-- Logs begin at Tue 2022-07-19 18:47:13 UTC, end at Tue 2022-07-19 21:30:01 UTC. -- Jul 19 19:28:31.245413 n-d-843834-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 19:28:31.255968 n-d-843834-3 devstack@n-api.service[104221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 19:28:31 2022] *** Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: nodename: n-d-843834-3 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: machine: x86_64 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: clock source: unix Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: pcre jit disabled Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: detected number of CPU cores: 4 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: current working directory: / Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: detected binary path: /usr/bin/uwsgi-core Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: your processes number limit is 47680 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: your memory page size is 4096 bytes Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: detected max file descriptor number: 2048 Jul 19 19:28:31.258255 n-d-843834-3 devstack@n-api.service[104221]: lock engine: pthread robust mutexes Jul 19 19:28:31.259284 n-d-843834-3 devstack@n-api.service[104221]: thunder lock: enabled Jul 19 19:28:31.259284 n-d-843834-3 devstack@n-api.service[104221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 19:28:31.259284 n-d-843834-3 devstack@n-api.service[104221]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 19:28:31.306497 n-d-843834-3 devstack@n-api.service[104221]: Python main interpreter initialized at 0x558c84fd89c0 Jul 19 19:28:31.306497 n-d-843834-3 devstack@n-api.service[104221]: python threads support enabled Jul 19 19:28:31.306497 n-d-843834-3 devstack@n-api.service[104221]: your server socket listen backlog is limited to 100 connections Jul 19 19:28:31.306497 n-d-843834-3 devstack@n-api.service[104221]: your mercy for graceful operations on workers is 90 seconds Jul 19 19:28:31.306863 n-d-843834-3 devstack@n-api.service[104221]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 19:28:31.306863 n-d-843834-3 devstack@n-api.service[104221]: *** Operational MODE: preforking *** Jul 19 19:28:31.307182 n-d-843834-3 devstack@n-api.service[104221]: *** uWSGI is running in multiple interpreter mode *** Jul 19 19:28:31.307182 n-d-843834-3 devstack@n-api.service[104221]: spawned uWSGI master process (pid: 104221) Jul 19 19:28:31.307372 n-d-843834-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 19:28:31.308397 n-d-843834-3 devstack@n-api.service[104221]: spawned uWSGI worker 1 (pid: 104222, cores: 1) Jul 19 19:28:31.308397 n-d-843834-3 devstack@n-api.service[104221]: spawned uWSGI worker 2 (pid: 104223, cores: 1) Jul 19 19:28:31.308397 n-d-843834-3 devstack@n-api.service[104221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 19:28:31.955883 n-d-843834-3 devstack@n-api.service[104223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:28:31.957456 n-d-843834-3 devstack@n-api.service[104222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:28:33.068229 n-d-843834-3 devstack@n-api.service[104223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:28:33.068229 n-d-843834-3 devstack@n-api.service[104223]: from cryptography.utils import int_from_bytes Jul 19 19:28:33.068850 n-d-843834-3 devstack@n-api.service[104222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:28:33.068850 n-d-843834-3 devstack@n-api.service[104222]: from cryptography.utils import int_from_bytes Jul 19 19:28:33.069347 n-d-843834-3 devstack@n-api.service[104223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:28:33.069347 n-d-843834-3 devstack@n-api.service[104223]: from cryptography.utils import int_from_bytes Jul 19 19:28:33.069478 n-d-843834-3 devstack@n-api.service[104222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:28:33.069478 n-d-843834-3 devstack@n-api.service[104222]: from cryptography.utils import int_from_bytes Jul 19 19:28:35.494470 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:28:35.495065 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:28:35.495168 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:28:35.495516 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:28:35.495742 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:28:35.496152 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.496473 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.496789 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.497102 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.497428 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.497740 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.498056 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.498371 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.498693 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.499081 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.499281 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.499587 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843834-3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.499903 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.500211 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.500516 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.500826 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.501133 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.501451 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.501755 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.503516 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.503516 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.503753 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:28:35.504133 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504219 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:28:35.504312 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504312 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504465 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:28:35.504551 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504644 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:28:35.504724 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504822 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:28:35.504904 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.504982 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505112 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505203 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505283 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505426 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505512 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505636 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505769 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843834-3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.505864 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506065 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506157 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506370 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506462 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506740 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.506876 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507123 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507238 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507373 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507491 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507691 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.507783 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508019 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843834-3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508111 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508334 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508437 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508638 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508735 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.508938 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509029 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509252 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509362 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509550 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509642 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509862 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.509960 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510158 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510256 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510464 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510647 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510749 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.510980 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511086 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511265 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511394 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511574 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511675 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511903 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.511996 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512205 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512294 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512490 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512594 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512802 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.512896 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513103 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513192 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513355 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513442 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513603 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.513702 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514014 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514125 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843834-3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514216 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514378 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514525 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514683 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.514829 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515022 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515158 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515427 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515559 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515733 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.515834 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516034 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516142 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516334 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516418 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516640 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516728 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.516951 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517037 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517264 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517360 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517575 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517672 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517879 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.517966 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518192 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518279 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518490 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518638 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518791 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.518874 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519120 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519224 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519431 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519542 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519727 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.519860 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520024 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520169 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520266 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520486 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520594 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520806 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.520892 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521111 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521210 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521417 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521503 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521684 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521779 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.521930 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522018 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522265 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522372 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522578 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522673 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.522879 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523029 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523209 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523309 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523507 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523609 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523805 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.523890 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524105 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524192 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524404 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524500 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524702 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524789 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.524998 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525083 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525302 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525391 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525607 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525694 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525910 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.525995 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526210 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526303 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526510 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526595 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526812 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.526899 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527137 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527240 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527437 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527524 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527735 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.527822 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528050 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528150 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528358 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528443 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528660 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528753 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.528959 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529054 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529257 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529344 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529556 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529651 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529855 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.529943 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530158 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530243 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530462 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530559 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530764 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.530860 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531047 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531149 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531345 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531441 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531646 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531737 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.531957 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532043 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532258 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532356 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532559 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532680 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532856 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.532944 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533149 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533248 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533448 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533537 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533752 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.533844 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534051 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534148 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534345 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534437 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534643 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534729 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.534960 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535071 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535263 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535348 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535558 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535651 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535854 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.535940 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536149 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536235 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536457 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536552 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536759 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.536854 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537059 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537153 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537359 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537529 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537657 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.537743 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.538023 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.538120 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.538346 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.538435 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.538648 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.538736 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.538984 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.539074 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.539288 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.539385 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.539586 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.539673 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.539894 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.539983 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.540201 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.540297 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.540501 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.540588 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.540813 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.540899 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.541109 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.541204 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.541410 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.541496 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.541719 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.541814 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.542018 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.542115 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.542316 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.542402 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.542610 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.542706 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.542955 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.543048 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.543232 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.543318 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.543530 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.543616 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.543824 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.543911 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.544120 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.544265 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.544413 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.544501 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.544728 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.544871 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.545041 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.545143 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.545341 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.545448 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.545640 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.545738 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.545937 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.546033 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.546248 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:28:35.546354 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.546575 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.546670 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.546900 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547035 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547229 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547337 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547537 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547646 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547844 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.547939 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548162 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548272 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548481 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548576 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548787 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.548888 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549098 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549201 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549418 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549520 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549707 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.549811 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550012 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550118 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550315 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550418 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550623 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550717 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.550951 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551060 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551276 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551386 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551585 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551707 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.551900 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552000 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552207 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552301 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552511 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552607 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552811 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.552906 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553122 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553223 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553461 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553556 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553755 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.553846 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554057 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554148 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554364 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554479 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554665 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.554758 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555004 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555096 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555329 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555433 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555635 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555734 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.555941 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556033 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556246 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556350 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556553 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556644 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556863 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.556961 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557167 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557271 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557469 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557593 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557778 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.557867 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558084 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558188 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558388 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558485 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558695 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.558786 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559047 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559136 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559321 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559420 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559643 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559736 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.559949 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560040 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560252 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560351 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560562 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560671 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560866 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.560965 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561170 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561260 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561476 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561567 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561777 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.561868 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562113 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562262 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562396 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562514 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562719 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.562852 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563014 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563130 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563365 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563514 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563650 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563747 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.563953 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564059 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564277 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564380 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564578 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564672 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564881 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.564983 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565183 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565286 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565486 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565580 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565785 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.565879 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566085 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566179 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566390 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566484 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566687 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.566788 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567009 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567105 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567312 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567407 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567615 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567708 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.567917 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568017 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568222 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568323 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568524 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568618 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568823 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.568924 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569178 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569287 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569483 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569595 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569789 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.569891 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570095 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570191 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570412 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570518 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570719 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.570823 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571049 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571199 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571380 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571526 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571688 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571823 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.571991 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572203 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572294 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572383 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572590 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572677 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572897 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.572993 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573194 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573348 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573500 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573634 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573798 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.573931 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.574100 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.574227 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.574751 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.574883 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575088 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575215 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575388 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575523 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575687 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575822 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.575985 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576111 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576282 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576416 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576582 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576708 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.576897 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577024 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577205 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577332 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577504 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577630 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577800 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.577937 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578097 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578230 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578401 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578526 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578710 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.578847 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579038 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579167 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579345 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579471 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579657 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579798 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.579963 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580090 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580272 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580396 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580572 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580710 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580872 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.580997 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581179 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581314 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581484 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581611 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581782 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.581907 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582091 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582231 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582449 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582602 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582728 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.582851 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583019 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583155 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583289 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583403 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583596 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583722 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.583909 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584035 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584206 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584341 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584514 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584641 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584872 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.584997 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585194 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585321 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585504 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585630 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585818 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.585953 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586121 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586248 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586426 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586552 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586726 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.586860 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587058 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587186 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587360 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587485 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587659 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587863 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.587989 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588111 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588243 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588364 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588548 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588684 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588850 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.588976 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589163 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589290 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589468 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589595 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589774 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.589907 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590072 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590200 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590507 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590686 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.590811 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591011 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591139 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591321 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591458 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591621 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591748 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.591935 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592061 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592240 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592368 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592569 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592702 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592826 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.592956 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593117 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593245 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593416 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593534 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593718 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.593855 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594022 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594146 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594322 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594446 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594627 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594761 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.594950 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595089 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595258 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595357 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595558 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595671 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595867 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.595962 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596176 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596272 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596488 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596585 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596807 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.596903 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597116 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597211 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597425 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597520 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597734 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.597840 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598036 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598173 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598319 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598452 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598640 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598775 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.598963 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599237 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599397 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599545 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599677 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599818 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.599977 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600138 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600229 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600530 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600620 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600831 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.600918 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601145 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601233 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601461 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601547 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601766 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.601852 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602077 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602176 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602382 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602476 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602690 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.602784 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603017 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603121 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603331 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603416 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603638 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603736 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.603940 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604036 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604243 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604342 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604548 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604641 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604849 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.604951 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605151 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605238 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605451 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605536 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605752 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.605838 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606054 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606149 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606352 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606440 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606655 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606743 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.606975 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607063 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607301 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607541 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607642 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607870 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.607965 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608179 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608273 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608480 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608580 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608790 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.608876 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609103 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609190 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609426 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609513 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609746 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.609833 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610076 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610217 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610376 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610477 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610679 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.610766 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611001 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611090 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611304 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611477 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611610 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611706 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611907 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.611994 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612205 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612300 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612506 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612593 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612804 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.612892 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613100 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613199 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613399 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613487 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613699 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613819 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.613998 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614100 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614296 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614403 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614592 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614745 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.614956 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615100 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615247 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615382 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615519 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615653 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615799 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.615936 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616095 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616239 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616383 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616519 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616664 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616812 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.616979 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617123 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617286 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617437 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617575 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617717 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.617885 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618029 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618187 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618339 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618477 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618631 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618767 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.618902 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619079 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619228 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619379 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619517 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619654 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619796 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.619970 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620128 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620293 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620431 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620580 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620716 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620861 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.620998 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621133 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621284 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621420 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621555 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621698 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.621835 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622003 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622148 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622283 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622435 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622581 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622727 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.622982 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623140 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623279 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623415 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623560 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623697 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623834 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.623971 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624114 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624265 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624414 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624552 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624688 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624829 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.624966 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625118 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625256 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625392 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625536 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625674 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625818 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.625970 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626107 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626253 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626390 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626533 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626670 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626815 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.626971 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627114 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627251 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627386 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627534 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627679 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.627825 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628002 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628163 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628301 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628445 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628583 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628719 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628855 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.628998 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629136 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629280 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629417 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629553 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629698 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629849 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.629985 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630133 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630270 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630413 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630550 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630686 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.630860 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631040 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631213 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631358 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631563 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631720 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.631881 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632025 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632162 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632386 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632528 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632665 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632810 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.632973 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633189 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633332 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633468 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633605 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633750 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.633898 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634034 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634183 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634333 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634484 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634621 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634756 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.634903 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635071 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635207 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635360 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635498 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635635 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635782 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.635918 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636053 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636197 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636333 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636470 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636606 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636742 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.636877 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637022 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637189 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637425 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637588 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637723 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.637867 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638013 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638150 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638293 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638430 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638566 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638788 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.638963 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639121 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639259 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639395 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639548 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639693 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639837 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.639974 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640109 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640244 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640381 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640526 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640671 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640815 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.640952 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641087 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641223 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641377 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641515 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641706 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641845 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.641980 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642129 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642266 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642402 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642545 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642681 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642823 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.642990 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643133 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643376 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643525 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643663 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643806 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.643956 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644120 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644369 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644512 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644649 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644786 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.644931 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645077 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645226 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645362 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645499 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645647 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645793 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.645931 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646067 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646202 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646345 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646489 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646627 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646761 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.646898 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647100 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647244 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647398 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647536 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647679 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647817 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.647959 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648179 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648337 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648475 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648611 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648783 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.648934 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649092 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649229 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649375 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649520 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649657 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649792 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.649965 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650119 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650257 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650401 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650560 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650704 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.650982 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651152 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651291 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651426 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651573 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651709 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.651882 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652035 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652172 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652308 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652452 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652596 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652759 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.652912 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653080 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653224 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653387 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653609 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653752 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.653898 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654034 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654170 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654334 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654497 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654637 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654787 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.654975 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655121 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655258 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655395 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655555 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655714 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655852 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.655990 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656202 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656353 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656492 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656641 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656805 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.656985 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657135 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657273 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657419 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657557 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657742 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.657888 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658026 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658166 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658311 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658457 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658595 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658750 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.658889 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659090 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659241 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659516 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659660 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659805 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.659943 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660093 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660230 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660376 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660514 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660662 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660811 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.660949 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661086 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661267 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661412 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661575 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661729 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.661878 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662015 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662169 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662376 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662519 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662675 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.662867 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663050 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663191 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663338 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663476 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663640 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663851 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.663992 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664129 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664265 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664410 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664568 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664706 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.664844 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665020 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665163 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665339 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665489 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665647 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665790 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.665937 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666075 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666221 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666358 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666506 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666642 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.666821 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667033 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667187 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667323 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667461 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667597 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667734 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.667881 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668019 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668155 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668291 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668438 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668576 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668720 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668858 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.668996 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669166 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669309 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669453 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669603 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669774 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.669918 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670077 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670219 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670373 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670518 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670656 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670801 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.670962 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671107 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671293 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671438 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671596 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671747 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.671926 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672072 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672233 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672550 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672727 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.672885 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673021 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673169 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673313 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673451 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673596 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673743 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.673963 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674118 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674267 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674405 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674550 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674697 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.674844 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675047 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675189 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675326 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675462 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675598 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675749 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.675897 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676040 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676197 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676336 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676480 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676669 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676810 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.676961 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677099 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677259 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677411 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677560 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677698 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677834 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.677970 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678117 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678263 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678452 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678597 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678788 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.678965 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679111 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679260 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679423 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679568 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679735 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.679880 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680036 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680185 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680323 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680460 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680639 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680783 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.680955 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681098 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681267 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681410 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681577 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681730 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.681884 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682050 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682217 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682388 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682542 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682686 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.682838 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683032 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683173 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683316 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683458 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683694 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.683850 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684091 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684236 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684522 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684676 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684830 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.684975 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685126 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685270 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685412 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685563 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685717 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.685880 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686025 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686175 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686328 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686481 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686625 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686770 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.686930 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687092 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687246 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687399 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687544 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687696 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.687848 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688000 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688153 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688297 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688439 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688580 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688723 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.688875 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689019 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689161 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689304 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689454 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689607 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689762 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.689907 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690050 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690229 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690380 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690554 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690782 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.690994 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691147 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691290 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691479 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691479 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691790 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.691942 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692088 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692088 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692359 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692514 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692665 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692816 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.692959 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693102 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693245 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693245 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693537 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693679 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693830 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.693996 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.694238 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.694398 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.694544 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.694686 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.694839 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695012 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695170 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695316 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695480 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695656 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695820 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.695965 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696123 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696267 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696410 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696561 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696705 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696847 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.696999 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697151 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697315 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697458 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697600 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697757 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.697900 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698043 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698195 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698340 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698484 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698636 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.698816 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.699008 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.699181 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.699339 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.699847 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700009 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700161 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700304 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700447 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700596 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700740 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.700891 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701042 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701186 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701330 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701473 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701638 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701638 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.701910 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702059 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702209 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702353 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702504 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702656 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702799 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.702966 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703118 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703260 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703419 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703580 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703736 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.703880 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704030 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704171 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704407 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704559 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704704 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.704866 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705010 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705161 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705305 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705460 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705604 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705746 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.705746 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706024 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706168 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706321 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706472 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706615 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706758 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.706931 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707085 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707228 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707406 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707590 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707738 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.707890 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708043 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708188 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708332 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708483 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708636 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708780 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.708932 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709075 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709226 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709388 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709539 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709746 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.709898 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710041 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710184 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710327 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710481 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710624 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710774 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.710961 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711112 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711255 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711420 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711564 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711707 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.711850 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712002 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712159 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712303 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712458 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712603 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712746 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.712889 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713045 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713200 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713343 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713485 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713627 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713776 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.713934 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714079 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714222 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714381 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714604 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714770 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.714942 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715106 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715268 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715412 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715555 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715707 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.715858 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716002 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716152 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716297 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716448 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716605 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716605 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.716888 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717042 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717217 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717384 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717541 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717685 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717835 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.717979 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718122 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718274 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718418 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718560 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718702 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.718844 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719056 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719282 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719438 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719590 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719736 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.719887 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720030 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720185 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720331 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720473 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720623 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720773 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720937 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.720937 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721210 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721353 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721495 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721646 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721800 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.721944 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722086 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722228 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722370 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722513 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722664 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722817 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.722984 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723134 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723278 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723433 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723578 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723720 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.723863 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724006 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724178 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724354 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724501 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724745 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.724898 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725042 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725184 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725366 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725511 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725663 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725807 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.725949 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726100 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726252 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726397 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726539 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726697 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.726840 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727054 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727210 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727354 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727499 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727644 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727644 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.727922 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728066 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728218 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728361 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728520 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728665 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728817 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.728969 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729113 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729256 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729398 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729549 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729692 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729844 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.729995 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730139 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730282 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730447 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730592 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730735 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.730877 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731071 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731177 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731289 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731375 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731456 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731536 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731617 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731790 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.731955 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732107 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732252 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732414 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732636 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732800 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.732947 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733090 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733233 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733405 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733576 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733732 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.733876 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734038 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734183 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734325 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734477 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734637 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.734867 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735051 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735205 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735350 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735510 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735654 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735796 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.735939 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736095 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736247 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736399 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736543 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736686 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736827 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.736969 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737115 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737266 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737431 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737657 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737806 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.737961 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738105 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738105 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738386 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738529 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738671 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.738813 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739019 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739171 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739324 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739468 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739611 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739754 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.739917 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740062 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740207 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740350 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740501 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740651 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.740804 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.741035 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.741230 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.741426 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.741656 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.741889 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.742093 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.742290 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.742500 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.742686 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.742834 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743037 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743184 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743327 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743471 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743471 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743471 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.743471 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.744024 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.744194 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.744435 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.744629 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.744783 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745020 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745138 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745223 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745305 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745393 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745485 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745569 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745656 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745738 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.745819 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746079 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746229 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746409 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746547 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746722 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746858 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.746985 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:28:35.747163 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.747379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.747701 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.748017 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.748331 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.748660 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.749188 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.749520 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.749835 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.750147 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.750456 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.750774 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.751108 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.751422 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.751739 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.752041 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.752464 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.753062 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.753630 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.754239 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.754852 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.755538 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.756122 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.756775 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.757351 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.757903 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.758454 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.759029 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:28:35.759482 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:28:35.810343 n-d-843834-3 devstack@n-api.service[104223]: INFO dbcounter [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Registered counter for database nova_api Jul 19 19:28:35.833391 n-d-843834-3 devstack@n-api.service[104222]: INFO dbcounter [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Registered counter for database nova_api Jul 19 19:28:35.925711 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:35.932614 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writer thread running {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:35.948190 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_db.sqlalchemy.engines [None req-cff94424-2278-4363-81a3-343dfeca231a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:35.955354 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writer thread running {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:35.988327 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.context [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=104223) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:28:35.992367 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_concurrency.lockutils [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:28:35.993947 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_concurrency.lockutils [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:28:35.994794 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_concurrency.lockutils [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:28:35.996885 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_concurrency.lockutils [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:28:35.998871 n-d-843834-3 devstack@n-api.service[104223]: INFO dbcounter [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Registered counter for database nova_cell0 Jul 19 19:28:36.002728 n-d-843834-3 devstack@n-api.service[104223]: INFO dbcounter [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Registered counter for database nova_cell1 Jul 19 19:28:36.010184 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.010996 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.context [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=104222) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:28:36.012390 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.015102 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:28:36.016644 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writer thread running {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.016742 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:28:36.017515 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:28:36.019747 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:28:36.021793 n-d-843834-3 devstack@n-api.service[104222]: INFO dbcounter [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Registered counter for database nova_cell0 Jul 19 19:28:36.025835 n-d-843834-3 devstack@n-api.service[104222]: INFO dbcounter [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Registered counter for database nova_cell1 Jul 19 19:28:36.033462 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_db.sqlalchemy.engines [None req-cff94424-2278-4363-81a3-343dfeca231a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.037037 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_db.sqlalchemy.engines [None req-cff94424-2278-4363-81a3-343dfeca231a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.040146 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writer thread running {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.156337 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writer thread running {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.166806 n-d-843834-3 devstack@n-api.service[104223]: INFO dbcounter [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Registered counter for database nova_cell0 Jul 19 19:28:36.176026 n-d-843834-3 devstack@n-api.service[104223]: DEBUG oslo_db.sqlalchemy.engines [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.178872 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writer thread running {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.181038 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writer thread running {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.189289 n-d-843834-3 devstack@n-api.service[104222]: INFO dbcounter [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Registered counter for database nova_cell0 Jul 19 19:28:36.198531 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_db.sqlalchemy.engines [None req-cff94424-2278-4363-81a3-343dfeca231a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:28:36.203726 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writer thread running {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:28:36.514647 n-d-843834-3 devstack@n-api.service[104223]: WARNING keystonemiddleware.auth_token [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:28:36.517819 n-d-843834-3 devstack@n-api.service[104222]: WARNING keystonemiddleware.auth_token [None req-cff94424-2278-4363-81a3-343dfeca231a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:28:36.522133 n-d-843834-3 devstack@n-api.service[104223]: WARNING keystonemiddleware.auth_token [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:28:36.525272 n-d-843834-3 devstack@n-api.service[104222]: WARNING keystonemiddleware.auth_token [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:28:36.863293 n-d-843834-3 devstack@n-api.service[104223]: WARNING keystonemiddleware.auth_token [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:28:36.866731 n-d-843834-3 devstack@n-api.service[104222]: WARNING keystonemiddleware.auth_token [None req-cff94424-2278-4363-81a3-343dfeca231a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:28:36.869360 n-d-843834-3 devstack@n-api.service[104223]: WARNING keystonemiddleware.auth_token [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:28:36.872759 n-d-843834-3 devstack@n-api.service[104222]: WARNING keystonemiddleware.auth_token [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:28:36.874588 n-d-843834-3 devstack@n-api.service[104223]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c84fd89c0 pid: 104223 (default app) Jul 19 19:28:36.876661 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:28:36.877862 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-5f1096d2-aaec-40bb-bb37-89ceba0c4bf5 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jul 19 19:28:36.877994 n-d-843834-3 devstack@n-api.service[104222]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c84fd89c0 pid: 104222 (default app) Jul 19 19:28:36.878269 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Jul 19 19:28:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:29:53.841151 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:29:53.842475 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-cff94424-2278-4363-81a3-343dfeca231a None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jul 19 19:29:53.842878 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:29:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:29:53.854359 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_api:SELECT=3 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:53.855330 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_cell1:SELECT=3 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:53.856270 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_cell0:SELECT=3 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:53.857276 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:54.726980 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-46b37da0-482f-4630-a752-a695c059e671 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:29:54.757819 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-46b37da0-482f-4630-a752-a695c059e671 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.908754 Jul 19 19:29:54.758691 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 19:29:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:29:56.993072 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-cff94424-2278-4363-81a3-343dfeca231a None None] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:29:56.994136 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-cff94424-2278-4363-81a3-343dfeca231a None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 19 19:29:56.994808 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:29:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:29:57.479524 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-a57ec8ea-28d8-44ba-be62-5c6d23711aab admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:29:57.497558 n-d-843834-3 devstack@n-api.service[104223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:29:57.497558 n-d-843834-3 devstack@n-api.service[104223]: warnings.warn(msg) Jul 19 19:29:57.527204 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-a57ec8ea-28d8-44ba-be62-5c6d23711aab admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526145 Jul 19 19:29:57.528073 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:29:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:29:57.541288 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_api:SELECT=3 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:57.542442 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_cell0:SELECT=3 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:57.543151 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_cell1:SELECT=3 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:57.544333 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_cell0:SELECT=3 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:29:57.751175 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-be7f25b2-43c2-4362-8028-875a62257ff6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:29:57.753680 n-d-843834-3 devstack@n-api.service[104222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:29:57.753680 n-d-843834-3 devstack@n-api.service[104222]: warnings.warn(msg) Jul 19 19:29:57.817543 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-be7f25b2-43c2-4362-8028-875a62257ff6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281405 Jul 19 19:29:57.818160 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 19 19:29:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:30:00.100797 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-a57ec8ea-28d8-44ba-be62-5c6d23711aab admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:00.102493 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-a57ec8ea-28d8-44ba-be62-5c6d23711aab admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002150 Jul 19 19:30:00.102890 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:00.949941 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-5c201924-6719-47bb-936a-95cea9c0f9f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:00.967858 n-d-843834-3 devstack@n-api.service[104222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:30:00.967858 n-d-843834-3 devstack@n-api.service[104222]: warnings.warn(msg) Jul 19 19:30:00.987997 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-5c201924-6719-47bb-936a-95cea9c0f9f9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.878696 Jul 19 19:30:00.988556 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:01.000322 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-4bdd8c43-cf78-464a-a03a-846d94b6720c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:01.001824 n-d-843834-3 devstack@n-api.service[104223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:30:01.001824 n-d-843834-3 devstack@n-api.service[104223]: warnings.warn(msg) Jul 19 19:30:01.034701 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-4bdd8c43-cf78-464a-a03a-846d94b6720c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038028 Jul 19 19:30:01.051034 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 19 19:30:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:03.474820 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-5c201924-6719-47bb-936a-95cea9c0f9f9 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:03.475890 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-5c201924-6719-47bb-936a-95cea9c0f9f9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 19 19:30:03.481335 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:04.029047 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-8ebe8e60-8224-4c79-a589-2488ec233552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "swap": 0, "disk": 10, "ram": 1024}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:04.049600 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-8ebe8e60-8224-4c79-a589-2488ec233552 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565287 Jul 19 19:30:04.066323 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-712938ba-00ca-48cc-98be-7bd2a6951e9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:04.069657 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:30:04.096548 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-712938ba-00ca-48cc-98be-7bd2a6951e9d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037344 Jul 19 19:30:04.106359 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 19 19:30:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:06.577017 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-8ebe8e60-8224-4c79-a589-2488ec233552 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:06.578513 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-8ebe8e60-8224-4c79-a589-2488ec233552 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Jul 19 19:30:06.579221 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:06.991261 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-17c46847-8dec-48c2-b970-087d5e011da2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:07.021986 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-17c46847-8dec-48c2-b970-087d5e011da2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436574 Jul 19 19:30:07.022549 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:30:07.047547 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-303a0725-1d8a-46fd-8f2c-3474f64d8ad8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:07.084309 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-303a0725-1d8a-46fd-8f2c-3474f64d8ad8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045679 Jul 19 19:30:07.084826 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 19 19:30:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:09.515737 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-17c46847-8dec-48c2-b970-087d5e011da2 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:09.517380 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-17c46847-8dec-48c2-b970-087d5e011da2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Jul 19 19:30:09.518079 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:30:10.101801 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:10.137626 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.612181 Jul 19 19:30:10.139443 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:10.151472 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-378a6881-b82a-407c-b930-465dfcbb053a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:10.176833 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-378a6881-b82a-407c-b930-465dfcbb053a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029380 Jul 19 19:30:10.190946 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 19 19:30:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:12.669180 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:12.675368 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006581 Jul 19 19:30:12.679198 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:13.508660 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-1eb992d2-a7c2-476b-938e-eb3836982d1a admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:13.551917 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-1eb992d2-a7c2-476b-938e-eb3836982d1a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.868680 Jul 19 19:30:13.559237 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 19:30:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:15.810075 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:15.811352 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-f10b2e04-cf07-4f40-b82f-c007c34ab85b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jul 19 19:30:15.811768 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:16.237488 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-44b44a7e-b99d-4d99-9543-9f3cd7945a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "id": "1", "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:16.258320 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-44b44a7e-b99d-4d99-9543-9f3cd7945a6d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439521 Jul 19 19:30:16.258879 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:16.272672 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-008317dd-a6ca-46a2-b8a7-db04f1d5f6bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:16.299064 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-008317dd-a6ca-46a2-b8a7-db04f1d5f6bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030505 Jul 19 19:30:16.299656 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 19 19:30:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:30:18.744079 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-44b44a7e-b99d-4d99-9543-9f3cd7945a6d admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:18.745182 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-44b44a7e-b99d-4d99-9543-9f3cd7945a6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 19 19:30:18.745764 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:19.194015 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-22bdf2cc-f153-4190-864d-cc690f4556b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "vcpus": 1}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:19.214805 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-22bdf2cc-f153-4190-864d-cc690f4556b2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462966 Jul 19 19:30:19.215433 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:30:19.228379 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-c14d3bec-9144-4620-85ad-7de5d726ef8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:19.255448 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-c14d3bec-9144-4620-85ad-7de5d726ef8c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030872 Jul 19 19:30:19.255906 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 19 19:30:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:21.557299 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-22bdf2cc-f153-4190-864d-cc690f4556b2 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:21.558684 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-22bdf2cc-f153-4190-864d-cc690f4556b2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jul 19 19:30:21.559390 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:21.994275 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-067f6716-f443-4cfd-9945-d41c2117c37f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:22.016204 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-067f6716-f443-4cfd-9945-d41c2117c37f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449650 Jul 19 19:30:22.016795 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:22.034278 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-97d5f078-512c-4458-8daf-bc20d46955b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:22.060679 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-97d5f078-512c-4458-8daf-bc20d46955b7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034244 Jul 19 19:30:22.061324 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 19 19:30:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:24.379636 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-067f6716-f443-4cfd-9945-d41c2117c37f admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:24.380584 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-067f6716-f443-4cfd-9945-d41c2117c37f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 19 19:30:24.380958 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:24.790512 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-c15c13db-daed-4b12-ba38-5178946a2c31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:24.795353 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:30:24.811883 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-c15c13db-daed-4b12-ba38-5178946a2c31 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424859 Jul 19 19:30:24.819559 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:24.824966 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-bc22a3ed-0144-40d0-83db-94bfc62052dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:24.847512 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-bc22a3ed-0144-40d0-83db-94bfc62052dc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026638 Jul 19 19:30:24.848061 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 19 19:30:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:27.079589 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-c15c13db-daed-4b12-ba38-5178946a2c31 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:27.080599 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-c15c13db-daed-4b12-ba38-5178946a2c31 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 19 19:30:27.081182 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:27.482236 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:27.500416 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.412652 Jul 19 19:30:27.500970 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 19 19:30:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:30:27.513374 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e1b77334-9afe-464d-aa5f-9efbefc8c50d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:30:27.537523 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e1b77334-9afe-464d-aa5f-9efbefc8c50d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028118 Jul 19 19:30:27.538041 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 19 19:30:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:30:54.291908 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:54.293200 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jul 19 19:30:54.293699 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:54.301118 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:30:54.729881 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-0a6b9c37-0ed0-4a6c-9e1f-b336a1dc65cb admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:54.746648 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-0a6b9c37-0ed0-4a6c-9e1f-b336a1dc65cb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.446396 Jul 19 19:30:54.747294 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 19:30:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:55.836365 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:55.837377 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-77457464-c963-4d12-80de-e74d9e314c0e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 19:30:55.837801 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:56.419920 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-05805d69-5820-4221-9b4b-1533189d4d53 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:56.425921 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.wsgi [None req-05805d69-5820-4221-9b4b-1533189d4d53 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-05805d69-5820-4221-9b4b-1533189d4d53 admin admin] Request method failure captured: Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Accept: application/json Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Accept-Encoding: gzip, deflate Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Connection: keep-alive Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Content-Length: 0 Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Host: 10.222.0.23 Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: Openstack-System-Scope: None Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: User-Agent: python-novaclient Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Auth-Token: gAAAAABi1wZvvs9HsQOlwcwqRLRCUarjHNqj0XBj5zd3vPHmwDvsj574F76IzDpNdPv3aIS7e4mVlqyOJqNDb4-6xVFk0ZZXQ9mIDcg0yhlIoS-E0e7_jSMs0f-qz0ecFD-5QgGzOsPWwqEnp1tc5fxdRHZgaMZT7kc7hE7wA2ylzVUMjTSU-ts Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Id: None Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Name: None Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Identity-Status: Confirmed Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Is-Admin-Project: True Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Id: default Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Name: Default Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Name: admin Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Role: reader,admin,member Jul 19 19:30:56.429242 n-d-843834-3 devstack@n-api.service[104223]: X-Roles: reader,admin,member Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant: admin Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Name: admin Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-User: admin Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Id: default Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Name: Default Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: X-User-Name: admin Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: method: > Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: exception: Flavor 42 could not be found. Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: action_args: {'id': '42'} Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:56.430937 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:56.432060 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.433588 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-05805d69-5820-4221-9b4b-1533189d4d53 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:56.434872 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-05805d69-5820-4221-9b4b-1533189d4d53 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445797 Jul 19 19:30:56.434872 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:30:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:30:56.440683 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-896014ac-cf9f-4a5a-ba40-736627fed4b7 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:56.444833 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:30:56.464895 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-896014ac-cf9f-4a5a-ba40-736627fed4b7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027874 Jul 19 19:30:56.465470 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:56.491595 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-ca3deb70-7f16-4783-8ea6-8d0358b300c4 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:56.513450 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-ca3deb70-7f16-4783-8ea6-8d0358b300c4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025511 Jul 19 19:30:56.514017 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:56.524146 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-98fb33a3-0b33-4481-94cc-ca7f61e594bd admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:56.530328 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.wsgi [None req-98fb33a3-0b33-4481-94cc-ca7f61e594bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-98fb33a3-0b33-4481-94cc-ca7f61e594bd admin admin] Request method failure captured: Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Accept: application/json Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Accept-Encoding: gzip, deflate Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Connection: keep-alive Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Content-Length: 0 Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Host: 10.222.0.23 Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: Openstack-System-Scope: None Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: User-Agent: python-novaclient Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Auth-Token: gAAAAABi1wZvvs9HsQOlwcwqRLRCUarjHNqj0XBj5zd3vPHmwDvsj574F76IzDpNdPv3aIS7e4mVlqyOJqNDb4-6xVFk0ZZXQ9mIDcg0yhlIoS-E0e7_jSMs0f-qz0ecFD-5QgGzOsPWwqEnp1tc5fxdRHZgaMZT7kc7hE7wA2ylzVUMjTSU-ts Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Id: None Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Name: None Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Identity-Status: Confirmed Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Is-Admin-Project: True Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Id: default Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Name: Default Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Name: admin Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Role: reader,admin,member Jul 19 19:30:56.533719 n-d-843834-3 devstack@n-api.service[104222]: X-Roles: reader,admin,member Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant: admin Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Name: admin Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-User: admin Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Id: default Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Name: Default Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: X-User-Name: admin Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: method: > Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: exception: Flavor 42 could not be found. Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: action_args: {'id': '42'} Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:56.535249 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:56.536215 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:56.537506 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-98fb33a3-0b33-4481-94cc-ca7f61e594bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:56.538776 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-98fb33a3-0b33-4481-94cc-ca7f61e594bd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015180 Jul 19 19:30:56.538776 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:30:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:30:57.656078 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-ca3deb70-7f16-4783-8ea6-8d0358b300c4 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:57.657113 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-ca3deb70-7f16-4783-8ea6-8d0358b300c4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 19 19:30:57.657507 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:58.211850 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-23d21e6e-8eb3-4aa8-bba9-d29d4b62b38f admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:58.221100 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.wsgi [None req-23d21e6e-8eb3-4aa8-bba9-d29d4b62b38f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-23d21e6e-8eb3-4aa8-bba9-d29d4b62b38f admin admin] Request method failure captured: Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Accept: application/json Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Accept-Encoding: gzip, deflate Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Connection: keep-alive Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Content-Length: 0 Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Host: 10.222.0.23 Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: Openstack-System-Scope: None Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: User-Agent: python-novaclient Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Auth-Token: gAAAAABi1wZxIBB7xNL-DV1535vgMDHtNP_wSacJhkYTzFp1FW_cxXqwThJiDKhBGyvkhh1m2bJnu0gSGoiYc8MVrh6LlGGV19qPKX2NDdzkPbiJPBc-25GQBOEB8pY74PnuEQR4pxgn47MKnSbm2W6RiwfV30mtczAWA2xjJ-ecrFFF4PIle7U Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Id: None Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Name: None Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Identity-Status: Confirmed Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Is-Admin-Project: True Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Id: default Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Name: Default Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Name: admin Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Role: reader,admin,member Jul 19 19:30:58.222557 n-d-843834-3 devstack@n-api.service[104222]: X-Roles: reader,admin,member Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant: admin Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Name: admin Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-User: admin Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Id: default Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Name: Default Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: X-User-Name: admin Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: method: > Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: exception: Flavor 84 could not be found. Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: action_args: {'id': '84'} Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:58.224159 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:58.227391 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.228672 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-23d21e6e-8eb3-4aa8-bba9-d29d4b62b38f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:58.229917 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-23d21e6e-8eb3-4aa8-bba9-d29d4b62b38f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432419 Jul 19 19:30:58.229917 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:30:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:30:58.238421 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-8dfa460f-11a8-48c3-b249-9a6c52a785d1 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:58.252361 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-8dfa460f-11a8-48c3-b249-9a6c52a785d1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021084 Jul 19 19:30:58.252886 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:58.262439 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-7fc9575b-8c04-4cef-abe5-dfd20e0ac603 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:58.276528 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-7fc9575b-8c04-4cef-abe5-dfd20e0ac603 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017598 Jul 19 19:30:58.277066 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:58.288370 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-7c58279b-288c-4664-bbdb-5db1d368bf83 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:58.294619 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.wsgi [None req-7c58279b-288c-4664-bbdb-5db1d368bf83 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-7c58279b-288c-4664-bbdb-5db1d368bf83 admin admin] Request method failure captured: Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Accept: application/json Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Accept-Encoding: gzip, deflate Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Connection: keep-alive Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Content-Length: 0 Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Host: 10.222.0.23 Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: Openstack-System-Scope: None Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: User-Agent: python-novaclient Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Auth-Token: gAAAAABi1wZxIBB7xNL-DV1535vgMDHtNP_wSacJhkYTzFp1FW_cxXqwThJiDKhBGyvkhh1m2bJnu0gSGoiYc8MVrh6LlGGV19qPKX2NDdzkPbiJPBc-25GQBOEB8pY74PnuEQR4pxgn47MKnSbm2W6RiwfV30mtczAWA2xjJ-ecrFFF4PIle7U Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Id: None Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Name: None Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Identity-Status: Confirmed Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Is-Admin-Project: True Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Id: default Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Name: Default Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Name: admin Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Role: reader,admin,member Jul 19 19:30:58.296174 n-d-843834-3 devstack@n-api.service[104223]: X-Roles: reader,admin,member Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant: admin Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Name: admin Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-User: admin Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Id: default Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Name: Default Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: X-User-Name: admin Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: method: > Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: exception: Flavor 84 could not be found. Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: action_args: {'id': '84'} Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:58.297709 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:58.298596 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:58.299803 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-7c58279b-288c-4664-bbdb-5db1d368bf83 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:58.300822 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-7c58279b-288c-4664-bbdb-5db1d368bf83 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014739 Jul 19 19:30:58.300822 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:30:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:30:59.300410 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-7fc9575b-8c04-4cef-abe5-dfd20e0ac603 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:59.301418 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-7fc9575b-8c04-4cef-abe5-dfd20e0ac603 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 19 19:30:59.301879 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:30:59.846321 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-16601c4d-5291-4ec2-9a25-03c43cc0c171 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:59.852444 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.wsgi [None req-16601c4d-5291-4ec2-9a25-03c43cc0c171 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-16601c4d-5291-4ec2-9a25-03c43cc0c171 admin admin] Request method failure captured: Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Accept: application/json Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Accept-Encoding: gzip, deflate Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Connection: keep-alive Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Content-Length: 0 Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Host: 10.222.0.23 Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: Openstack-System-Scope: None Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: User-Agent: python-novaclient Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Auth-Token: gAAAAABi1wZz3FpzDxMSAA7OuaKAAl9N6PK9lOo2EruhSK32EbGh5nWv2U2fZ-V4dE4MhqT3-NvVWbhimkuWYpZkaksXruszceWd7VgITL2bi0UrxnV8hl1OOhJe1AAWcQuLw2WLB1wIgT6lEeGa5mWxbS0wc9fmmxtUJO0_91lejGQNB-LkTAc Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Id: None Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Domain-Name: None Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Identity-Status: Confirmed Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Is-Admin-Project: True Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Id: default Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Domain-Name: Default Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Project-Name: admin Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Role: reader,admin,member Jul 19 19:30:59.853954 n-d-843834-3 devstack@n-api.service[104223]: X-Roles: reader,admin,member Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant: admin Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-Tenant-Name: admin Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-User: admin Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Id: default Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-User-Domain-Name: Default Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: X-User-Name: admin Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: method: > Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: exception: Flavor 451 could not be found. Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: action_args: {'id': '451'} Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:59.855491 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:59.856425 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.857798 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-16601c4d-5291-4ec2-9a25-03c43cc0c171 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:59.859348 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-16601c4d-5291-4ec2-9a25-03c43cc0c171 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416430 Jul 19 19:30:59.859348 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:30:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:30:59.865342 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-52b50c9d-f5d2-4ef4-8cff-3febafda47d9 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:59.879325 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-52b50c9d-f5d2-4ef4-8cff-3febafda47d9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017558 Jul 19 19:30:59.879846 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:59.889447 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:59.905779 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019837 Jul 19 19:30:59.906372 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:30:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:30:59.916285 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-be6f2f3e-85c5-4dc4-89f4-ca890ada7699 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:30:59.921959 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.wsgi [None req-be6f2f3e-85c5-4dc4-89f4-ca890ada7699 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-be6f2f3e-85c5-4dc4-89f4-ca890ada7699 admin admin] Request method failure captured: Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Accept: application/json Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Accept-Encoding: gzip, deflate Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Connection: keep-alive Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Content-Length: 0 Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Host: 10.222.0.23 Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Openstack-Api-Version: compute 2.90 Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: Openstack-System-Scope: None Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: User-Agent: python-novaclient Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Auth-Token: gAAAAABi1wZz3FpzDxMSAA7OuaKAAl9N6PK9lOo2EruhSK32EbGh5nWv2U2fZ-V4dE4MhqT3-NvVWbhimkuWYpZkaksXruszceWd7VgITL2bi0UrxnV8hl1OOhJe1AAWcQuLw2WLB1wIgT6lEeGa5mWxbS0wc9fmmxtUJO0_91lejGQNB-LkTAc Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Id: None Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Domain-Name: None Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Identity-Status: Confirmed Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Is-Admin-Project: True Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Id: default Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Domain-Name: Default Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Project-Name: admin Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Role: reader,admin,member Jul 19 19:30:59.923496 n-d-843834-3 devstack@n-api.service[104222]: X-Roles: reader,admin,member Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da083a626af04f3ebbcf9d4e2ec0567f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant: admin Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Id: da083a626af04f3ebbcf9d4e2ec0567f Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-Tenant-Name: admin Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-User: admin Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Id: default Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-User-Domain-Name: Default Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-User-Id: b0feb48f63ce473fa3842ae4cc0a6608 Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: X-User-Name: admin Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: method: > Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: exception: Flavor 451 could not be found. Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: action_args: {'id': '451'} Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:30:59.925000 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:59.925814 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: ERROR nova.api.openstack.wsgi Jul 19 19:30:59.927025 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-be6f2f3e-85c5-4dc4-89f4-ca890ada7699 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:30:59.928039 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-be6f2f3e-85c5-4dc4-89f4-ca890ada7699 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012292 Jul 19 19:30:59.928039 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:30:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:31:00.895158 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:00.896178 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 19 19:31:00.896566 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:31:01.461649 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-234193ef-a215-4d3c-974b-862c683fb2a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:31:01.482544 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-234193ef-a215-4d3c-974b-862c683fb2a0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.450274 Jul 19 19:31:01.483119 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 19 19:31:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:31:02.476114 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:02.477148 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 19 19:31:02.477546 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:31:03.059179 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-ffed5536-0371-4826-ba33-65edce77a28c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:31:03.083837 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-ffed5536-0371-4826-ba33-65edce77a28c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.471891 Jul 19 19:31:03.084396 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 19 19:31:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:31:04.079423 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:04.080459 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 19 19:31:04.080887 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:31:04.640013 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-2e46d1fa-2e59-4362-b978-915857313d05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:31:04.659084 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-2e46d1fa-2e59-4362-b978-915857313d05 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.443551 Jul 19 19:31:04.659622 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 19 19:31:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:31:05.661142 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:05.662154 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 19:31:05.662550 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:31:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:31:06.220392 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-6a3204a1-beb7-4600-bfe5-512af812f2db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:31:06.240748 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-6a3204a1-beb7-4600-bfe5-512af812f2db admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.444095 Jul 19 19:31:06.241290 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 19 19:31:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:31:07.221199 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:07.222248 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 19 19:31:07.222641 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:31:07.805842 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-a614a7b6-8492-4c20-a1d2-698ea244e8af admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:31:07.825096 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-a614a7b6-8492-4c20-a1d2-698ea244e8af admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.468715 Jul 19 19:31:07.825627 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Jul 19 19:31:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:32:00.081505 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.082507 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-e969e796-d232-4a6e-bd91-dcdd3e7a8016 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 19:32:00.082897 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:32:00.096800 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:32:00.528153 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-fe0578dc-6960-46ac-abeb-707a15741a00 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.547549 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-fe0578dc-6960-46ac-abeb-707a15741a00 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.457928 Jul 19 19:32:00.548094 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:32:00.569809 n-d-843834-3 devstack@n-api.service[104223]: DEBUG dbcounter [-] [104223] Writing DB stats nova_api:SELECT=14 {{(pid=104223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:32:00.574502 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-dd116116-ffc7-4c76-b588-432ee3a5ad16 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.583389 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-dd116116-ffc7-4c76-b588-432ee3a5ad16 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015178 Jul 19 19:32:00.583912 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:32:00.595912 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-69954894-6dc4-4619-b05b-9ef92fa55304 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.603760 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-69954894-6dc4-4619-b05b-9ef92fa55304 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Jul 19 19:32:00.604268 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:32:00.615707 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.623849 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Jul 19 19:32:00.624377 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:32:00.635671 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-ed5a76e1-1cbc-4ebd-b7c7-447f4b4079d8 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:32:00.643505 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-ed5a76e1-1cbc-4ebd-b7c7-447f4b4079d8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011273 Jul 19 19:32:00.644017 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jul 19 19:32:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:37:31.686522 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:31.687579 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 19 19:37:31.687933 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:31.827273 n-d-843834-3 devstack@n-api.service[104222]: DEBUG dbcounter [-] [104222] Writing DB stats nova_api:SELECT=6 {{(pid=104222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:37:31.978630 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:31.979812 n-d-843834-3 devstack@n-api.service[104222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:37:31.979812 n-d-843834-3 devstack@n-api.service[104222]: warnings.warn(msg) Jul 19 19:37:31.980999 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:37:31.981429 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:37:31.982195 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:37:31.982628 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:37:32.022517 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-d6023fcf-115a-481d-a61a-6177fdd07361 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.196722 Jul 19 19:37:32.023116 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:37:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:37:32.840385 n-d-843834-3 devstack@n-api.service[104223]: DEBUG nova.api.openstack.wsgi [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] Calling method '>' {{(pid=104223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:32.841409 n-d-843834-3 devstack@n-api.service[104223]: INFO nova.api.openstack.requestlog [None req-4af8c21b-057e-4246-9894-f3c9b4346070 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 19 19:37:32.841804 n-d-843834-3 devstack@n-api.service[104223]: [pid: 104223|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 19 19:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:37:33.042952 n-d-843834-3 devstack@n-api.service[104222]: DEBUG nova.api.openstack.wsgi [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] Calling method '>' {{(pid=104222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:37:33.044098 n-d-843834-3 devstack@n-api.service[104222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:37:33.044098 n-d-843834-3 devstack@n-api.service[104222]: warnings.warn(msg) Jul 19 19:37:33.045286 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:37:33.045720 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:37:33.046515 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:37:33.046964 n-d-843834-3 devstack@n-api.service[104222]: DEBUG oslo_concurrency.lockutils [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:37:33.070981 n-d-843834-3 devstack@n-api.service[104222]: INFO nova.api.openstack.requestlog [None req-032db2e5-6891-4fe5-8e61-9c45bed158cc admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.093496 Jul 19 19:37:33.071565 n-d-843834-3 devstack@n-api.service[104222]: [pid: 104222|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:37:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:38:17.409045 n-d-843834-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 19:38:17.409583 n-d-843834-3 devstack@n-api.service[104221]: Tue Jul 19 19:38:17 2022 - graceful shutdown triggered... Jul 19 19:38:17.410040 n-d-843834-3 devstack@n-api.service[104222]: Gracefully killing worker 1 (pid: 104222)... Jul 19 19:38:17.410659 n-d-843834-3 devstack@n-api.service[104223]: Gracefully killing worker 2 (pid: 104223)... Jul 19 19:38:18.410777 n-d-843834-3 devstack@n-api.service[104221]: worker 1 buried after 1 seconds Jul 19 19:38:18.410777 n-d-843834-3 devstack@n-api.service[104221]: worker 2 buried after 1 seconds Jul 19 19:38:18.410777 n-d-843834-3 devstack@n-api.service[104221]: goodbye to uWSGI. Jul 19 19:38:18.413286 n-d-843834-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 19 19:38:18.414338 n-d-843834-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 19:38:18.418762 n-d-843834-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 19:38:18.437212 n-d-843834-3 devstack@n-api.service[131221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 19:38:18 2022] *** Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: nodename: n-d-843834-3 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: machine: x86_64 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: clock source: unix Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: pcre jit disabled Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: detected number of CPU cores: 4 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: current working directory: / Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: detected binary path: /usr/bin/uwsgi-core Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: your processes number limit is 47680 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: your memory page size is 4096 bytes Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: detected max file descriptor number: 2048 Jul 19 19:38:18.446835 n-d-843834-3 devstack@n-api.service[131221]: lock engine: pthread robust mutexes Jul 19 19:38:18.447883 n-d-843834-3 devstack@n-api.service[131221]: thunder lock: enabled Jul 19 19:38:18.447883 n-d-843834-3 devstack@n-api.service[131221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 19:38:18.447883 n-d-843834-3 devstack@n-api.service[131221]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 19:38:18.490902 n-d-843834-3 devstack@n-api.service[131221]: Python main interpreter initialized at 0x5570c48b79c0 Jul 19 19:38:18.490902 n-d-843834-3 devstack@n-api.service[131221]: python threads support enabled Jul 19 19:38:18.490902 n-d-843834-3 devstack@n-api.service[131221]: your server socket listen backlog is limited to 100 connections Jul 19 19:38:18.490902 n-d-843834-3 devstack@n-api.service[131221]: your mercy for graceful operations on workers is 90 seconds Jul 19 19:38:18.491496 n-d-843834-3 devstack@n-api.service[131221]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 19:38:18.491496 n-d-843834-3 devstack@n-api.service[131221]: *** Operational MODE: preforking *** Jul 19 19:38:18.491656 n-d-843834-3 devstack@n-api.service[131221]: *** uWSGI is running in multiple interpreter mode *** Jul 19 19:38:18.491656 n-d-843834-3 devstack@n-api.service[131221]: spawned uWSGI master process (pid: 131221) Jul 19 19:38:18.491819 n-d-843834-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 19:38:18.494854 n-d-843834-3 devstack@n-api.service[131221]: spawned uWSGI worker 1 (pid: 131229, cores: 1) Jul 19 19:38:18.494854 n-d-843834-3 devstack@n-api.service[131221]: spawned uWSGI worker 2 (pid: 131230, cores: 1) Jul 19 19:38:18.494854 n-d-843834-3 devstack@n-api.service[131221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 19:38:19.142735 n-d-843834-3 devstack@n-api.service[131230]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:38:19.144662 n-d-843834-3 devstack@n-api.service[131229]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 19:38:20.351066 n-d-843834-3 devstack@n-api.service[131230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:38:20.351066 n-d-843834-3 devstack@n-api.service[131230]: from cryptography.utils import int_from_bytes Jul 19 19:38:20.351708 n-d-843834-3 devstack@n-api.service[131230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:38:20.351708 n-d-843834-3 devstack@n-api.service[131230]: from cryptography.utils import int_from_bytes Jul 19 19:38:20.351848 n-d-843834-3 devstack@n-api.service[131229]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:38:20.351848 n-d-843834-3 devstack@n-api.service[131229]: from cryptography.utils import int_from_bytes Jul 19 19:38:20.351848 n-d-843834-3 devstack@n-api.service[131229]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 19:38:20.351848 n-d-843834-3 devstack@n-api.service[131229]: from cryptography.utils import int_from_bytes Jul 19 19:38:22.632481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:38:22.633098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:38:22.633288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:38:22.633673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:38:22.633894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:38:22.634310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.634607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.634954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.635294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.635622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.635934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.637814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843834-3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.638118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.638427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.638741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.639084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.639393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.639715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.640021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.641886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.641886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.641886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.641886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.641886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.642340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.642496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.642809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.643155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.643499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.643821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.644237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843834-3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.644506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.644831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.645107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.645626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.645873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.646190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.646340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 19:38:22.646798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.646980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 19:38:22.647085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.647171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 19:38:22.647251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.647473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.647605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 19:38:22.647732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 19:38:22.647871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.648982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.649999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.650848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843834-3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.651976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.652846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.653538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.653663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.653752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.653835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.653927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.654964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.655938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.656954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.657953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843834-3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.658934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.659989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.660935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.661904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.662806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.663943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.664954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.665793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.666885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.667968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.668879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.669800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.670710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.671960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.672894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.673996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.674958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.675934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.676816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.677017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.677120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.677328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.677419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.677633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.677737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.677937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.678029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.678241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.678340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.678548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.678646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.678853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.679009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.679185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.679284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.679499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.679601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.679796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.679889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.680113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.680205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.680433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.680533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.680742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.680840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.681048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.681197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.681354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.681466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.681659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.681758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.681976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.682068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.682281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.682419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.682606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.682751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.682898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.683063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.683293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.683399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.683624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.683722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.683939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.684037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.684246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.684345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.684552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.684652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.684871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.684963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.685188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.685331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.685478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.685586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.685797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.685896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.686103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.686319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.686413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.686508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.686696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.686797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.687023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.687136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.687338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.687442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.687643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.687734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.687946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.688038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.688251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.688403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.688550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.688690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.688866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.688966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.689188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.689286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.689497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.689586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.689805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.689906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.690109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.690217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.690429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 19:38:22.690529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.690735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.690826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.691839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.692976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.693079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.693290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.693393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.693947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.694894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.695955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.696882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.697822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.698798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.699966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.700989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.701943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.702876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.703829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.704967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.705982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.706178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.706280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.706561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.706799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.706799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.707900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.708704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.708926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.709883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.710981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.711909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.712921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.713992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.714833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.715940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.716862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.717925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.718950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.719881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.720948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.721996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.722135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.722268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.722395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.724812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.725542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.725769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.725912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.726856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.727762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.728954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.729873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.730823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.731923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.732704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.733962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.734990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.735903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.736961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.737983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.738931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.739869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.740984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.741880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.742998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.743930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.744983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.745967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.746893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.747893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.748911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.749793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.750943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.751941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.752979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.753936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.754893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.755961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.756999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.757890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.758971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.759934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.760901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.761979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.762792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.763950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.764904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.765983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.766890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.767930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.768881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.769976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.770871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.771948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.772876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.773966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.774895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.775961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.776913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.777970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.778957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.779983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.780977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.781924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.782848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.783986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.784897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.785959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.786961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.787888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.788926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.789868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.790992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.791914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.792870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.793914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.794987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.795921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.796869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.797971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.798871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.799936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.800880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.801981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.802165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.802304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.802477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.802614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.802821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.803929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.804884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.805832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.806986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.807835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.808000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.808166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.808437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.808697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.808834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.809921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.810861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.811968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.812890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.813843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.814984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.815914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.816989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.817163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.817293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.817489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.817742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.817871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.818077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.818214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.818394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.818544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.819995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.820934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.821879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.822963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.823924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.824866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.825964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.826900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.827992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.828927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.829869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.830904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.831938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.832946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.833876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.834993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.835933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.836993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.837932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.838960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.839902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.840945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.841946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.842939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.843872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.844934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.845993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.846905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.847127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.847255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.847434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.847748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.847876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.848860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.849012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.849366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.849526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.849743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.849886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.850884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.851107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.851239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.851439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.851685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.851817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.852981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.853900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.854823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.855940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.856116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.878603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.878603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.879383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.879688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.879895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.880084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.880240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.880421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.880594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.881411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.881588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.882846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.883105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.883105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.883520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.883798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.884047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.885126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.885405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.885568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.885714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.886591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.887532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.887726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.887946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.888955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.889948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.890963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.891990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.892724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.893921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.894663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.896818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.897181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.897366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.897366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.897800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.897996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.898231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.900732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.900868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.900994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.901133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.901257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.901389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.901514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.901937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.902281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.902281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.902872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.903938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.904934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.905978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.906935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.907428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.908345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.909283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.910275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.911505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.912083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.912083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.912083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.912499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.913802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.914002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.914267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.914406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.914736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.914880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.915900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.916967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.917866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.918946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.919868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.920121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.921935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.922408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.922533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.922662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.922785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.922924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.923907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.924873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.925905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 19:38:22.926601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 19:38:23.063066 n-d-843834-3 devstack@n-api.service[131229]: INFO dbcounter [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Registered counter for database nova_api Jul 19 19:38:23.066186 n-d-843834-3 devstack@n-api.service[131230]: INFO dbcounter [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Registered counter for database nova_api Jul 19 19:38:23.085888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.087431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_db.sqlalchemy.engines [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.093386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writer thread running {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.094129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writer thread running {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.150905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.context [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131229) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:38:23.151160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.context [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131230) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 19:38:23.155231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:38:23.155691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:38:23.156856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:38:23.157274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:38:23.157657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:38:23.158114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:38:23.159708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:38:23.160207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:38:23.161791 n-d-843834-3 devstack@n-api.service[131230]: INFO dbcounter [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Registered counter for database nova_cell0 Jul 19 19:38:23.162283 n-d-843834-3 devstack@n-api.service[131229]: INFO dbcounter [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Registered counter for database nova_cell0 Jul 19 19:38:23.166411 n-d-843834-3 devstack@n-api.service[131230]: INFO dbcounter [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Registered counter for database nova_cell1 Jul 19 19:38:23.166557 n-d-843834-3 devstack@n-api.service[131229]: INFO dbcounter [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Registered counter for database nova_cell1 Jul 19 19:38:23.173756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.176432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.179887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_db.sqlalchemy.engines [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.180021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writer thread running {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.185636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_db.sqlalchemy.engines [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.186756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writer thread running {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.323398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writer thread running {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.332171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writer thread running {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.332529 n-d-843834-3 devstack@n-api.service[131229]: INFO dbcounter [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Registered counter for database nova_cell0 Jul 19 19:38:23.341640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.346115 n-d-843834-3 devstack@n-api.service[131230]: INFO dbcounter [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Registered counter for database nova_cell0 Jul 19 19:38:23.346548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writer thread running {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.356478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_db.sqlalchemy.engines [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 19:38:23.361854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writer thread running {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 19:38:23.672647 n-d-843834-3 devstack@n-api.service[131229]: WARNING keystonemiddleware.auth_token [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:38:23.677589 n-d-843834-3 devstack@n-api.service[131230]: WARNING keystonemiddleware.auth_token [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:38:23.680251 n-d-843834-3 devstack@n-api.service[131229]: WARNING keystonemiddleware.auth_token [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:38:23.686740 n-d-843834-3 devstack@n-api.service[131230]: WARNING keystonemiddleware.auth_token [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:38:24.029743 n-d-843834-3 devstack@n-api.service[131229]: WARNING keystonemiddleware.auth_token [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:38:24.035851 n-d-843834-3 devstack@n-api.service[131229]: WARNING keystonemiddleware.auth_token [None req-c2f89a11-4e4c-43df-9842-ff2b25af06aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:38:24.037993 n-d-843834-3 devstack@n-api.service[131230]: WARNING keystonemiddleware.auth_token [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 19:38:24.042088 n-d-843834-3 devstack@n-api.service[131229]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570c48b79c0 pid: 131229 (default app) Jul 19 19:38:24.044122 n-d-843834-3 devstack@n-api.service[131230]: WARNING keystonemiddleware.auth_token [None req-f9d0f172-2676-4a22-97be-a23b0b201239 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 19:38:24.051671 n-d-843834-3 devstack@n-api.service[131230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570c48b79c0 pid: 131230 (default app) Jul 19 19:39:07.492123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:07.493521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:07.494553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:07.495575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:08.716641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:08.718957 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:08.718957 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:08.720277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:08.720724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:08.721522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:08.721949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:08.768985 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0d86c23-11aa-4393-b3ad-d2453833e7a6 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.286332 Jul 19 19:39:08.769746 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:39:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:08.784989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:08.798027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:08.799449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:08.803177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:09.056911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5622235e-37a6-417d-bfb2-b3a3b6fb1962 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-455745620"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:09.076424 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:09.076424 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:09.077614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-5622235e-37a6-417d-bfb2-b3a3b6fb1962 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 50b3786c-0452-47b3-a8bb-03a67ba79072 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:09.186013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5622235e-37a6-417d-bfb2-b3a3b6fb1962 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.406198 Jul 19 19:39:09.187055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:09.197766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91646d91-e1e7-44e3-80c0-0782d369cd3b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:09.200721 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:09.200721 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:09.258149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91646d91-e1e7-44e3-80c0-0782d369cd3b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:09.258650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91646d91-e1e7-44e3-80c0-0782d369cd3b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:10.599648 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91646d91-e1e7-44e3-80c0-0782d369cd3b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.405881 Jul 19 19:39:10.602307 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:10.617817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:10.620349 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:10.620349 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:10.636667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:10.637130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:10.670725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-843834-3. Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 39 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:10.691422 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: {"add_host": {"host": "n-h1-843834-3"}} Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:10.692818 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate 1 already has host n-h1-843834-3. Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-843834-3'}}} Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:39:10.693853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-843834-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 19:39:10.695118 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 19:39:10.696111 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:39:10.697215 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-843834-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 19, 39, 10, 653686), 'updated_at': None, 'host': 'n-h1-843834-3', 'aggregate_id': 1}] Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:10.698261 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-843834-3. Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.699318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-843834-3. Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:10.700427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:10.702663 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-843834-3. Jul 19 19:39:10.702663 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:10.702663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-843834-3. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:10.703456 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59cc018d-38a5-4ca1-b2b8-3557705151d4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.091210 Jul 19 19:39:10.707053 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3/4] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 19 19:39:11.424385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '.version_select at 0x7f23feac0e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:11.425212 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:11.425212 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:11.438462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131229) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 19:39:11.444643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fe148af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:11.445822 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:11.445822 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:11.447078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.447835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.448640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.449069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.456164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.456771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.505886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.506713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.539494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.546402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.567661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2fabb4f1-6f54-407f-9f6c-7ea8307efb5a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.859039 Jul 19 19:39:11.569997 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 4/5] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:39:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:11.575312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d75d0ba-2b99-41da-8629-703eb6a200c2 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:11.579494 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84d964f6-5a2b-4987-a455-64c04ec8a37f tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.650496 Jul 19 19:39:11.580333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2/6] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:39:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:11.583095 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:11.583095 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:11.613051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d75d0ba-2b99-41da-8629-703eb6a200c2 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.613727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d75d0ba-2b99-41da-8629-703eb6a200c2 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.778196 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d75d0ba-2b99-41da-8629-703eb6a200c2 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.206127 Jul 19 19:39:11.779223 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 5/7] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:11.785211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fd884b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:11.787790 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:11.787790 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:11.789643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.790357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.791423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.792307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:11.828959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2c907b0-858e-4b46-810f-47f7d15cb28e tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.048083 Jul 19 19:39:11.830711 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1138 bytes} [Tue Jul 19 19:39:11 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:11.969806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Calling method '.version_select at 0x7f23fd8dcb80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:11.971784 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:11.971784 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:11.985543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131230) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 19:39:11.990858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:11.991572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.045979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.046734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.069486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.070239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.079180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5ea0ff6-f523-4fea-9f76-4b40b586f606 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.497420 Jul 19 19:39:12.080486 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3/9] 10.222.0.23 () {60 vars in 1207 bytes} [Tue Jul 19 19:39:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:39:12.277408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7ff62407-bef4-4e1b-acfb-885afafb5785 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-505605514", "id": 357292624, "os-flavor-access:is_public": "False"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:12.309054 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.309054 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:12.328837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-26b34fde-c2e0-4b7b-8c68-3cc08a375c9a tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2092063967", "ram": 512, "vcpus": 1, "disk": 10, "id": 108597779, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:12.332571 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.332571 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:12.389902 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-26b34fde-c2e0-4b7b-8c68-3cc08a375c9a tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.308111 Jul 19 19:39:12.391503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 4/10] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:12 2022] POST /compute/v2.1/flavors => generated 413 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:12.406474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c85d992-40ae-4b3a-b4de-d40c76dd211c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:12.407653 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.407653 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:12.428590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7ff62407-bef4-4e1b-acfb-885afafb5785 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.596435 Jul 19 19:39:12.431940 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 7/11] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:11 2022] POST /compute/v2.1/flavors => generated 427 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:12.438118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fd884e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:12.442259 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.442259 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:12.443909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.444583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.445568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.446012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.471127 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b9596a9-6471-42a8-96ab-084ec42dfb58 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.037768 Jul 19 19:39:12.479418 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 8/12] 10.222.0.23 () {58 vars in 1144 bytes} [Tue Jul 19 19:39:12 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:12.492031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c85d992-40ae-4b3a-b4de-d40c76dd211c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.098667 Jul 19 19:39:12.492788 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 5/13] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:12 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:12.507218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3045fff2-8748-4fa2-9d42-9916989e196e tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c879b5246d8b4b1da7c63b694278186b"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:12.513597 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.513597 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:12.704375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cd4cb7-c61e-4b4d-a059-fa4d13215309 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:12.744445 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f7cd4cb7-c61e-4b4d-a059-fa4d13215309 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] HTTP exception thrown: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cd4cb7-c61e-4b4d-a059-fa4d13215309 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Request method failure captured: Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whcSirlZbpha8BrpwZgOivZNYfBB3L4Iq75GJbBvQQcGqknTqlfRiOYrQfljAQ0OZiu6Q8l2q6HxAACuRfg0icYhp5e8FpsxvXizWdoEaLdINoXUbfUQTpeG_DPVcxwwzbp4yWLmZeQnVNHf7rPY1LcggoDhaxVHgGXehDKZBIZ1_I Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:12.746285 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f994ed227c01429d98efd045901dafc7 Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:12.747642 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'flavor_id': '108597779', 'id': 'hw:cpu_thread_policy'} Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:12.748339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:12.749619 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.751431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cd4cb7-c61e-4b4d-a059-fa4d13215309 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Returning 404 to user: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:12.752696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7cd4cb7-c61e-4b4d-a059-fa4d13215309 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] 10.222.0.23 "GET /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.276308 Jul 19 19:39:12.758583 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 9/14] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:39:12 2022] GET /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:12.763803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d1300eb1-6fbb-40c2-96d6-d6db4cf7cbfa tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-617114111"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:12.765354 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.765354 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:12.766502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-d1300eb1-6fbb-40c2-96d6-d6db4cf7cbfa tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 1bf2ac9f-ab57-4327-8a40-205ff4b3b907 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:12.836418 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d1300eb1-6fbb-40c2-96d6-d6db4cf7cbfa tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076421 Jul 19 19:39:12.837630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 10/15] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:12.847185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fc55bf70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:12.851875 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.851875 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:12.853452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.854112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.854965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:12.855406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:12.883669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ef81dda-30ad-42a8-b8f9-930be2b0aeef tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.044683 Jul 19 19:39:12.884431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 11/16] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:39:12 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:12.890503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70c46219-d969-4ef7-bce1-5d905593ba2b tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:12.892458 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:12.892458 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:12.893712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70c46219-d969-4ef7-bce1-5d905593ba2b tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f994ed227c01429d98efd045901dafc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead94667e02844dc824273fc9a94cdd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70c46219-d969-4ef7-bce1-5d905593ba2b tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Request method failure captured: Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/flavors/108597779/os-extra_specs HTTP/1.1 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 66 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whcSirlZbpha8BrpwZgOivZNYfBB3L4Iq75GJbBvQQcGqknTqlfRiOYrQfljAQ0OZiu6Q8l2q6HxAACuRfg0icYhp5e8FpsxvXizWdoEaLdINoXUbfUQTpeG_DPVcxwwzbp4yWLmZeQnVNHf7rPY1LcggoDhaxVHgGXehDKZBIZ1_I Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:12.896122 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f994ed227c01429d98efd045901dafc7 Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 19 19:39:12.897189 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'flavor_id': '108597779', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:12.897778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 19:39:12.898688 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:12.902018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70c46219-d969-4ef7-bce1-5d905593ba2b tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:12.903143 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70c46219-d969-4ef7-bce1-5d905593ba2b tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] 10.222.0.23 "POST /compute/v2.1/flavors/108597779/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.017430 Jul 19 19:39:12.908494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 12/17] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:39:12 2022] POST /compute/v2.1/flavors/108597779/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:12.991904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3045fff2-8748-4fa2-9d42-9916989e196e tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/357292624/action" status: 200 len: 96 microversion: 2.1 time: 0.495010 Jul 19 19:39:12.998612 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 6/18] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Jul 19 19:39:12 2022] POST /compute/v2.1/flavors/357292624/action => generated 96 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:13.005034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fc883e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.006680 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.006680 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.008249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.009081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.010173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.010793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.041546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08eff342-07a3-4155-a3cb-6720996e6421 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.041331 Jul 19 19:39:13.043092 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 7/19] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:39:12 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.050750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-444b5404-d6ef-4945-bbc9-be10cb1e3dc1 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.052747 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.052747 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.100989 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-444b5404-d6ef-4945-bbc9-be10cb1e3dc1 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/108597779/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055181 Jul 19 19:39:13.103504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 8/20] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/flavors/108597779/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:13.374452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eb1e51b-9d0c-4e1f-bb03-f7557f7e8c30 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.379216 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.379216 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.380317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1eb1e51b-9d0c-4e1f-bb03-f7557f7e8c30 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eb1e51b-9d0c-4e1f-bb03-f7557f7e8c30 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 39 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:13.390779 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: {"add_host": {"host": "n-h1-843834-3"}} Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:13.392952 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-843834-3'}}} Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:13.394481 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 19:39:13.397838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.398831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eb1e51b-9d0c-4e1f-bb03-f7557f7e8c30 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:13.398831 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1eb1e51b-9d0c-4e1f-bb03-f7557f7e8c30 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.488369 Jul 19 19:39:13.400175 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 13/21] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 490 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:13.423749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fd8848b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.425436 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.425436 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.426776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.429192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.431292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.431971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.494288 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b638d2f1-d25d-45e1-a94a-871240e9b6ad tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.091715 Jul 19 19:39:13.494900 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 14/22] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:39:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.496759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2f9d68cd-11d6-4377-8746-cbb49af716c7 tempest-FlavorsAccessTestJSON-552013551 tempest-FlavorsAccessTestJSON-552013551-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.503600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83c97c0b-627a-4d67-83f7-178ae53c1ed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.504625 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.504625 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.505789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-83c97c0b-627a-4d67-83f7-178ae53c1ed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f994ed227c01429d98efd045901dafc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead94667e02844dc824273fc9a94cdd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83c97c0b-627a-4d67-83f7-178ae53c1ed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Request method failure captured: Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whcSirlZbpha8BrpwZgOivZNYfBB3L4Iq75GJbBvQQcGqknTqlfRiOYrQfljAQ0OZiu6Q8l2q6HxAACuRfg0icYhp5e8FpsxvXizWdoEaLdINoXUbfUQTpeG_DPVcxwwzbp4yWLmZeQnVNHf7rPY1LcggoDhaxVHgGXehDKZBIZ1_I Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:13.507575 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f994ed227c01429d98efd045901dafc7 Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:13.508618 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'flavor_id': '108597779', 'id': 'hw:numa_nodes'} Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:13.509154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 19:39:13.510221 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.512556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83c97c0b-627a-4d67-83f7-178ae53c1ed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:13.513589 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83c97c0b-627a-4d67-83f7-178ae53c1ed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015572 Jul 19 19:39:13.519326 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 15/23] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:39:13 2022] DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:13.527678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef552284-4018-4d8b-9d2e-febb3c01396e tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-29879819", "name": "tempest-test_aggregate-1047381319"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.537501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2f9d68cd-11d6-4377-8746-cbb49af716c7 tempest-FlavorsAccessTestJSON-552013551 tempest-FlavorsAccessTestJSON-552013551-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.432379 Jul 19 19:39:13.538809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 9/24] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:13 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:13.543898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a26249d9-b174-4ade-9568-a8db6182d77e tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.544873 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.544873 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.551214 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.551214 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.552325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-ef552284-4018-4d8b-9d2e-febb3c01396e tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid ba73786f-1aef-406f-9a95-d6a6b40c828f for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:13.586905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a26249d9-b174-4ade-9568-a8db6182d77e tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.046187 Jul 19 19:39:13.588135 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 10/25] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:13 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:13.593992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fc80ee50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.594370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef552284-4018-4d8b-9d2e-febb3c01396e tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.073412 Jul 19 19:39:13.595006 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 16/26] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.595687 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.595687 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.600199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c7baae1-7d47-43ca-afb5-8c0854698af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.601553 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.601553 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.604955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.605653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.623853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.625243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.638132 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3c7baae1-7d47-43ca-afb5-8c0854698af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/108597779/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041981 Jul 19 19:39:13.639084 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 17/27] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/flavors/108597779/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:13.644498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-10fcb82a-9eab-457f-a328-9a302e1628e3 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c879b5246d8b4b1da7c63b694278186b"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.645975 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.645975 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.682237 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05007dae-3c07-458f-b371-2e83de18a66d tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-843834-3" status: 200 len: 332 microversion: 2.1 time: 0.092588 Jul 19 19:39:13.686866 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 11/28] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:39:13 2022] GET /compute/v2.1/os-hosts/n-h1-843834-3 => generated 332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.688612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-408c60c6-4aa3-417b-8960-c331599db007 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1394313544"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.690582 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.690582 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.691915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-408c60c6-4aa3-417b-8960-c331599db007 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 47588b56-4dd6-4011-9f67-9b70e2e81810 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:13.724284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-408c60c6-4aa3-417b-8960-c331599db007 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039852 Jul 19 19:39:13.730352 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 12/29] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.737212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b142657-c0f0-4345-b381-34ebd1358221 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.739238 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.739238 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.779242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b142657-c0f0-4345-b381-34ebd1358221 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.052879 Jul 19 19:39:13.780395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 13/30] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:39:13 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.785316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d8d3e1f-ffde-40a7-a57f-b3c4a4a38838 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.787215 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.787215 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.788275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d8d3e1f-ffde-40a7-a57f-b3c4a4a38838 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f994ed227c01429d98efd045901dafc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead94667e02844dc824273fc9a94cdd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d8d3e1f-ffde-40a7-a57f-b3c4a4a38838 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Request method failure captured: Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 22 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whcSirlZbpha8BrpwZgOivZNYfBB3L4Iq75GJbBvQQcGqknTqlfRiOYrQfljAQ0OZiu6Q8l2q6HxAACuRfg0icYhp5e8FpsxvXizWdoEaLdINoXUbfUQTpeG_DPVcxwwzbp4yWLmZeQnVNHf7rPY1LcggoDhaxVHgGXehDKZBIZ1_I Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:13.791764 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ead94667e02844dc824273fc9a94cdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ead94667e02844dc824273fc9a94cdd8 Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f994ed227c01429d98efd045901dafc7 Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: {"hw:numa_nodes": "1"} Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:13.793158 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'flavor_id': '108597779', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:13.793937 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 19:39:13.795078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:13.796564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d8d3e1f-ffde-40a7-a57f-b3c4a4a38838 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:13.797553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d8d3e1f-ffde-40a7-a57f-b3c4a4a38838 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514 tempest-FlavorsExtraSpecsNegativeTestJSON-1273229514-project] 10.222.0.23 "PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016036 Jul 19 19:39:13.798526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 14/31] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:39:13 2022] PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:13.804104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Calling method '.version_select at 0x7f23fc75cdc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:13.804999 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.804999 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.817376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.817979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.873512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.874184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.914250 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d6e4ed7-6bfb-4673-90f2-268e17968958 tempest-HostsAdminTestJSON-775237494 tempest-HostsAdminTestJSON-775237494-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-843834-3" status: 200 len: 332 microversion: 2.1 time: 0.114499 Jul 19 19:39:13.916775 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:39:13 2022] GET /compute/v2.1/os-hosts/n-h2-843834-3 => generated 332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:13.926277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-390312821"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.928016 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.928016 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:13.948319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.949202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.959246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:13.960040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:13.969918 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-10fcb82a-9eab-457f-a328-9a302e1628e3 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/357292624/action" status: 200 len: 21 microversion: 2.1 time: 0.329457 Jul 19 19:39:13.971465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 18/33] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/flavors/357292624/action => generated 21 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:13.979379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7e09f5b-85a7-4169-b33d-7c15ac19da42 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:13.982270 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:13.982270 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:13.982518 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-390312821 could not be found. Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 57 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:13.999241 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: {"add_host": {"host": "tempest-nonexist_host-390312821"}} Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:14.000640 n-d-843834-3 devstack@n-api.service[131230]: exception: Compute host tempest-nonexist_host-390312821 could not be found. Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-390312821'}}} Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-390312821' is not mapped to any cell Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.001560 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 19 19:39:14.002750 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-390312821 could not be found. Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-390312821 could not be found. Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.007360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-390312821 could not be found. Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-390312821 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0bcf8d0-46e5-4876-903b-b170a4100b46 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.083072 Jul 19 19:39:14.008969 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 16/34] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:14.015503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7e09f5b-85a7-4169-b33d-7c15ac19da42 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:14.015718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6809ad0-5f4e-4027-81de-20eda31139f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.016236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7e09f5b-85a7-4169-b33d-7c15ac19da42 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:14.016427 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.016427 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:14.049202 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d6809ad0-5f4e-4027-81de-20eda31139f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] HTTP exception thrown: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6809ad0-5f4e-4027-81de-20eda31139f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Request method failure captured: Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whfwMh_wKZFLikXpJ-a5Kciekv1t87OJ2a8qozGgg85y7bdHWsB5ZCdwyxs7q7uumSAwAHlpqrxpX5WshzuyWcrDpVUzdw3uv20WYHx6k5oZA79kfcc31PBOgfq1TCrsd5v6Cf-rh_N3arJUpgBXkHF64nAY6136wpeWQQIOdm25TQ Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:14.051613 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: b7c74b88bd284200a5bc231f92ebc7ca Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:14.052892 n-d-843834-3 devstack@n-api.service[131230]: exception: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'flavor_id': '108597779', 'id': 'hw:cpu_thread_policy'} Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.053468 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. Jul 19 19:39:14.054525 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.057434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6809ad0-5f4e-4027-81de-20eda31139f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Returning 404 to user: Flavor 108597779 has no extra specs with key hw:cpu_thread_policy. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.058721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d6809ad0-5f4e-4027-81de-20eda31139f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.052312 Jul 19 19:39:14.059818 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 19:39:14 2022] DELETE /compute/v2.1/flavors/108597779/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:14.069319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f4ab19e-0e7a-42b2-b4c4-2307e7f84a25 tempest-FlavorsAccessTestJSON-552013551 tempest-FlavorsAccessTestJSON-552013551-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.114362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f4ab19e-0e7a-42b2-b4c4-2307e7f84a25 tempest-FlavorsAccessTestJSON-552013551 tempest-FlavorsAccessTestJSON-552013551-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.053058 Jul 19 19:39:14.129911 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:14 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:14.140323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-143340e6-3f6b-4c97-a4d2-5aa59ade3ce9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.141283 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.141283 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:14.189728 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-143340e6-3f6b-4c97-a4d2-5aa59ade3ce9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.058366 Jul 19 19:39:14.190607 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:14 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:14.196437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ae3c28c-76eb-440e-9629-dfc95efd649e tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.209869 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.209869 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:14.213444 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8ae3c28c-76eb-440e-9629-dfc95efd649e tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ae3c28c-76eb-440e-9629-dfc95efd649e tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Request method failure captured: Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 27 Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whfwMh_wKZFLikXpJ-a5Kciekv1t87OJ2a8qozGgg85y7bdHWsB5ZCdwyxs7q7uumSAwAHlpqrxpX5WshzuyWcrDpVUzdw3uv20WYHx6k5oZA79kfcc31PBOgfq1TCrsd5v6Cf-rh_N3arJUpgBXkHF64nAY6136wpeWQQIOdm25TQ Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:14.215611 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: b7c74b88bd284200a5bc231f92ebc7ca Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: {"hw:cpu_policy": "shared"} Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:14.217027 n-d-843834-3 devstack@n-api.service[131230]: exception: Request body and URI mismatch Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'flavor_id': '108597779', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.217770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ae3c28c-76eb-440e-9629-dfc95efd649e tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ae3c28c-76eb-440e-9629-dfc95efd649e tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025346 Jul 19 19:39:14.218797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 20/38] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:39:14 2022] PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:39:14.242886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ff07945-6949-4522-b36f-148c7e6ccc50 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.244417 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.244417 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:14.283646 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ff07945-6949-4522-b36f-148c7e6ccc50 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/357292624" status: 202 len: 0 microversion: 2.1 time: 0.059645 Jul 19 19:39:14.284378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:39:14 2022] DELETE /compute/v2.1/flavors/357292624 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:14.293624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6eb2978d-eed6-4ff9-9361-b722a756e1c5 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.296062 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7e09f5b-85a7-4169-b33d-7c15ac19da42 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 311 microversion: 2.1 time: 0.323045 Jul 19 19:39:14.296672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:13 2022] POST /compute/v2.1/os-aggregates/3/action => generated 311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:14.306816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0190ad25-3bfe-4c65-9ee9-4b99713fa9d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0190ad25-3bfe-4c65-9ee9-4b99713fa9d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Request method failure captured: Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 49 Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whfwMh_wKZFLikXpJ-a5Kciekv1t87OJ2a8qozGgg85y7bdHWsB5ZCdwyxs7q7uumSAwAHlpqrxpX5WshzuyWcrDpVUzdw3uv20WYHx6k5oZA79kfcc31PBOgfq1TCrsd5v6Cf-rh_N3arJUpgBXkHF64nAY6136wpeWQQIOdm25TQ Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:14.311403 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/46424df9042c4f9a81bf0dd8d77e358f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 46424df9042c4f9a81bf0dd8d77e358f Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b7c74b88bd284200a5bc231f92ebc7ca Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 19 19:39:14.324550 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'flavor_id': '108597779', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 19 19:39:14.325563 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.326761 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0190ad25-3bfe-4c65-9ee9-4b99713fa9d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0190ad25-3bfe-4c65-9ee9-4b99713fa9d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.015330 Jul 19 19:39:14.327851 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:39:14 2022] PUT /compute/v2.1/flavors/108597779/os-extra_specs/hw:numa_nodes => generated 117 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:39:14.328379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96513a28-9fa2-4d8b-845d-c81741b1d3ce tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6eb2978d-eed6-4ff9-9361-b722a756e1c5 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 283 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:14.330217 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:14.331486 n-d-843834-3 devstack@n-api.service[131230]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:39:14.332128 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:39:14.332737 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:39:14.333806 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:39:14.334600 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:39:14.334600 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.336750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6eb2978d-eed6-4ff9-9361-b722a756e1c5 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.338390 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6eb2978d-eed6-4ff9-9361-b722a756e1c5 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.052989 Jul 19 19:39:14.342252 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:39:14.359985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9262ead-8327-434c-9070-8aa8eba87079 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.397611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9262ead-8327-434c-9070-8aa8eba87079 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/108597779" status: 202 len: 0 microversion: 2.1 time: 0.048322 Jul 19 19:39:14.399253 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:39:14 2022] DELETE /compute/v2.1/flavors/108597779 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:14.412705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e6da4fa-5db1-42ec-9143-f3a0112533f8 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e6da4fa-5db1-42ec-9143-f3a0112533f8 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 27 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:14.420513 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: {"aggregate": {"name": ""}} Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:14.422091 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '' Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.423614 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:39:14.425333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.426383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e6da4fa-5db1-42ec-9143-f3a0112533f8 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.426383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0e6da4fa-5db1-42ec-9143-f3a0112533f8 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023855 Jul 19 19:39:14.427757 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 24/44] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:39:14.436324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96513a28-9fa2-4d8b-845d-c81741b1d3ce tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.113113 Jul 19 19:39:14.440085 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 21/45] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:14 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:14.443806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16f1e241-3b5a-4cd7-9239-ab9d9ad2c019 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.452821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-328e2cc7-713c-4ee1-b7a1-ae88f1bed4ab tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-346263584"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.460331 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.460331 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:14.461406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-328e2cc7-713c-4ee1-b7a1-ae88f1bed4ab tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-328e2cc7-713c-4ee1-b7a1-ae88f1bed4ab tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 59 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:14.465008 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: {"aggregate": {"name": "tempest-test_aggregate-346263584"}} Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:14.466098 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-346263584'}}} Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:14.466729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:14.467672 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 19:39:14.468645 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.468645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-328e2cc7-713c-4ee1-b7a1-ae88f1bed4ab tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.469046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-328e2cc7-713c-4ee1-b7a1-ae88f1bed4ab tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.025537 Jul 19 19:39:14.476242 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:14.481622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2f84c54-5b86-414b-9240-c8d85b95ba5a tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1843243192", "id": 301748004, "os-flavor-access:is_public": "False"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.483255 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.483255 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:14.507121 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2f84c54-5b86-414b-9240-c8d85b95ba5a tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.029596 Jul 19 19:39:14.507720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/flavors => generated 428 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:14.513633 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16f1e241-3b5a-4cd7-9239-ab9d9ad2c019 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182 tempest-FlavorsExtraSpecsNegativeTestJSON-1415715182-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072990 Jul 19 19:39:14.513633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:14.521230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e589b67-f128-48e5-8157-dde78b82a29a tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2113438236"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.529443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-4e589b67-f128-48e5-8157-dde78b82a29a tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 883dd385-aab2-4a4b-b630-b6f028885599 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:14.533722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:14.570294 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e589b67-f128-48e5-8157-dde78b82a29a tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061382 Jul 19 19:39:14.571785 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:14.578303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fad5bc38-2fac-4291-9060-6d259d55ac3d tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.579866 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.579866 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:14.597759 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fad5bc38-2fac-4291-9060-6d259d55ac3d tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/301748004/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024569 Jul 19 19:39:14.599151 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1205 bytes} [Tue Jul 19 19:39:14 2022] GET /compute/v2.1/flavors/301748004/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:14.611080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2113438236"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:14.613460 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.613460 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:14.614572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 9c0e67ea-b302-41b6-837d-aef913245fae for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:14.625696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2113438236 already exists. Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 60 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:14.628675 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: {"aggregate": {"name": "tempest-test_aggregate-2113438236"}} Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:14.629770 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate tempest-test_aggregate-2113438236 already exists. Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2113438236'}}} Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 19 19:39:14.630456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2113438236 already exists. Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:14.631488 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2113438236 already exists. Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2113438236 already exists. Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2113438236 already exists. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:14.632474 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cebaeca-549b-4cea-82b4-be6a18dc77f0 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.030128 Jul 19 19:39:14.633160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 31 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:39:14.636411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d120412d-3f5e-440e-8155-b7e831432e0f tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:14.637696 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:14.637696 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:14.670671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d120412d-3f5e-440e-8155-b7e831432e0f tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/301748004" status: 202 len: 0 microversion: 2.1 time: 0.038671 Jul 19 19:39:14.671597 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:39:14 2022] DELETE /compute/v2.1/flavors/301748004 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:14.992590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1770457812", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "availability_zone": "tempest-test_az-29879819"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:15.022209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:15.023649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:15.024522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:15.025136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:15.052439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:15.208762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebf612c7-7043-43ee-8c04-a49375cf4c29 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1737589264", "id": 1735560932, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:15.210257 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.210257 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.229347 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebf612c7-7043-43ee-8c04-a49375cf4c29 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.556355 Jul 19 19:39:15.236858 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 28/53] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/flavors => generated 471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:39:15.241807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-621e0cff-db85-440d-8f61-1f7eb78ba873 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.242577 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.242577 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.281031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-621e0cff-db85-440d-8f61-1f7eb78ba873 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.042708 Jul 19 19:39:15.281694 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 29/54] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:15 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:15.292168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44a293fd-2f22-47b5-9d1c-6644a00652d9 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.327828 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44a293fd-2f22-47b5-9d1c-6644a00652d9 tempest-FlavorsAccessTestJSON-861097929 tempest-FlavorsAccessTestJSON-861097929-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.044075 Jul 19 19:39:15.328767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 30/55] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:15 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:15.340568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de3a5ba4-eec7-4013-8cb4-caa35c20f254 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:15.343487 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.343487 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.665459 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de3a5ba4-eec7-4013-8cb4-caa35c20f254 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1735560932/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.335282 Jul 19 19:39:15.671087 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 31/56] 10.222.0.23 () {62 vars in 1264 bytes} [Tue Jul 19 19:39:15 2022] POST /compute/v2.1/flavors/1735560932/os-extra_specs => generated 62 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:15.680256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d9bb471-74f3-42c0-96ba-c0b397a0d87c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1165540290"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:15.715983 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.715983 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.717160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-0d9bb471-74f3-42c0-96ba-c0b397a0d87c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid a3453d18-1182-4141-9409-58a117e1a909 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:15.756216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d9bb471-74f3-42c0-96ba-c0b397a0d87c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080862 Jul 19 19:39:15.763202 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 32/57] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:15.769193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7dec2c07-a368-40b4-b33b-75604bb75c41 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.770340 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.770340 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.800707 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7dec2c07-a368-40b4-b33b-75604bb75c41 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1735560932" status: 202 len: 0 microversion: 2.86 time: 0.035796 Jul 19 19:39:15.801710 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 33/58] 10.222.0.23 () {60 vars in 1201 bytes} [Tue Jul 19 19:39:15 2022] DELETE /compute/v2.1/flavors/1735560932 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:39:15.808787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0e4adfdc-8124-4de1-ba9d-899a4d40309e tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.809677 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.809677 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.810828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0e4adfdc-8124-4de1-ba9d-899a4d40309e tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0e4adfdc-8124-4de1-ba9d-899a4d40309e tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:15.812735 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:39:15.813808 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6'} Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:15.814431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.815414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0e4adfdc-8124-4de1-ba9d-899a4d40309e tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:15.816815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0e4adfdc-8124-4de1-ba9d-899a4d40309e tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.011358 Jul 19 19:39:15.816815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 34/59] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:15.823545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc1897ba-69b4-4cbc-95d3-7269bfac2171 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.858233 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc1897ba-69b4-4cbc-95d3-7269bfac2171 tempest-FlavorMetadataValidation-1664816662 tempest-FlavorMetadataValidation-1664816662-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.037881 Jul 19 19:39:15.860600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 35/60] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:39:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:39:15.873108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d2eedac-fcb5-4883-af3b-7d7bc3e7d780 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.941652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d2eedac-fcb5-4883-af3b-7d7bc3e7d780 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.073360 Jul 19 19:39:15.943970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 36/61] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:15.958172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4def14b1-c751-4934-a888-581ab6168ce4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:15.958955 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:15.958955 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:15.990485 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4def14b1-c751-4934-a888-581ab6168ce4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4def14b1-c751-4934-a888-581ab6168ce4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:15.992707 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate -1 could not be found. Jul 19 19:39:15.993865 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '-1'} Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:39:15.994549 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.996091 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4def14b1-c751-4934-a888-581ab6168ce4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4def14b1-c751-4934-a888-581ab6168ce4 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043757 Jul 19 19:39:15.997149 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 37/62] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:39:15 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:39:16.014644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85af2d3c-43bd-490f-8e76-96a41fca5e9d tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1163444366"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:16.015992 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:16.015992 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:16.019754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-85af2d3c-43bd-490f-8e76-96a41fca5e9d tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 7d12613d-95e6-4e3f-891e-e9251f86b832 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:16.065949 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85af2d3c-43bd-490f-8e76-96a41fca5e9d tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057986 Jul 19 19:39:16.067398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 38/63] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:16.079670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0144acee-bb35-4141-8962-ca9e2143e700 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:16.080661 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:16.080661 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:16.081744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0144acee-bb35-4141-8962-ca9e2143e700 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0144acee-bb35-4141-8962-ca9e2143e700 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:16.083802 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:39:16.084985 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7'} Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:16.086903 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.088735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0144acee-bb35-4141-8962-ca9e2143e700 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:16.090024 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0144acee-bb35-4141-8962-ca9e2143e700 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.010470 Jul 19 19:39:16.090024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 39/64] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:39:16 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:39:16.103049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-21e85e35-c305-43f8-8579-510d758bfb30 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:16.104341 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:16.104341 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:16.134425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:39:16.179867 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-21e85e35-c305-43f8-8579-510d758bfb30 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.083803 Jul 19 19:39:16.181053 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 40/65] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:16 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:16.190503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc748941-b584-4e5c-ac14-5232d170cbff tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:16.191594 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:16.191594 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:16.200884 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-fc748941-b584-4e5c-ac14-5232d170cbff tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc748941-b584-4e5c-ac14-5232d170cbff tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:16.202733 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate -1 could not be found. Jul 19 19:39:16.204138 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '-1'} Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.204807 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 19:39:16.205861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.213273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc748941-b584-4e5c-ac14-5232d170cbff tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:16.219924 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc748941-b584-4e5c-ac14-5232d170cbff tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027901 Jul 19 19:39:16.220816 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 41/66] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:16 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 19:39:16.237543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6fe0b95-d597-4886-83fb-e404f3042501 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:16.243135 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:16.243135 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:16.244525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6fe0b95-d597-4886-83fb-e404f3042501 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6fe0b95-d597-4886-83fb-e404f3042501 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:16.249597 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:39:16.250782 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:16.251855 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 19:39:16.252969 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:16.256586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6fe0b95-d597-4886-83fb-e404f3042501 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:16.257682 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6fe0b95-d597-4886-83fb-e404f3042501 tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.030773 Jul 19 19:39:16.260358 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 42/67] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:39:16 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:16.463461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:39:16.464686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:39:16.465644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:39:16.466238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:39:16.467113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:39:16.503891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:16.504356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:16.507383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:16.509501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:16.551869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Getting quotas for project c418f69e6aed48fdb23e24686b09ce69. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:16.560090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Getting quotas for user d8b7bf8b38cc4511adc0923410b02d3d and project c418f69e6aed48fdb23e24686b09ce69. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:16.585187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:39:16.590630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:39:16.686006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-526aed9d-f95b-4001-bf00-b31ee4b65020 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175390 Jul 19 19:39:16.694652 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 26/68] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:39:16.700755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2794955e-2715-4bf0-bd0b-16c9d0d162cd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:16.701968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2794955e-2715-4bf0-bd0b-16c9d0d162cd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:17.968631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2794955e-2715-4bf0-bd0b-16c9d0d162cd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:17.998970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2794955e-2715-4bf0-bd0b-16c9d0d162cd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1241 microversion: 2.1 time: 1.304544 Jul 19 19:39:18.008988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 43/69] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:16 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1241 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:19.020769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:19.021768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:19.050257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:19.050727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:19.051960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:19.054328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:19.293981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:19.313244 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07573fcf-f676-4d5c-870b-a0ff9b53d388 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1241 microversion: 2.1 time: 0.300275 Jul 19 19:39:19.313622 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 27/70] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:19 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1241 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:20.334683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:20.336671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:20.367693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:20.370470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:20.389546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:20.391953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:20.737837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:20.760724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e990678-54ad-43c2-9458-0a73f781d785 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1307 microversion: 2.1 time: 0.433286 Jul 19 19:39:20.772541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 44/71] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:20 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1307 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:21.780678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:21.781927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:21.822199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:21.824315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:21.825191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:21.825647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:22.147518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:22.155728 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c66a1f73-ca62-4279-b0f8-c158c08ad2a4 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1295 microversion: 2.1 time: 0.380330 Jul 19 19:39:22.171154 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 28/72] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:21 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1295 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:23.178104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:23.179669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:23.200928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:23.204275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:23.205454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:23.208127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:23.452958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:23.775104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:23.803564 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-139cda0a-2737-4f60-bc99-a0dd49a08bf9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.627609 Jul 19 19:39:23.810727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 45/73] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:23 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:24.825396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:24.826803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:24.845838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:24.848260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:24.851341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:24.852252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:25.062590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-366229146", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:25.182199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:39:25.533084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:25.552004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b95d8a49-a4cf-41e3-bf9a-19804ac2c605 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.732779 Jul 19 19:39:25.579463 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 46/74] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:24 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:26.098424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf98df4f-2619-4c81-839c-c211c13c830a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:26.118599 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf98df4f-2619-4c81-839c-c211c13c830a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.537320 Jul 19 19:39:26.119662 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 47/75] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:39:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:26.197273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:39:26.197972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:39:26.198345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:39:26.199486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:39:26.199931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:39:26.222418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:26.223184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:26.224576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:26.225320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:26.270703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:26.277314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for user f2e7f9d9c6ab4b20aa20b98a514bf701 and project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:26.298076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:39:26.300501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:39:26.392703 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ad1fc49-93ad-4ad5-ac6f-318b6c8fe50d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177308 Jul 19 19:39:26.394630 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 29/76] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:39:26.421811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-427e4fd8-e5bd-4804-bf9c-0b4389f5e9d0 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1576601791", "id": 1694819681, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:26.424449 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:26.424449 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:26.487515 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-427e4fd8-e5bd-4804-bf9c-0b4389f5e9d0 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.343176 Jul 19 19:39:26.488910 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 48/77] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:26 2022] POST /compute/v2.1/flavors => generated 425 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:26.499479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04061ab6-c8ff-4b2b-a177-3c1b947b547c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:26.500410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04061ab6-c8ff-4b2b-a177-3c1b947b547c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:26.824948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04061ab6-c8ff-4b2b-a177-3c1b947b547c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:26.836743 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04061ab6-c8ff-4b2b-a177-3c1b947b547c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1212 microversion: 2.1 time: 0.346567 Jul 19 19:39:26.841802 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 49/78] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:26 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1212 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:26.864816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b194fb1f-0359-412d-8977-66f9c2d81f23 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:26.904732 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b194fb1f-0359-412d-8977-66f9c2d81f23 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.061767 Jul 19 19:39:26.915820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 50/79] 10.222.0.23 () {58 vars in 1181 bytes} [Tue Jul 19 19:39:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:26.929087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:26.929860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:26.951654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:26.954252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:26.956690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:26.958811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.263217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Calling method '.version_select at 0x7f23fc61ef70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:27.265675 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:27.265675 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:27.270843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:27.271836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.328819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:27.332204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.346361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:27.359945 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53a644a7-8c6b-4294-b12a-3beb1486c107 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.442971 Jul 19 19:39:27.360543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 51/80] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:26 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:27.365260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf135518-ce35-473d-9147-02d046621a2c tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1916168388", "id": 1624844462, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:27.366870 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:27.366870 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:27.372017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:27.375543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.404994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:27.408652 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-327810f8-7da9-4e0b-aba6-6e71467fbc08 tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.011417 Jul 19 19:39:27.416419 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 30/81] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:39:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:39:27.425538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf135518-ce35-473d-9147-02d046621a2c tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.061258 Jul 19 19:39:27.426976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Calling method '.version_select at 0x7f23fc4cef70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:27.427827 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 52/82] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:27 2022] POST /compute/v2.1/flavors => generated 425 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:27.430576 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:27.430576 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:27.436106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:27.437928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.446372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d3dc434-0f0d-4b4e-a00b-45dd6dd86056 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:27.488687 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d3dc434-0f0d-4b4e-a00b-45dd6dd86056 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.052479 Jul 19 19:39:27.491831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 53/83] 10.222.0.23 () {58 vars in 1181 bytes} [Tue Jul 19 19:39:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:27.515033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4430caf9-7206-4ed1-bfe8-a7b9aabcdc3f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Action: 'create', calling method: .version_select at 0x7f23fc3344c0>, body: {"keypair": {"name": "tempest-keypair-671997608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8itrWghTcunHlq9cY6nvO/BUAtojudvzyT/EH1P4ptb6En8CebFqDN6KaBMzM5b1/GcpnYq/Q0M8FS3TPm0BfQ9iDMh924Kg4aEkzGhb/9nY0STZLKnSstxLDlexNc4A=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:27.522256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:27.522716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:27.567437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a7931a98-65fa-486a-8e73-4750266be73d tempest-HypervisorAdminV228Test-164218674 tempest-HypervisorAdminV228Test-164218674-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.149426 Jul 19 19:39:27.575247 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 31/84] 10.222.0.23 () {60 vars in 1192 bytes} [Tue Jul 19 19:39:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:39:27.630828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-4430caf9-7206-4ed1-bfe8-a7b9aabcdc3f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:27.661267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-4430caf9-7206-4ed1-bfe8-a7b9aabcdc3f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for user 2813b3164f34435ab921bd3ffc8f910a and project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:27.752820 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4430caf9-7206-4ed1-bfe8-a7b9aabcdc3f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247326 Jul 19 19:39:27.755685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 54/85] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:39:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:27.860910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-377e58c0-5db1-43fa-8d32-2d64ca793909 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:27.861778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-377e58c0-5db1-43fa-8d32-2d64ca793909 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:28.301122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-377e58c0-5db1-43fa-8d32-2d64ca793909 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:28.344371 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-377e58c0-5db1-43fa-8d32-2d64ca793909 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1212 microversion: 2.1 time: 0.490058 Jul 19 19:39:28.344972 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 32/86] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:27 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1212 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:28.376996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:28.378341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:28.396815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:28.397774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:28.398900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:28.399615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:28.813859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-32fc1a3a-5a70-460c-b5b9-b2d5bb0818ae req-03cc1873-62d4-40e5-8803-35bc65f0d612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0962b8af-0f27-411e-a220-45ca41f51493", "tag": "ad3301b5-fe16-4bc9-a01d-49545f3819cd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:28.836690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-32fc1a3a-5a70-460c-b5b9-b2d5bb0818ae req-03cc1873-62d4-40e5-8803-35bc65f0d612 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:28.839149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-32fc1a3a-5a70-460c-b5b9-b2d5bb0818ae req-03cc1873-62d4-40e5-8803-35bc65f0d612 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:28.911957 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-32fc1a3a-5a70-460c-b5b9-b2d5bb0818ae req-03cc1873-62d4-40e5-8803-35bc65f0d612 service nova] Creating event network-changed:ad3301b5-fe16-4bc9-a01d-49545f3819cd for instance 0962b8af-0f27-411e-a220-45ca41f51493 on n-h1-843834-3 Jul 19 19:39:28.912509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-32fc1a3a-5a70-460c-b5b9-b2d5bb0818ae req-03cc1873-62d4-40e5-8803-35bc65f0d612 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:39:28.921225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:28.921844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:28.922747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:28.923226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:28.951800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.rpcapi [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 19:39:28.953595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] Releasing lock "compute-rpcapi-router" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:39:29.011699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dbfa5ee4-520b-4f1a-8018-97a34250600d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478968 Jul 19 19:39:29.013128 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 33/87] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:29.166878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:29.180730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26e8fff7-2186-47f4-852e-3a68ab1e8105 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.803620 Jul 19 19:39:29.185654 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 55/88] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:28 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:29.660566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4ffca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:29.662611 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:29.662611 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:29.664442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:29.665766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:29.768627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6437e1b4-0494-4666-9153-96483650a80f tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1773183070", "id": 1034121708, "os-flavor-access:is_public": "False"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:29.771164 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:29.771164 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:29.798304 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6437e1b4-0494-4666-9153-96483650a80f tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.481569 Jul 19 19:39:29.799877 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 56/89] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:29.802066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:29.802622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:29.812203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:29.813807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:29.824865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:29.825797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:29.827157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:29.827863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:29.854366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:29.858093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:29.888733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba478fd7-20eb-4595-af7a-80d2bc9f506a tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.872872 Jul 19 19:39:29.904704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 34/90] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:29.923365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90f659bb-2474-4179-9962-9c3f29d314a3 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:29.928298 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:29.928298 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:30.160376 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90f659bb-2474-4179-9962-9c3f29d314a3 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1034121708/action" status: 200 len: 97 microversion: 2.1 time: 0.252331 Jul 19 19:39:30.161675 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 35/91] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:29 2022] POST /compute/v2.1/flavors/1034121708/action => generated 97 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:30.167680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc497dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:30.168772 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:30.168772 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:30.170268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.177004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.201273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.202015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.204411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:30.220655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-684f741a-2a37-45fb-b935-c249bda73a73 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1282 microversion: 2.1 time: 0.418071 Jul 19 19:39:30.223547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.223700 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 57/92] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:29 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1282 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:30.224429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.236508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ee44244-e6c6-4a06-8ebb-06f61ef13d9c tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:30.240288 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:30.240288 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:30.240479 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-463ebcc8-8ea6-45b2-9273-fd8a3f93ac89 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.077464 Jul 19 19:39:30.250473 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 36/93] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:39:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:30.261204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:30.262637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:30.272111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.272893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.273872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.275284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.668322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:30.704924 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d16c769-e840-4aec-81ba-9962d32374b3 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.450841 Jul 19 19:39:30.727860 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 37/94] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:30 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:30.741598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4cec10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:30.758215 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:30.758215 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:30.761324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.766501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.811166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.822281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.846163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.847370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.862874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-940a82f1-56d1-47f3-9b27-9b69a804b603 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132654 Jul 19 19:39:30.873601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 38/95] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:30.884966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4e4040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:30.887404 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:30.887404 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:30.890430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.891559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.895103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0ee44244-e6c6-4a06-8ebb-06f61ef13d9c tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ee44244-e6c6-4a06-8ebb-06f61ef13d9c tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Request method failure captured: Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/flavors/1034121708/action HTTP/1.1 Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 67 Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whus6JOlE-9XNRo2PHPfmK-afQZ3NjRCTpDfCurT6M72oSJoPf3PRUM8MdWmXiRmeGPOwGcWq5iNRcD7A4wj--BYYrcE_QJLcMaaF7rE8eYSeJBbw6AfmNjk-z-stHKr3YU4Gt8lB0cr_p8MPuTjN9bdoqHrQbuPL3ZHyhfic9-b8Y Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:30.911728 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c86a2fccf3f8499da420278cff99320b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6ef091c99b5a45d2aa6e0b37a097b896 Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} Jul 19 19:39:30.914103 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1034121708', 'body': {'addTenantAccess': {'tenant': '5b5180a5bb9f47a89c75d8773dccf070'}}} Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:39:30.915464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-5b5180a5bb9f47a89c75d8773dccf070' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 19:39:30.917319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 19:39:30.921294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:39:30.925762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-5b5180a5bb9f47a89c75d8773dccf070' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 19, 39, 30, 884998), 'updated_at': None, 'flavor_id': 21, 'project_id': '5b5180a5bb9f47a89c75d8773dccf070'}] Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:30.930065 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:30.933601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:30.937876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ee44244-e6c6-4a06-8ebb-06f61ef13d9c tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project 5b5180a5bb9f47a89c75d8773dccf070 combination. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ee44244-e6c6-4a06-8ebb-06f61ef13d9c tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1034121708/action" status: 409 len: 152 microversion: 2.1 time: 0.691653 Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 58/96] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:30 2022] POST /compute/v2.1/flavors/1034121708/action => generated 152 bytes in 696 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:39:30.942147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2107059-bfa2-45bf-bf78-f114a119aad8 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:30.950738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:30.951407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:30.959453 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:30.959453 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:30.981943 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d82a5d65-b87b-46cc-ac52-905eb347c0cd tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.106473 Jul 19 19:39:30.986820 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 39/97] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:31.007203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f123df7-f316-4d36-abb6-c0073b4160b6 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4bb1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.013121 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:31.013121 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:31.018940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f123df7-f316-4d36-abb6-c0073b4160b6 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.019696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f123df7-f316-4d36-abb6-c0073b4160b6 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.087569 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f123df7-f316-4d36-abb6-c0073b4160b6 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.084107 Jul 19 19:39:31.090131 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 40/98] 10.222.0.23 () {58 vars in 1178 bytes} [Tue Jul 19 19:39:30 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:31.107964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4bbf70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.109521 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:31.109521 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:31.112363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.113136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.156778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.157543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.172142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.174901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.187140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff086b45-24ec-48c7-93b8-990a20202920 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085520 Jul 19 19:39:31.188704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 41/99] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:31.217811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc497e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.223575 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:31.223575 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:31.230754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.232608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.307789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.310092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.331808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c84185f-6c8a-441b-aaf1-6acef0b1cb63 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.132095 Jul 19 19:39:31.341247 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 42/100] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:31.354514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.359383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:31.386457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.387508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.390520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.392594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.662161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2107059-bfa2-45bf-bf78-f114a119aad8 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1034121708/action" status: 200 len: 21 microversion: 2.1 time: 0.730697 Jul 19 19:39:31.663466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 59/101] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:30 2022] POST /compute/v2.1/flavors/1034121708/action => generated 21 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:31.674851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc2593a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.677131 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:31.677131 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:31.681040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.682625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.745892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.747965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.768812 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61867d0e-14c0-4ed7-aa80-e3eb64443766 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.103066 Jul 19 19:39:31.769961 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 60/102] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:31 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:31.782193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16c5e77d-b414-407f-af0c-6a2a23f54dea tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.783575 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:31.783575 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:31.820765 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16c5e77d-b414-407f-af0c-6a2a23f54dea tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1034121708" status: 202 len: 0 microversion: 2.1 time: 0.049546 Jul 19 19:39:31.825938 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 61/103] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:39:31 2022] DELETE /compute/v2.1/flavors/1034121708 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:31.834457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:31.836967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:31.856635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.857204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.858087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:31.862676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:31.994263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:32.005990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9884f461-1aae-4c79-abb5-da5d7378c8a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1270 microversion: 2.1 time: 0.663258 Jul 19 19:39:32.009732 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 43/104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:31 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1270 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:32.025455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Calling method '.version_select at 0x7f23fc4385e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.026408 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:32.026408 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:32.027720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:32.028179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:32.045564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:32.078783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:32.079285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:32.104199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:32.104655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:32.170117 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ccb35c8d-3d76-4044-85e3-f180a39a9016 tempest-HypervisorAdminTestJSON-861490307 tempest-HypervisorAdminTestJSON-861490307-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.155092 Jul 19 19:39:32.180035 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 44/105] 10.222.0.23 () {58 vars in 1172 bytes} [Tue Jul 19 19:39:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:32.186810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-95f22ecb-2a35-45e2-b425-543d8b490f76 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.245114 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-95f22ecb-2a35-45e2-b425-543d8b490f76 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.068784 Jul 19 19:39:32.261379 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 45/106] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:32.270243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a0e25d8-973e-4d16-a668-97ea48cd33b3 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1981675926", "id": 1686190146, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:32.278003 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:32.278003 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:32.318640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a0e25d8-973e-4d16-a668-97ea48cd33b3 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.054716 Jul 19 19:39:32.326522 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 46/107] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:32 2022] POST /compute/v2.1/flavors => generated 438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:32.333610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc7ba919-c309-492f-829f-35175daf1b1b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.334416 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:32.334416 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:32.343358 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-dc7ba919-c309-492f-829f-35175daf1b1b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc7ba919-c309-492f-829f-35175daf1b1b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Request method failure captured: Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/flavors/1686190146/os-flavor-access HTTP/1.1 Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whus6JOlE-9XNRo2PHPfmK-afQZ3NjRCTpDfCurT6M72oSJoPf3PRUM8MdWmXiRmeGPOwGcWq5iNRcD7A4wj--BYYrcE_QJLcMaaF7rE8eYSeJBbw6AfmNjk-z-stHKr3YU4Gt8lB0cr_p8MPuTjN9bdoqHrQbuPL3ZHyhfic9-b8Y Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:32.346054 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c86a2fccf3f8499da420278cff99320b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6ef091c99b5a45d2aa6e0b37a097b896 Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: exception: Access list not available for public flavors. Jul 19 19:39:32.348620 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'flavor_id': '1686190146'} Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 19 19:39:32.349884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.353965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc7ba919-c309-492f-829f-35175daf1b1b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:32.353965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc7ba919-c309-492f-829f-35175daf1b1b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1686190146/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.019923 Jul 19 19:39:32.353965 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 47/108] 10.222.0.23 () {58 vars in 1208 bytes} [Tue Jul 19 19:39:32 2022] GET /compute/v2.1/flavors/1686190146/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:39:32.362830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc9e64c6-926c-4022-83de-57a80a3451e9 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.363731 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:32.363731 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:32.386238 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc9e64c6-926c-4022-83de-57a80a3451e9 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1686190146" status: 202 len: 0 microversion: 2.1 time: 0.032155 Jul 19 19:39:32.391128 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 48/109] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:39:32 2022] DELETE /compute/v2.1/flavors/1686190146 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:32.403342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df059dce-0fce-4b2f-94b7-74edeea06778 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.429215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df059dce-0fce-4b2f-94b7-74edeea06778 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036587 Jul 19 19:39:32.442356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 49/110] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:32.450503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-685e806a-0fcb-438d-b08f-6622e066f839 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1883181409", "id": 397090989, "os-flavor-access:is_public": "False"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:32.463622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:32.482079 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-685e806a-0fcb-438d-b08f-6622e066f839 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.035321 Jul 19 19:39:32.491106 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 50/111] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:32.882842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f08d1d38-ce68-42ff-b894-77620f114317 tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:32.884122 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:32.884122 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:32.885296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f08d1d38-ce68-42ff-b894-77620f114317 tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c77e3f0c1c8b42708505f05d10ed6848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5180a5bb9f47a89c75d8773dccf070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f08d1d38-ce68-42ff-b894-77620f114317 tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Request method failure captured: Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/flavors/397090989/action HTTP/1.1 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 67 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whrABJYXBNo_ilUp3Z2G7rJbnX9TEHPy_Znbu9_1gxRjM3IEkbqv7cX3UGqyB2VK7j_7e2nJB7v_KrG4k95gMrWsqojceJw6dlZ0S1uLKVvoeV8Rh_19p5nqHXSH3XpTyhGAasJ9P5ctupcHAN5humFhWd20ZvrnxEWs0uBJhGGwD8 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5b5180a5bb9f47a89c75d8773dccf070 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:32.893642 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5b5180a5bb9f47a89c75d8773dccf070 Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FlavorsAccessNegativeTestJSON-657123734-project Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: c77e3f0c1c8b42708505f05d10ed6848 Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-657123734-project Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} Jul 19 19:39:32.894791 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '397090989', 'body': {'addTenantAccess': {'tenant': '5b5180a5bb9f47a89c75d8773dccf070'}}} Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:32.895473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 19:39:32.896475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:32.897814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f08d1d38-ce68-42ff-b894-77620f114317 tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:32.897814 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f08d1d38-ce68-42ff-b894-77620f114317 tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] 10.222.0.23 "POST /compute/v2.1/flavors/397090989/action" status: 403 len: 130 microversion: 2.1 time: 0.402746 Jul 19 19:39:32.902718 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 51/112] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Jul 19 19:39:32 2022] POST /compute/v2.1/flavors/397090989/action => generated 130 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:32.914110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d22d8451-d9da-4c8f-a056-75ef4cd9cb49 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.955404 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d22d8451-d9da-4c8f-a056-75ef4cd9cb49 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/397090989" status: 202 len: 0 microversion: 2.1 time: 0.048176 Jul 19 19:39:32.960592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 52/113] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:39:32 2022] DELETE /compute/v2.1/flavors/397090989 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:32.966495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f2d6dda-adfb-4cc6-acad-088aa9fa913a tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:32.970320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:33.005862 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-27567a87-64c4-4a01-bb55-1710f0fdee19 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 1.178674 Jul 19 19:39:33.008571 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 62/114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:31 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:33.019359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f2d6dda-adfb-4cc6-acad-088aa9fa913a tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.057538 Jul 19 19:39:33.023421 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 53/115] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:33.031047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:33.031531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:33.050404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:33.051170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:33.058343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:33.059072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:33.059471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd080b05-8ebe-4a09-b261-aa96b9dbf6af tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1186003171", "id": 2012065731, "os-flavor-access:is_public": "False"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:33.099532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd080b05-8ebe-4a09-b261-aa96b9dbf6af tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.056173 Jul 19 19:39:33.101459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 54/116] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:33.121303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8152a21-86e1-4239-8f4b-412bff02d055 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:33.609429 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8152a21-86e1-4239-8f4b-412bff02d055 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2012065731/action" status: 200 len: 97 microversion: 2.1 time: 0.498788 Jul 19 19:39:33.611144 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 55/117] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:33 2022] POST /compute/v2.1/flavors/2012065731/action => generated 97 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:33.636674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-43581231", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "1624844462", "adminPass": "***", "networks": [{"uuid": "0a02c0bb-966f-4bb6-b02a-6e8d0148e831"}], "security_groups": [{"name": "tempest-securitygroup--1374059101"}], "key_name": "tempest-keypair-671997608", "user_data": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:33.798942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:33.808348 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-096d3b4a-b5aa-4be3-b5d0-2f82b231d9e4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1270 microversion: 2.1 time: 0.784992 Jul 19 19:39:33.814491 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 63/118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:33 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1270 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:33.830670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-820afc1d-0166-4f68-99b9-fdfef6805acf tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:33.835946 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:33.835946 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:33.837770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-820afc1d-0166-4f68-99b9-fdfef6805acf tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c77e3f0c1c8b42708505f05d10ed6848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5180a5bb9f47a89c75d8773dccf070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-820afc1d-0166-4f68-99b9-fdfef6805acf tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Request method failure captured: Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/flavors/2012065731/action HTTP/1.1 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 70 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whrABJYXBNo_ilUp3Z2G7rJbnX9TEHPy_Znbu9_1gxRjM3IEkbqv7cX3UGqyB2VK7j_7e2nJB7v_KrG4k95gMrWsqojceJw6dlZ0S1uLKVvoeV8Rh_19p5nqHXSH3XpTyhGAasJ9P5ctupcHAN5humFhWd20ZvrnxEWs0uBJhGGwD8 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5b5180a5bb9f47a89c75d8773dccf070 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:33.841217 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5b5180a5bb9f47a89c75d8773dccf070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5b5180a5bb9f47a89c75d8773dccf070 Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-657123734 Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsAccessNegativeTestJSON-657123734-project Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c77e3f0c1c8b42708505f05d10ed6848 Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-657123734-project Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: {"removeTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} Jul 19 19:39:33.842701 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '2012065731', 'body': {'removeTenantAccess': {'tenant': '5b5180a5bb9f47a89c75d8773dccf070'}}} Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can( Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:33.843546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 19:39:33.844863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:33.850651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-820afc1d-0166-4f68-99b9-fdfef6805acf tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:33.851757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-820afc1d-0166-4f68-99b9-fdfef6805acf tempest-FlavorsAccessNegativeTestJSON-657123734 tempest-FlavorsAccessNegativeTestJSON-657123734-project] 10.222.0.23 "POST /compute/v2.1/flavors/2012065731/action" status: 403 len: 133 microversion: 2.1 time: 0.035935 Jul 19 19:39:33.854044 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 64/119] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:33 2022] POST /compute/v2.1/flavors/2012065731/action => generated 133 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:33.864623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed737252-bcea-4c5d-a97a-40668d2e3624 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b5180a5bb9f47a89c75d8773dccf070"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:34.643986 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed737252-bcea-4c5d-a97a-40668d2e3624 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2012065731/action" status: 200 len: 21 microversion: 2.1 time: 0.783914 Jul 19 19:39:34.655815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 65/120] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:33 2022] POST /compute/v2.1/flavors/2012065731/action => generated 21 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:39:34.719021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:34.727006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:34.768734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:34.769957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:34.800324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:34.803745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:35.240680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:35.260599 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d7b17c9b-293b-4e12-8fcd-4be6d54f5a00 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.600087 Jul 19 19:39:35.262172 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 66/121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:34 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:35.287816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6fc6e84-2ec0-4254-9ef7-4bee58f66343 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:35.291743 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:35.291743 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:35.366582 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6fc6e84-2ec0-4254-9ef7-4bee58f66343 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2012065731" status: 202 len: 0 microversion: 2.1 time: 0.099982 Jul 19 19:39:35.373803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 67/122] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:39:35 2022] DELETE /compute/v2.1/flavors/2012065731 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:35.379784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:35.382287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:35.390206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:35.391152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:35.393974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:35.394964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:36.000424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:36.019264 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb985c3e-5805-40e1-a1cd-8fd97715da6b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.641547 Jul 19 19:39:36.022143 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 68/123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:35 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:36.056051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f90830b9-5250-4f6d-987f-9c22bf10cfc9 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:36.103441 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f90830b9-5250-4f6d-987f-9c22bf10cfc9 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058465 Jul 19 19:39:36.106360 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 69/124] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:36 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:36.141152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f8b8283-d443-449a-b564-d8c8e6ef7d4b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1348310257", "id": 1465639784, "os-flavor-access:is_public": "False"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:36.143153 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:36.143153 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:36.198884 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f8b8283-d443-449a-b564-d8c8e6ef7d4b tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.062006 Jul 19 19:39:36.213627 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 70/125] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:36 2022] POST /compute/v2.1/flavors => generated 439 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:36.231779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e0337dd-670b-49a4-b398-e2785f4d5450 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "10880d30dc544c85abe4aea07aa4510a"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:36.234518 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:36.234518 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:37.118008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] validate_networks() for [('0a02c0bb-966f-4bb6-b02a-6e8d0148e831', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:39:37.188082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4e0337dd-670b-49a4-b398-e2785f4d5450 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] HTTP exception thrown: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e0337dd-670b-49a4-b398-e2785f4d5450 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Request method failure captured: Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/flavors/1465639784/action HTTP/1.1 Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 70 Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whus6JOlE-9XNRo2PHPfmK-afQZ3NjRCTpDfCurT6M72oSJoPf3PRUM8MdWmXiRmeGPOwGcWq5iNRcD7A4wj--BYYrcE_QJLcMaaF7rE8eYSeJBbw6AfmNjk-z-stHKr3YU4Gt8lB0cr_p8MPuTjN9bdoqHrQbuPL3ZHyhfic9-b8Y Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:37.191144 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c86a2fccf3f8499da420278cff99320b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c86a2fccf3f8499da420278cff99320b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c86a2fccf3f8499da420278cff99320b Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-468962488 Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6ef091c99b5a45d2aa6e0b37a097b896 Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: {"removeTenantAccess": {"tenant": "10880d30dc544c85abe4aea07aa4510a"}} Jul 19 19:39:37.192598 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1465639784', 'body': {'removeTenantAccess': {'tenant': '10880d30dc544c85abe4aea07aa4510a'}}} Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 19 19:39:37.194133 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:37.195430 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e0337dd-670b-49a4-b398-e2785f4d5450 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Returning 404 to user: Flavor access not found for 25 / 10880d30dc544c85abe4aea07aa4510a combination. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:37.197114 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e0337dd-670b-49a4-b398-e2785f4d5450 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1465639784/action" status: 404 len: 124 microversion: 2.1 time: 0.977637 Jul 19 19:39:37.199790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 71/126] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Jul 19 19:39:36 2022] POST /compute/v2.1/flavors/1465639784/action => generated 124 bytes in 984 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:37.205638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:37.205638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:37.227967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:37.229635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:37.234633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:37.236693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:37.686477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:37.991682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:37.994097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=99 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:38.001018 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e439b25e-b835-4d31-a3b9-b50c6e90b6bd tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.799869 Jul 19 19:39:38.014165 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 72/127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:37 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:38.033208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:38.033839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:38.052406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.052965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.053882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.054395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.337356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:38.339334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:38.353866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3105a318-33e8-4289-85f4-ebbc89581073 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.338147 Jul 19 19:39:38.367761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 73/128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:38 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:38.382286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14884c22-90ac-44f4-9a24-85c18f79116e tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:38.384457 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:38.384457 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:38.408244 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14884c22-90ac-44f4-9a24-85c18f79116e tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1465639784" status: 202 len: 0 microversion: 2.1 time: 0.033887 Jul 19 19:39:38.408837 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 74/129] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:39:38 2022] DELETE /compute/v2.1/flavors/1465639784 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:38.613245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:39:38.613683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:39:38.614849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:39:38.614849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:39:38.615188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:39:38.633270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.633871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.634842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.635536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.656613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:38.661572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for user 2813b3164f34435ab921bd3ffc8f910a and project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:38.674216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:39:38.676924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:39:38.748841 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3f74c3a8-a8ff-40bd-bf51-c8536cbbc735 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.134980 Jul 19 19:39:38.757263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 56/130] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:39:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 5145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:39:38.770091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-13ebf642-ccb7-4008-bc42-c518441162a8 req-d7049532-8f13-4953-9413-5d765994d869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:38.785796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-13ebf642-ccb7-4008-bc42-c518441162a8 req-d7049532-8f13-4953-9413-5d765994d869 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.786523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-13ebf642-ccb7-4008-bc42-c518441162a8 req-d7049532-8f13-4953-9413-5d765994d869 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.813362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-13ebf642-ccb7-4008-bc42-c518441162a8 req-d7049532-8f13-4953-9413-5d765994d869 service nova] Creating event network-changed:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h2-843834-3 Jul 19 19:39:38.819822 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-13ebf642-ccb7-4008-bc42-c518441162a8 req-d7049532-8f13-4953-9413-5d765994d869 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060010 Jul 19 19:39:38.820974 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 57/131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:38.828295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe10e2b1-4cc4-496b-994b-097a7afe1f70 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:38.834395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Calling method '.version_select at 0x7f23fc247430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:38.835395 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:38.835395 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:38.836913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.837415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.856289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.860587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.866749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe10e2b1-4cc4-496b-994b-097a7afe1f70 tempest-FlavorsAccessNegativeTestJSON-468962488 tempest-FlavorsAccessNegativeTestJSON-468962488-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.043528 Jul 19 19:39:38.868185 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 58/132] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:38 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:38.872868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d1af8ae9-a645-4a79-85f4-12c04d7e4a75 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:38.873747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d1af8ae9-a645-4a79-85f4-12c04d7e4a75 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:38.885046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:38.885701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:38.894071 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d76f1a1-2ade-4a34-871d-cc3b89b8c16a tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.483721 Jul 19 19:39:38.895444 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 75/133] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:38.975559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d1af8ae9-a645-4a79-85f4-12c04d7e4a75 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:38.983250 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d1af8ae9-a645-4a79-85f4-12c04d7e4a75 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1262 microversion: 2.1 time: 0.113851 Jul 19 19:39:38.994422 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 59/134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:38 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:39.020342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.021291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:39.030240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.030654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.031503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.032231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.334196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a573e9a-4fe9-427d-ab63-a8ab5bfeb5b0 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Calling method '.version_select at 0x7f23fc247dc0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.335316 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:39.335316 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:39.336449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a573e9a-4fe9-427d-ab63-a8ab5bfeb5b0 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '420f145c3aa746ed9842ff762b0cc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e60fdf5cbf4181bb84f26be6c77cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a573e9a-4fe9-427d-ab63-a8ab5bfeb5b0 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Request method failure captured: Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hypervisors/n-h1-843834-3/search HTTP/1.1 Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wh3TA1zZNNLKwNOYqDnBBX3U1BBUI_TYlvlMWa81x_3fllrcw0UhddokPj_dkgL8bdMKg-k03rg_-k_KbCBn8M-M15WzcOXe3hkPbM-b3r-mdpyZjYDTuBAkww4BKMQ5r-0bgRHWG-b87jSWyM-CPcfUoK4vZrIRyHoQSRsFITWAoU Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 02e60fdf5cbf4181bb84f26be6c77cac Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:39.338657 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 02e60fdf5cbf4181bb84f26be6c77cac Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 420f145c3aa746ed9842ff762b0cc791 Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:39:39.340599 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-h1-843834-3'} Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:39.341453 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 19:39:39.342880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.344344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a573e9a-4fe9-427d-ab63-a8ab5bfeb5b0 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:39.344344 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a573e9a-4fe9-427d-ab63-a8ab5bfeb5b0 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-843834-3/search" status: 403 len: 117 microversion: 2.1 time: 0.438867 Jul 19 19:39:39.345142 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 76/135] 10.222.0.23 () {58 vars in 1208 bytes} [Tue Jul 19 19:39:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-843834-3/search => generated 117 bytes in 444 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:39.348539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:39.354360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Calling method '.version_select at 0x7f23fc3950d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.357487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.358110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.368949 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66baea52-ad33-44da-a4d5-466ab14ffa48 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.349942 Jul 19 19:39:39.369701 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 60/136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:39.373039 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Request method failure captured: Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wh5dlLuwps6B1dyY1ukAmXi8GvAwkaXHdV8Fuv4w5Aa_lR0NVAQ1csnyBYjXPhuE3wCcBwH3Z8dBzjGWlIfOgrT7w2hZUCToR7bMueBS7jUFuBRuVwk9LmOVdxsmJEvfq1UkZEDJZXBg1FvoR_ZXlhWd93em4Y_q8bnGXbHAgQIT2g Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 210dfa3f283943fcaade03ccef5abc69 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:39.374618 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 210dfa3f283943fcaade03ccef5abc69 Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f2fefb57500745e186201fd40e7417b8 Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:39:39.375967 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.376710 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.377740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.377740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:39.377740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:39.377740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 19:39:39.377740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.378825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:39.380042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8c214c15-5a57-416b-bf05-95c3911d97ef tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029613 Jul 19 19:39:39.380920 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 77/137] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:39.396727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Calling method '.version_select at 0x7f23fc2b4e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.398385 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:39.398385 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:39.399799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.400412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.406706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.407373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:39.419281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.419986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.428799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.429259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.430052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.430587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.435348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.436149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.447236 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e3ff1f01-e0fb-45ab-887d-35e24e9ce659 tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056083 Jul 19 19:39:39.463457 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 78/138] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:39.475604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93218d71-d340-4e97-a733-e472fdcd3796 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Calling method '.version_select at 0x7f23fc2b4310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.476689 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:39.476689 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:39.478304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93218d71-d340-4e97-a733-e472fdcd3796 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '420f145c3aa746ed9842ff762b0cc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e60fdf5cbf4181bb84f26be6c77cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93218d71-d340-4e97-a733-e472fdcd3796 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Request method failure captured: Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wh3TA1zZNNLKwNOYqDnBBX3U1BBUI_TYlvlMWa81x_3fllrcw0UhddokPj_dkgL8bdMKg-k03rg_-k_KbCBn8M-M15WzcOXe3hkPbM-b3r-mdpyZjYDTuBAkww4BKMQ5r-0bgRHWG-b87jSWyM-CPcfUoK4vZrIRyHoQSRsFITWAoU Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 02e60fdf5cbf4181bb84f26be6c77cac Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:39.480586 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02e60fdf5cbf4181bb84f26be6c77cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 02e60fdf5cbf4181bb84f26be6c77cac Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534 Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 420f145c3aa746ed9842ff762b0cc791 Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:39:39.481890 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1'} Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:39.482683 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 19:39:39.483927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.486227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93218d71-d340-4e97-a733-e472fdcd3796 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:39.487293 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93218d71-d340-4e97-a733-e472fdcd3796 tempest-HypervisorAdminNegativeUnderV252Test-1503891534 tempest-HypervisorAdminNegativeUnderV252Test-1503891534-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021782 Jul 19 19:39:39.494821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 79/139] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:39.500480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Calling method '.version_select at 0x7f23fc22a0d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:39.502973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:39.503721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:39.511358 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] HTTP exception thrown: No hypervisor matching '9c39d46d-b7f7-432c-8861-3a774e16ad26' could be found. Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Request method failure captured: Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hypervisors/9c39d46d-b7f7-432c-8861-3a774e16ad26/servers HTTP/1.1 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wh5dlLuwps6B1dyY1ukAmXi8GvAwkaXHdV8Fuv4w5Aa_lR0NVAQ1csnyBYjXPhuE3wCcBwH3Z8dBzjGWlIfOgrT7w2hZUCToR7bMueBS7jUFuBRuVwk9LmOVdxsmJEvfq1UkZEDJZXBg1FvoR_ZXlhWd93em4Y_q8bnGXbHAgQIT2g Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 210dfa3f283943fcaade03ccef5abc69 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:39.513124 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/210dfa3f283943fcaade03ccef5abc69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 210dfa3f283943fcaade03ccef5abc69 Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023 Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f2fefb57500745e186201fd40e7417b8 Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: exception: No hypervisor matching '9c39d46d-b7f7-432c-8861-3a774e16ad26' could be found. Jul 19 19:39:39.514647 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '9c39d46d-b7f7-432c-8861-3a774e16ad26'} Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '9c39d46d-b7f7-432c-8861-3a774e16ad26' could be found. Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.515528 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '9c39d46d-b7f7-432c-8861-3a774e16ad26' could be found. Jul 19 19:39:39.516732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:39.518115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] Returning 404 to user: No hypervisor matching '9c39d46d-b7f7-432c-8861-3a774e16ad26' could be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:39.519400 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2676a928-0e5f-4502-8c83-ebff1096b0fc tempest-HypervisorAdminNegativeUnderV252Test-559023023 tempest-HypervisorAdminNegativeUnderV252Test-559023023-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/9c39d46d-b7f7-432c-8861-3a774e16ad26/servers" status: 404 len: 123 microversion: 2.1 time: 0.022941 Jul 19 19:39:39.520153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 80/140] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/os-hypervisors/9c39d46d-b7f7-432c-8861-3a774e16ad26/servers => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:39.664872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:39.688098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27890333-fe57-4d85-91ea-25daff77d6a1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.313285 Jul 19 19:39:39.691507 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 61/141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:40.002654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.003489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:40.016037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.016747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.017849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.021720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.118819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:40.145134 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-361eecc6-05a3-4ac5-9b75-1b1171c289ab tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1278 microversion: 2.1 time: 0.146755 Jul 19 19:39:40.147733 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 81/142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:39 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:40.386557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.387273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:40.399034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.401196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.403699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.405627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.509980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42f2041b-719b-48aa-96de-7274ee4c1058 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Calling method '.version_select at 0x7f23fc4bb0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.511958 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:40.511958 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:40.513242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42f2041b-719b-48aa-96de-7274ee4c1058 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2636279264b14cb4b5498199b59deace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f9ad78ec5d488892fe5a7f3bbc392e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42f2041b-719b-48aa-96de-7274ee4c1058 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Request method failure captured: Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh6dItIl5o0pYs83McZLtH9MlqWj1quIxdW6QitfXHbl-AfifSAZsUda69POywWE4uadQi6tDnA_PQtHzFzA0tnaL6uklDFkQueCLvBmz0IiZfglCnRk7TgOvYYaZWKltUue9UE6_RA5Bhmvo79whbTQ3ECjgUQjkW-gnWjC51KZzk Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:40.524105 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2636279264b14cb4b5498199b59deace Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 19:39:40.525618 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:40.526360 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 19:39:40.527409 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.528415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42f2041b-719b-48aa-96de-7274ee4c1058 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:40.528782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42f2041b-719b-48aa-96de-7274ee4c1058 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.352538 Jul 19 19:39:40.530828 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 62/143] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 357 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:40.552542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1dfbb7b3-b479-46f5-9726-e55d7cc93990 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Calling method '.version_select at 0x7f23fc3ffc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.553933 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:40.553933 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:40.562222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1dfbb7b3-b479-46f5-9726-e55d7cc93990 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2636279264b14cb4b5498199b59deace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f9ad78ec5d488892fe5a7f3bbc392e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1dfbb7b3-b479-46f5-9726-e55d7cc93990 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Request method failure captured: Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh6dItIl5o0pYs83McZLtH9MlqWj1quIxdW6QitfXHbl-AfifSAZsUda69POywWE4uadQi6tDnA_PQtHzFzA0tnaL6uklDFkQueCLvBmz0IiZfglCnRk7TgOvYYaZWKltUue9UE6_RA5Bhmvo79whbTQ3ECjgUQjkW-gnWjC51KZzk Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:40.564390 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2636279264b14cb4b5498199b59deace Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 19:39:40.565563 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:40.566245 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 19:39:40.567372 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.571610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1dfbb7b3-b479-46f5-9726-e55d7cc93990 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:40.572792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1dfbb7b3-b479-46f5-9726-e55d7cc93990 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034838 Jul 19 19:39:40.574185 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 63/144] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:40.603469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-39c1be3c-5666-4b8c-9186-68cb53cee494 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Calling method '.version_select at 0x7f23fc3ff4c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.605394 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:40.605394 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:40.608331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-39c1be3c-5666-4b8c-9186-68cb53cee494 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2636279264b14cb4b5498199b59deace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f9ad78ec5d488892fe5a7f3bbc392e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-39c1be3c-5666-4b8c-9186-68cb53cee494 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Request method failure captured: Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh6dItIl5o0pYs83McZLtH9MlqWj1quIxdW6QitfXHbl-AfifSAZsUda69POywWE4uadQi6tDnA_PQtHzFzA0tnaL6uklDFkQueCLvBmz0IiZfglCnRk7TgOvYYaZWKltUue9UE6_RA5Bhmvo79whbTQ3ECjgUQjkW-gnWjC51KZzk Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:40.611809 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2636279264b14cb4b5498199b59deace Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 19:39:40.613010 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:40.614432 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 19:39:40.615690 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:40.619503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-39c1be3c-5666-4b8c-9186-68cb53cee494 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:40.622175 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-39c1be3c-5666-4b8c-9186-68cb53cee494 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.035378 Jul 19 19:39:40.623863 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 64/145] 10.222.0.23 () {58 vars in 1178 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:40.825742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:40.833953 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd9239d9-bf26-494f-b1a9-61d0ad0ee3d1 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.451928 Jul 19 19:39:40.835110 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 82/146] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:40.840137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.841009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:40.851316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.852013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.853043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.853780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:40.987124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Calling method '.version_select at 0x7f23fc4bb040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:40.989354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:40.989964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.021033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.021813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.034223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.035037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.042597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-410e8595-8134-4993-acac-d3b327f41c05 tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.413613 Jul 19 19:39:41.043718 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 65/147] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:41.056419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3399ce48-6106-40b3-bff7-c6be6817c24c tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Calling method '.version_select at 0x7f23fc3ff160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.057563 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:41.057563 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:41.058966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3399ce48-6106-40b3-bff7-c6be6817c24c tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2636279264b14cb4b5498199b59deace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f9ad78ec5d488892fe5a7f3bbc392e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3399ce48-6106-40b3-bff7-c6be6817c24c tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Request method failure captured: Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh6dItIl5o0pYs83McZLtH9MlqWj1quIxdW6QitfXHbl-AfifSAZsUda69POywWE4uadQi6tDnA_PQtHzFzA0tnaL6uklDFkQueCLvBmz0IiZfglCnRk7TgOvYYaZWKltUue9UE6_RA5Bhmvo79whbTQ3ECjgUQjkW-gnWjC51KZzk Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:41.060811 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2636279264b14cb4b5498199b59deace Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1'} Jul 19 19:39:41.062111 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:41.063051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 19:39:41.064258 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.066291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3399ce48-6106-40b3-bff7-c6be6817c24c tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:41.068333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3399ce48-6106-40b3-bff7-c6be6817c24c tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017206 Jul 19 19:39:41.073944 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 66/148] 10.222.0.23 () {58 vars in 1172 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:39:41.080825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca61bb54-cbf1-4b2c-a593-5b9cdacbc3ac tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Calling method '.version_select at 0x7f23fc438430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.083223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ca61bb54-cbf1-4b2c-a593-5b9cdacbc3ac tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] HTTP exception thrown: Hypervisor with ID 'b3b9dd79-1354-4b86-a490-4cc065fe7699' could not be found. Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca61bb54-cbf1-4b2c-a593-5b9cdacbc3ac tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Request method failure captured: Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors/b3b9dd79-1354-4b86-a490-4cc065fe7699/uptime HTTP/1.1 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh7lSsTr-rnhLBy182tHrwP0vCNU7LxAAx8bMIXGfzkjJek-Od772N_wRcwy5KMPfPA2w_YEkHsn4qfsGTNjH_nWRH-MZSG4clfqARCwODQYUXrkQAsf-tNUhj2DqP5nCq_fuzGOsF28GremiHqUWfoZod3hJ7T5YnNFCprtdrZdIw Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 74e18c3580fe4b059d0d7f08969ce051 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:41.121857 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 74e18c3580fe4b059d0d7f08969ce051 Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 87f5db59e14047f5bb3cebca199c052e Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: exception: Hypervisor with ID 'b3b9dd79-1354-4b86-a490-4cc065fe7699' could not be found. Jul 19 19:39:41.123140 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b3b9dd79-1354-4b86-a490-4cc065fe7699'} Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b3b9dd79-1354-4b86-a490-4cc065fe7699' Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 19:39:41.123827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b3b9dd79-1354-4b86-a490-4cc065fe7699' could not be found. Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.124969 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b3b9dd79-1354-4b86-a490-4cc065fe7699' could not be found. Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca61bb54-cbf1-4b2c-a593-5b9cdacbc3ac tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Returning 404 to user: Hypervisor with ID 'b3b9dd79-1354-4b86-a490-4cc065fe7699' could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:41.126497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca61bb54-cbf1-4b2c-a593-5b9cdacbc3ac tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/b3b9dd79-1354-4b86-a490-4cc065fe7699/uptime" status: 404 len: 123 microversion: 2.1 time: 0.050627 Jul 19 19:39:41.131838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 67/149] 10.222.0.23 () {58 vars in 1277 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/os-hypervisors/b3b9dd79-1354-4b86-a490-4cc065fe7699/uptime => generated 123 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:41.143902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Calling method '.version_select at 0x7f23fc3f69d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.146244 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:41.146244 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:41.155226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.166775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.194370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.195073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.213659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.214476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.223704 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2dc223cb-af98-4c2e-84b3-e245213b14fd tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090329 Jul 19 19:39:41.224815 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 68/150] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:41.230740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.231793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:41.238761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.239601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.240872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.241537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.274272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:41.300858 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c282ec39-59d1-4f7c-ba5d-10b619835557 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.464450 Jul 19 19:39:41.301459 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 83/151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:40 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:41.332514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb796e02-e3eb-4744-ade6-3262cd6a05f7 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Calling method '.version_select at 0x7f23fc1d3a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.341766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:41.353025 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:41.353025 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:41.353393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d63bd009-6ba4-4f65-9f10-abb5308756a0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1340 microversion: 2.1 time: 0.126551 Jul 19 19:39:41.354191 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 69/152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1340 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:41.354674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb796e02-e3eb-4744-ade6-3262cd6a05f7 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2636279264b14cb4b5498199b59deace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f9ad78ec5d488892fe5a7f3bbc392e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb796e02-e3eb-4744-ade6-3262cd6a05f7 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Request method failure captured: Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wh6dItIl5o0pYs83McZLtH9MlqWj1quIxdW6QitfXHbl-AfifSAZsUda69POywWE4uadQi6tDnA_PQtHzFzA0tnaL6uklDFkQueCLvBmz0IiZfglCnRk7TgOvYYaZWKltUue9UE6_RA5Bhmvo79whbTQ3ECjgUQjkW-gnWjC51KZzk Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:41.356406 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f9ad78ec5d488892fe5a7f3bbc392e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e3f9ad78ec5d488892fe5a7f3bbc392e Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-900443558 Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2636279264b14cb4b5498199b59deace Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-900443558-project Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1'} Jul 19 19:39:41.357541 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:41.358293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 19:39:41.359539 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.360533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb796e02-e3eb-4744-ade6-3262cd6a05f7 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:41.378709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb796e02-e3eb-4744-ade6-3262cd6a05f7 tempest-HypervisorAdminNegativeTestJSON-900443558 tempest-HypervisorAdminNegativeTestJSON-900443558-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.052012 Jul 19 19:39:41.379351 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 84/153] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:41.390033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5f5e507-a9ed-4646-b849-8ae74d552fff tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Calling method '.version_select at 0x7f23fc3fff70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.390882 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:41.390882 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:41.391848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b5f5e507-a9ed-4646-b849-8ae74d552fff tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] HTTP exception thrown: Hypervisor with ID 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' could not be found. Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5f5e507-a9ed-4646-b849-8ae74d552fff tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Request method failure captured: Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hypervisors/a689c3fd-8641-4021-a3c2-cbe2e0ab9d78 HTTP/1.1 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wh7lSsTr-rnhLBy182tHrwP0vCNU7LxAAx8bMIXGfzkjJek-Od772N_wRcwy5KMPfPA2w_YEkHsn4qfsGTNjH_nWRH-MZSG4clfqARCwODQYUXrkQAsf-tNUhj2DqP5nCq_fuzGOsF28GremiHqUWfoZod3hJ7T5YnNFCprtdrZdIw Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 74e18c3580fe4b059d0d7f08969ce051 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:39:41.394372 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74e18c3580fe4b059d0d7f08969ce051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 74e18c3580fe4b059d0d7f08969ce051 Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013 Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 87f5db59e14047f5bb3cebca199c052e Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: exception: Hypervisor with ID 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' could not be found. Jul 19 19:39:41.395727 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78'} Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 19:39:41.396371 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:39:41.397557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' could not be found. Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' could not be found. Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5f5e507-a9ed-4646-b849-8ae74d552fff tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] Returning 404 to user: Hypervisor with ID 'a689c3fd-8641-4021-a3c2-cbe2e0ab9d78' could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:41.398622 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5f5e507-a9ed-4646-b849-8ae74d552fff tempest-HypervisorAdminNegativeTestJSON-1088789013 tempest-HypervisorAdminNegativeTestJSON-1088789013-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/a689c3fd-8641-4021-a3c2-cbe2e0ab9d78" status: 404 len: 123 microversion: 2.1 time: 0.012721 Jul 19 19:39:41.399415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 70/154] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/os-hypervisors/a689c3fd-8641-4021-a3c2-cbe2e0ab9d78 => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:39:41.853202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:41.854843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:41.865701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:41.868615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.869069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:41.869896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:41.870325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:42.319385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:42.321928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:42.328075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:42.336241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:42.337255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:42.340581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:42.342051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:42.344240 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be478cc3-a48d-4ffd-823e-2d6f01c5ce74 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.493853 Jul 19 19:39:42.354619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 85/155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:41 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:42.373473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:42.374469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:42.385711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:42.386560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:42.388090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:42.388724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:42.542726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:42.556818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4fcc207-ecd5-4805-9ff9-09d915735614 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1340 microversion: 2.1 time: 0.187227 Jul 19 19:39:42.558085 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 86/156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:42 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1340 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:42.733950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:42.747988 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f32dfe7d-0e95-471c-9ec4-ffc175b126c4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.430893 Jul 19 19:39:42.752095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 71/157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:42 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:43.363627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:43.364892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:43.389942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:43.391260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:43.393275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:43.396373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:43.575215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:43.576790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:43.601627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:43.602272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:43.604217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:43.606873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:44.017321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:44.031888 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1a09de9d-a38b-4b8f-8649-bff04dc5288b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.674756 Jul 19 19:39:44.033138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 87/158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:43 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:44.038134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:44.039069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:44.046371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:44.047418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:44.048390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:44.049016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:44.168370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:44.176098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6882927-5530-4f5e-b21b-26b0f291da4f tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.605809 Jul 19 19:39:44.177371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 72/159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:43 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:44.472142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:44.480106 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23644a17-4eed-43dd-bb03-9599e7651fa0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.445622 Jul 19 19:39:44.480966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 88/160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:44 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:44.490106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-96825017-f6a5-48ae-b1ed-802d86c8eb14 req-125f0f41-33e4-4353-8dd0-449c833876a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0962b8af-0f27-411e-a220-45ca41f51493", "name": "network-vif-plugged", "status": "completed", "tag": "ad3301b5-fe16-4bc9-a01d-49545f3819cd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:44.494805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-96825017-f6a5-48ae-b1ed-802d86c8eb14 req-125f0f41-33e4-4353-8dd0-449c833876a6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:44.499419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-96825017-f6a5-48ae-b1ed-802d86c8eb14 req-125f0f41-33e4-4353-8dd0-449c833876a6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:44.524204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-96825017-f6a5-48ae-b1ed-802d86c8eb14 req-125f0f41-33e4-4353-8dd0-449c833876a6 service nova] Creating event network-vif-plugged:ad3301b5-fe16-4bc9-a01d-49545f3819cd for instance 0962b8af-0f27-411e-a220-45ca41f51493 on n-h1-843834-3 Jul 19 19:39:44.536144 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-96825017-f6a5-48ae-b1ed-802d86c8eb14 req-125f0f41-33e4-4353-8dd0-449c833876a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355781 Jul 19 19:39:44.537518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 73/161] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:44.959580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-07f3011b-9625-4405-997f-49a15ee33cea req-8334f53a-1cc7-4c70-a2a4-fafcfa415223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfaffe29-9112-4b41-8e9a-3556b7c7b8ec", "tag": "683810a0-b10e-490c-b6b4-081f0d618475"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:44.987822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-07f3011b-9625-4405-997f-49a15ee33cea req-8334f53a-1cc7-4c70-a2a4-fafcfa415223 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:44.988392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-07f3011b-9625-4405-997f-49a15ee33cea req-8334f53a-1cc7-4c70-a2a4-fafcfa415223 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.017651 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-07f3011b-9625-4405-997f-49a15ee33cea req-8334f53a-1cc7-4c70-a2a4-fafcfa415223 service nova] Creating event network-changed:683810a0-b10e-490c-b6b4-081f0d618475 for instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec on n-h1-843834-3 Jul 19 19:39:45.018420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-07f3011b-9625-4405-997f-49a15ee33cea req-8334f53a-1cc7-4c70-a2a4-fafcfa415223 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:39:45.021067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.022042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.023927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.027425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.050125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:45.050828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:45.053192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.compute.rpcapi [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 19:39:45.054096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] Releasing lock "compute-rpcapi-router" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:39:45.063161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.074098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.075072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.075526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.079863 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07b8d297-64c4-44eb-935e-a982c65fce9e None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124883 Jul 19 19:39:45.081035 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 89/162] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:45.195149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:45.195776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:45.206955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.208850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.210063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.210506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.360070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:45.368393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20688263-2dbe-45c5-bd3b-9994de6d3d84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.322780 Jul 19 19:39:45.368990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 74/163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:45 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:45.498555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:45.499311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:45.509513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.511201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.515091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:45.516153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:45.516917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:45.531368 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43766c4c-a499-41fe-8145-5d3a3c6b9ad3 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.340815 Jul 19 19:39:45.533410 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 90/164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:45 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:45.915284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bae36682-e5b2-4189-894c-ddf2ce264450 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Action: 'create', calling method: .version_select at 0x7f23fc2b4ee0>, body: {"keypair": {"name": "tempest-keypair-66610717", "type": "ssh", "user_id": "268dc1cd1d7740ebbf62c4248fc70df2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm1hf/DaN6wh9leAzDG9PJRbOKUg4/LN++7TnwhaYcQFoUTxpIM2uoOwU51ubIWGtYYa0k1izC1k0M9HL17/hYHa+SSWl2xCP3FNTCBna+BX5l50/zilq6GznOzbJfDeQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:45.935666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:45.946323 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d953a2b9-b77b-4ea1-b00f-3f60fe774b46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.452386 Jul 19 19:39:45.948080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bae36682-e5b2-4189-894c-ddf2ce264450 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:45.948471 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 75/165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:45 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:45.958423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bae36682-e5b2-4189-894c-ddf2ce264450 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for user 98fd06dd9f7247d78474694e41496d47 and project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:45.991381 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bae36682-e5b2-4189-894c-ddf2ce264450 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.435267 Jul 19 19:39:45.992641 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 91/166] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:39:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 438 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 19 19:39:46.005218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d4af2c0-28ba-4fb7-a0b6-67f016354a6a tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Action: 'create', calling method: .version_select at 0x7f23fc3f63a0>, body: {"keypair": {"name": "tempest-keypair-1735092319", "type": "ssh", "user_id": "268dc1cd1d7740ebbf62c4248fc70df2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtqw+nwH/8x+aqKjnm/qENhbfErE7zu0UEgcqS2TuvBZYvZrxyNN/U9q3tQtA6IB25cXJdu02LPwYRqYEqHvdmVaecGUik/iJXcPW44ZAfjY1P2hggL9LIik9RpkocSw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:46.040284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9d4af2c0-28ba-4fb7-a0b6-67f016354a6a tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:46.045533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9d4af2c0-28ba-4fb7-a0b6-67f016354a6a tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for user 98fd06dd9f7247d78474694e41496d47 and project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:46.082625 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d4af2c0-28ba-4fb7-a0b6-67f016354a6a tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.079520 Jul 19 19:39:46.084034 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 76/167] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:39:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:39:46.093895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5185d0da-a5e0-43b0-b3fa-3d09259dcecb tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Calling method '.version_select at 0x7f23fc22aaf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.103652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5185d0da-a5e0-43b0-b3fa-3d09259dcecb tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-66610717?user_id=268dc1cd1d7740ebbf62c4248fc70df2" status: 200 len: 510 microversion: 2.10 time: 0.013753 Jul 19 19:39:46.104697 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 92/168] 10.222.0.23 () {60 vars in 1333 bytes} [Tue Jul 19 19:39:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-66610717?user_id=268dc1cd1d7740ebbf62c4248fc70df2 => generated 510 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:39:46.121020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe4b2415-5cfb-4ebf-bc75-5c5fe123c8a1 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Action: 'create', calling method: .version_select at 0x7f23fc401160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-518662429", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn9OvxL6i6KJwGkc1DjO0+oSK9Lnb+aqk4rcTJJlEWfZhVhLAvUiDGzt0nmWIR8Sou8vkoH5f5QRqhxi2ialsnaK+8t2E4MFz+HAQvnqjavhEUStuLougEz0JEvpzpZWQ=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:46.153514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fe4b2415-5cfb-4ebf-bc75-5c5fe123c8a1 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:39:46.161178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fe4b2415-5cfb-4ebf-bc75-5c5fe123c8a1 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Getting quotas for user 98fd06dd9f7247d78474694e41496d47 and project 011d38ee1d304a379bc11bd85beaa222. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:39:46.195745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe4b2415-5cfb-4ebf-bc75-5c5fe123c8a1 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.081386 Jul 19 19:39:46.206652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e3e2e2f6-2bb5-468f-8e6f-bb2568be9b46 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Calling method '.version_select at 0x7f23fc1ee940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.209951 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-e3e2e2f6-2bb5-468f-8e6f-bb2568be9b46 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:39:46.212250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 77/169] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:39:46 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:39:46.219128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e3e2e2f6-2bb5-468f-8e6f-bb2568be9b46 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=268dc1cd1d7740ebbf62c4248fc70df2" status: 200 len: 724 microversion: 2.10 time: 0.016651 Jul 19 19:39:46.231688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-58e51111-5ff5-457e-a7a6-292ca4a8c769 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Calling method '.version_select at 0x7f23fc36d8b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.235158 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 93/170] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jul 19 19:39:46 2022] GET /compute/v2.1/os-keypairs?user_id=268dc1cd1d7740ebbf62c4248fc70df2 => generated 724 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:39:46.253464 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-58e51111-5ff5-457e-a7a6-292ca4a8c769 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-518662429" status: 204 len: 0 microversion: 2.10 time: 0.026138 Jul 19 19:39:46.254314 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 78/171] 10.222.0.23 () {60 vars in 1321 bytes} [Tue Jul 19 19:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-518662429 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:39:46.262636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f25451c8-33de-4356-9497-3e5937a02f2b tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Calling method '.version_select at 0x7f23fc1ee3a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.291153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f25451c8-33de-4356-9497-3e5937a02f2b tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735092319?user_id=268dc1cd1d7740ebbf62c4248fc70df2" status: 204 len: 0 microversion: 2.10 time: 0.032232 Jul 19 19:39:46.292033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 94/172] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735092319?user_id=268dc1cd1d7740ebbf62c4248fc70df2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:39:46.304982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-63e8bc63-ff83-4b71-a3b6-e6de19bebd89 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] Calling method '.version_select at 0x7f23fc30b8b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.312179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:46.331122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-63e8bc63-ff83-4b71-a3b6-e6de19bebd89 tempest-KeyPairsV210TestJSON-923988794 tempest-KeyPairsV210TestJSON-923988794-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66610717?user_id=268dc1cd1d7740ebbf62c4248fc70df2" status: 204 len: 0 microversion: 2.10 time: 0.029677 Jul 19 19:39:46.332389 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 79/173] 10.222.0.23 () {60 vars in 1336 bytes} [Tue Jul 19 19:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66610717?user_id=268dc1cd1d7740ebbf62c4248fc70df2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:39:46.386261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.387354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:46.396906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.399852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:46.401636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.404421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:46.550552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.557639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:46.565156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.565918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:46.567109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.568297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:46.690828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:46.720248 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7187d7b4-13cc-4c32-a54d-11438dad42b5 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1337 microversion: 2.1 time: 0.338662 Jul 19 19:39:46.721594 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 95/174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:46 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1337 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:46.820003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:46.830615 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0931d011-b72e-4e81-9738-96da06091e14 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.284435 Jul 19 19:39:46.832379 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 80/175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:46 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:46.973480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:46.974566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:46.985095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.986297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:46.987734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:46.989861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.331742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:47.344784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-303aed5c-2564-40e1-9faf-e7bda17bf525 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.384512 Jul 19 19:39:47.358214 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 96/176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:46 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:47.568111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Calling method '.version_select at 0x7f23fc36dd30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:47.569727 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:47.569727 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:47.572039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.572713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.592084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.592792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.605281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.606810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.615864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-428af10e-5ee1-4953-af89-d1bd3c823018 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.348724 Jul 19 19:39:47.616698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 81/177] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:47.629846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Calling method '.version_select at 0x7f23fc22aa60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:47.631329 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:47.631329 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:47.634346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.635188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.654234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.654986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.700011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.700921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.708387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-52d8149f-3ab0-48b7-a2f0-a0055be2c150 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-843834-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.084239 Jul 19 19:39:47.709645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 97/178] 10.222.0.23 () {58 vars in 1211 bytes} [Tue Jul 19 19:39:47 2022] GET /compute/v2.1/os-hypervisors/n-h1-843834-3/servers => generated 275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:47.729983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Calling method '.version_select at 0x7f23fc4388b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:47.731610 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:47.731610 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:47.740232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.743495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:47.744477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.750184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:47.761219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.763331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.764981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.767037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.787063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.790646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.838365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.838820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.851382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1cafc59-9fca-418e-bfb4-f8a5f1613e42 tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129519 Jul 19 19:39:47.852626 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 82/179] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:39:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:47.857431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:47.858249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:47.865635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.866328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:47.867346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:47.867944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.154622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:48.163523 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16668f0d-1efe-4a16-aef4-01118134f52e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.309655 Jul 19 19:39:48.164125 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 83/180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:47 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:48.173330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Calling method '.version_select at 0x7f23fc418dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:48.174110 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:48.174110 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:48.175290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.175735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.184512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:48.189541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:48.197256 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57776f36-17e1-4cbc-847a-85eba4288f84 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1487 microversion: 2.1 time: 0.463071 Jul 19 19:39:48.197862 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 98/181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:47 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1487 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:48.217952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:48.222228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:48.223589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.224194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.238995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.239429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.240210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.240639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.244281 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b3a0227-4f31-49a3-bd0c-574ca364c43c tempest-HypervisorAdminUnderV252Test-1355850472 tempest-HypervisorAdminUnderV252Test-1355850472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-843834-3/search" status: 200 len: 104 microversion: 2.1 time: 0.076788 Jul 19 19:39:48.245114 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 84/182] 10.222.0.23 () {58 vars in 1208 bytes} [Tue Jul 19 19:39:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-843834-3/search => generated 104 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:48.363709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:48.364741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:48.375636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.376092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.383813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:48.385072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:48.645825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=16 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:48.773202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:48.781628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b68bf1e-2506-4720-8595-8ee28dbd659a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.421810 Jul 19 19:39:48.794895 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 85/183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:48 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:49.008988 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bf1d6aec-bad8-4f7d-9973-3cc137a570ef tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1638 microversion: 2.1 time: 0.795325 Jul 19 19:39:49.013081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 99/184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:48 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1638 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:49.029715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:49.030227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:49.041559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.042039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.054175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.056627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.061714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:49.131371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:39:49.182509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:49.183171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:49.198982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.199448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.200891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.202525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.390413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f95105e9-b535-4591-97ec-1052d0ccc0aa tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 204 len: 0 microversion: 2.1 time: 0.363900 Jul 19 19:39:49.391423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 86/185] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:39:49 2022] DELETE /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:39:49.402510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:49.403247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:49.421879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.422284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.423096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.423533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.745195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:49.755503 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64a425c1-df86-4a97-9b44-dcec14527efb tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.577998 Jul 19 19:39:49.762412 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 100/186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:49 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:49.815853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:49.818484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:49.838774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.840660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.843964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:49.846558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:49.935329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:49.948436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04a0219a-5ef4-485c-9c09-2874b1a51ab9 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1493 microversion: 2.1 time: 0.552276 Jul 19 19:39:49.954209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 87/187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:49 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1493 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:39:50.124708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:50.138736 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ffc8ac9-5ee6-4ab8-8048-d41134d29a03 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.329477 Jul 19 19:39:50.140333 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 101/188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:49 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:50.780276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:50.781377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:50.795260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:50.796965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:50.800660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:50.801661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:50.881304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e0c6da27-3717-454b-9c96-e875b71bc423 req-a89a6634-043b-4c92-82f3-37190eec82d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "name": "network-vif-plugged", "status": "completed", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:50.904608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e0c6da27-3717-454b-9c96-e875b71bc423 req-a89a6634-043b-4c92-82f3-37190eec82d0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:50.910603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e0c6da27-3717-454b-9c96-e875b71bc423 req-a89a6634-043b-4c92-82f3-37190eec82d0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:50.947070 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e0c6da27-3717-454b-9c96-e875b71bc423 req-a89a6634-043b-4c92-82f3-37190eec82d0 service nova] Creating event network-vif-plugged:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h2-843834-3 Jul 19 19:39:50.961349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e0c6da27-3717-454b-9c96-e875b71bc423 req-a89a6634-043b-4c92-82f3-37190eec82d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084956 Jul 19 19:39:50.967959 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 102/189] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:50.988249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:50.989374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:51.011052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:51.013222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:51.016578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:51.017362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:51.968908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:51.991980 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-000fc0d8-1256-41bb-8ea6-3f1bce158352 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1493 microversion: 2.1 time: 1.021620 Jul 19 19:39:51.995217 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 103/190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:50 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1493 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:52.024078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:52.029003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:52.048471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:52.051930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:52.058054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:52.058620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:52.606563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:52.616293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e00cc96-1b69-49bc-8e1b-3fc03f066ffd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 1.842167 Jul 19 19:39:52.617246 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 88/191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:50 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:52.666896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:52.676639 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a593a2b2-c0b4-4679-9272-19ae32f20667 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.676091 Jul 19 19:39:52.677815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 104/192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:51 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:52.982428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-22eec89e-1ad7-47f3-8bb9-b2afa871ed0a req-fc8fddac-9d5a-4505-8783-f4a33aecb645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0962b8af-0f27-411e-a220-45ca41f51493", "name": "network-vif-deleted", "tag": "ad3301b5-fe16-4bc9-a01d-49545f3819cd"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:53.007852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-22eec89e-1ad7-47f3-8bb9-b2afa871ed0a req-fc8fddac-9d5a-4505-8783-f4a33aecb645 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.008706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-22eec89e-1ad7-47f3-8bb9-b2afa871ed0a req-fc8fddac-9d5a-4505-8783-f4a33aecb645 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.046433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb3e2b96-c862-4eda-b4d0-d199fd417e5a tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] Action: 'create', calling method: .version_select at 0x7f23fc36d280>, body: {"security_group": {"name": "tempest-securitygroup-2123931975", "description": "tempest-description-744980598"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:53.050787 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-22eec89e-1ad7-47f3-8bb9-b2afa871ed0a req-fc8fddac-9d5a-4505-8783-f4a33aecb645 service nova] Creating event network-vif-deleted:ad3301b5-fe16-4bc9-a01d-49545f3819cd for instance 0962b8af-0f27-411e-a220-45ca41f51493 on n-h1-843834-3 Jul 19 19:39:53.065337 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-22eec89e-1ad7-47f3-8bb9-b2afa871ed0a req-fc8fddac-9d5a-4505-8783-f4a33aecb645 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091354 Jul 19 19:39:53.066426 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 105/193] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:53.073196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:53.080877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:53.105410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.106120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.107146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.107743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.294554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b7bf8b38cc4511adc0923410b02d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c418f69e6aed48fdb23e24686b09ce69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:53.308822 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5ee8c750-a804-4608-8645-d8d829faa72b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 200 len: 1322 microversion: 2.1 time: 0.239829 Jul 19 19:39:53.309404 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 106/194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:53 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:53.326016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-75abf227-4de8-4485-9046-fe6bfe426991 req-ac51138b-05f9-4440-a1aa-62f234e43539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaffe29-9112-4b41-8e9a-3556b7c7b8ec", "name": "network-vif-plugged", "status": "completed", "tag": "683810a0-b10e-490c-b6b4-081f0d618475"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:53.338539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-75abf227-4de8-4485-9046-fe6bfe426991 req-ac51138b-05f9-4440-a1aa-62f234e43539 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.339291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-75abf227-4de8-4485-9046-fe6bfe426991 req-ac51138b-05f9-4440-a1aa-62f234e43539 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.354572 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-75abf227-4de8-4485-9046-fe6bfe426991 req-ac51138b-05f9-4440-a1aa-62f234e43539 service nova] Creating event network-vif-plugged:683810a0-b10e-490c-b6b4-081f0d618475 for instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec on n-h1-843834-3 Jul 19 19:39:53.361346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-75abf227-4de8-4485-9046-fe6bfe426991 req-ac51138b-05f9-4440-a1aa-62f234e43539 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041039 Jul 19 19:39:53.362315 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 107/195] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:53.624278 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb3e2b96-c862-4eda-b4d0-d199fd417e5a tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.005874 Jul 19 19:39:53.631292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 89/196] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:39:52 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:53.635270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:53.635734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81fd962e-3cc8-49a9-b2ed-16461d051373 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] Action: 'create', calling method: .version_select at 0x7f23fc30bb80>, body: {"security_group": {"name": "tempest-securitygroup-413746472", "description": "tempest-description-1517438773"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:53.636619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:53.666977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.668340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.670757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.671362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.925383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:53.940328 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04cb1fd4-163d-427e-aca9-e15f3335bcf5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1408 microversion: 2.1 time: 0.310262 Jul 19 19:39:53.944327 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 108/197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:53 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:53.949417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:53.950981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:53.981421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.981965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:53.983472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:53.984726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:54.023278 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81fd962e-3cc8-49a9-b2ed-16461d051373 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.391221 Jul 19 19:39:54.023978 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 90/198] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:39:53 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:54.169158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:54.177215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7bd4dd2-213c-4ea2-a825-ddaf33178b14 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1312 microversion: 2.1 time: 0.231808 Jul 19 19:39:54.177795 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 109/199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:53 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:54.506857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-106a6ee1-f4e9-42af-8126-77df03b5d6cb tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] Action: 'create', calling method: .version_select at 0x7f23fc2b5160>, body: {"security_group": {"name": "tempest-securitygroup-1303709267", "description": "tempest-description-1823352681"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:54.537247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb47186-b439-4a3b-8c69-569af3b627b7 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:54.538542 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:54.538542 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:54.541689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bdb47186-b439-4a3b-8c69-569af3b627b7 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb47186-b439-4a3b-8c69-569af3b627b7 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin] Request method failure captured: Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiK2_3cCEIl0HvyKp_uT7XcniD6P00n4tDGLdg01fXv8ABrDoQV6Ncr1I4M-rGxk7E7uTuVjaPdMXSPKuP7UWOKOXXNgTW1gihxR9SGRLxDQZVyMTiCxEvo0Gppew9A4u3tgogGwSxr_xg0FIv6BWV9Xjv9spQ27j3yPuQz_yM4npo Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 0346319e001445abbf3f59e980b9576d Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:39:54.550198 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0346319e001445abbf3f59e980b9576d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0346319e001445abbf3f59e980b9576d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0346319e001445abbf3f59e980b9576d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0346319e001445abbf3f59e980b9576d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 0346319e001445abbf3f59e980b9576d Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: e844fd691ce54efcbdabe459b197854f Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid timestamp for date invalid_time Jul 19 19:39:54.551799 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'invalid_time'} Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:54.552600 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.553970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb47186-b439-4a3b-8c69-569af3b627b7 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:54.556063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdb47186-b439-4a3b-8c69-569af3b627b7 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965 tempest-InstanceUsageAuditLogNegativeTestJSON-20174965-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.376984 Jul 19 19:39:54.558982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 110/200] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jul 19 19:39:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:39:54.570118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:54.573656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:54.583959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:54.584402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:54.585391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:54.586001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:54.602138 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] HTTP exception thrown: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Request method failure captured: Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 HTTP/1.1 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whcWgRzRcMmWdMqqPEgNZZ3AbPAawXuR8gCpDye10iV5lMyPlhNZ9z3ZhFValfL29t9DaJ7hypJumAQOrur60O7jOpU0FmjFMvH3DnT_-n8FrNvd7P_43udInnBBqyrQx_SYWVgjZFEBHn-xeUmQr_lMeeX1TnVOSgdIZhBPzoz9N0 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:54.605383 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d8b7bf8b38cc4511adc0923410b02d3d Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:39:54.606603 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0962b8af-0f27-411e-a220-45ca41f51493'} Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:54.607277 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:39:54.608334 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.611334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Returning 404 to user: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:54.612492 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be396a9d-cf6e-46cd-b73b-68ebdfd21336 tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 404 len: 111 microversion: 2.1 time: 0.052321 Jul 19 19:39:54.617628 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 111/201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:54 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:54.825178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad65a288-115c-4495-a52b-cb5eb54dc62b tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:54.825944 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:54.825944 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:54.827377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad65a288-115c-4495-a52b-cb5eb54dc62b tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cb8d1ac88ed94d53a922d04e9dfc1060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6eb221d7a8439ca45ffe208a3b3ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad65a288-115c-4495-a52b-cb5eb54dc62b tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Request method failure captured: Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiIgR8w6TLB5PptFFIMjD0gK_lozbSt1jEgwYS41R9076Mb3mN4uH5gF8CZfaHlXA10eIlSnOK7NerPMqzElGKVS-6WgxE0EK1MJqdU7pVFajECqSpRjBzRiBcax4yVN9oAQ5tAeSDuf94ngSS-Lc0VU3eVBEOMJQQFbKQBM2QG4FU Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ef6eb221d7a8439ca45ffe208a3b3ad2 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:39:54.829217 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ef6eb221d7a8439ca45ffe208a3b3ad2 Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cb8d1ac88ed94d53a922d04e9dfc1060 Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:39:54.830672 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:54.831554 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 19:39:54.832864 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.836512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad65a288-115c-4495-a52b-cb5eb54dc62b tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:54.839191 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad65a288-115c-4495-a52b-cb5eb54dc62b tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.219552 Jul 19 19:39:54.840749 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 112/202] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:39:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:54.853720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b63b7c7-f7d2-4dad-911f-b7daa26b728f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:54.855539 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:54.855539 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:54.855738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-106a6ee1-f4e9-42af-8126-77df03b5d6cb tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.821977 Jul 19 19:39:54.856224 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 91/203] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:39:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:39:54.863245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f14a44a1-c46a-4774-bf70-1dd32fd9bec5 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:54.864476 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:54.864476 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:54.868908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f14a44a1-c46a-4774-bf70-1dd32fd9bec5 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cb8d1ac88ed94d53a922d04e9dfc1060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6eb221d7a8439ca45ffe208a3b3ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f14a44a1-c46a-4774-bf70-1dd32fd9bec5 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Request method failure captured: Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019:39:54 HTTP/1.1 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wiIgR8w6TLB5PptFFIMjD0gK_lozbSt1jEgwYS41R9076Mb3mN4uH5gF8CZfaHlXA10eIlSnOK7NerPMqzElGKVS-6WgxE0EK1MJqdU7pVFajECqSpRjBzRiBcax4yVN9oAQ5tAeSDuf94ngSS-Lc0VU3eVBEOMJQQFbKQBM2QG4FU Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ef6eb221d7a8439ca45ffe208a3b3ad2 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:39:54.871881 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef6eb221d7a8439ca45ffe208a3b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ef6eb221d7a8439ca45ffe208a3b3ad2 Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cb8d1ac88ed94d53a922d04e9dfc1060 Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:39:54.873103 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '2022-07-19 19:39:54'} Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:39:54.873861 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 19:39:54.875138 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:39:54.875984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f14a44a1-c46a-4774-bf70-1dd32fd9bec5 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:39:54.878301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b63b7c7-f7d2-4dad-911f-b7daa26b728f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:54.878468 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f14a44a1-c46a-4774-bf70-1dd32fd9bec5 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816 tempest-InstanceUsageAuditLogNegativeTestJSON-2134750816-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 19:39:54" status: 403 len: 128 microversion: 2.1 time: 0.019866 Jul 19 19:39:54.879370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b63b7c7-f7d2-4dad-911f-b7daa26b728f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:54.880348 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 92/204] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 19:39:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019%3A39%3A54 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:39:54.892748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44249852-d789-4f6a-ad56-153d235195d0 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] Action: 'create', calling method: .version_select at 0x7f23fc2aa1f0>, body: {"security_group": {"name": "tempest-securitygroup-1629567557", "description": "tempest-description-960097354"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:55.050406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:55.109123 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b63b7c7-f7d2-4dad-911f-b7daa26b728f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 296 microversion: 2.1 time: 0.266449 Jul 19 19:39:55.109897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 113/205] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 296 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:55.121336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:55.126606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:55.144983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.145559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.146544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.147040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.193349 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44249852-d789-4f6a-ad56-153d235195d0 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.310634 Jul 19 19:39:55.199572 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 93/206] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:39:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:55.200887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5dc55a1a-9876-435b-870d-ef0671718b71 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:55.201669 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:55.201669 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:55.254199 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5dc55a1a-9876-435b-870d-ef0671718b71 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.058467 Jul 19 19:39:55.254871 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 94/207] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:39:55 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:39:55.262524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:55.263493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:55.275810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.276557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.277749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.278360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.453398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:55.461834 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0237b40-bd4f-4d53-9a32-17b0e405cf51 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1586 microversion: 2.1 time: 0.350589 Jul 19 19:39:55.462766 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 114/208] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:55 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1586 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:55.480527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc610305-b3c1-4a6b-a151-23142f3bd522 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] Calling method '.version_select at 0x7f23fc1fe9d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:55.667570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:55.682491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-64de5bfb-8bec-4920-8269-61cf1c5b7edd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1461 microversion: 2.1 time: 0.423719 Jul 19 19:39:55.683598 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 95/209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:55 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1461 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:55.709446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a75d29af-7d70-48a5-aed6-ff95bfccc3a1 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1902861927"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:55.720754 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:55.720754 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:55.721907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-a75d29af-7d70-48a5-aed6-ff95bfccc3a1 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid 8b57fc12-1210-4117-ad9e-64852274e519 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:39:55.753669 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a75d29af-7d70-48a5-aed6-ff95bfccc3a1 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058314 Jul 19 19:39:55.760655 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 96/210] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:39:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:55.767172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:55.768040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:55.779847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.781956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.783351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:55.784170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:55.968828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:55.992388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08a28ef4-1360-49fa-95f4-de83bf23288a tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227705 Jul 19 19:39:56.002976 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 97/211] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:39:55 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:56.172948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=16 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:39:56.472582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:56.474038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:56.490743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:56.495417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:56.496493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:56.497085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:57.554066 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1189eb58-8748-4a47-9eef-2cb31e47d3fa tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1612 microversion: 2.1 time: 1.546632 Jul 19 19:39:57.555529 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 98/212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:56 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1612 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:57.574799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7ae8ea3-4ecb-460f-94d4-f3b6c5a7c153 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:57.580012 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:57.580012 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:57.603181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ea3-4ecb-460f-94d4-f3b6c5a7c153 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:57.603699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ea3-4ecb-460f-94d4-f3b6c5a7c153 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:58.199911 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7ae8ea3-4ecb-460f-94d4-f3b6c5a7c153 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.642558 Jul 19 19:39:58.200815 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 99/213] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:58.207942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:58.208972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:58.217327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:58.218034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:58.219149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:58.220044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:58.386520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5af05fbd4f98465ba488d5fc95359327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79a79c2b88d4f4d80826bdd0df205c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:39:58.387526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] flavor_id is None. Assuming migration. {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 19:39:58.388715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:39:58.709078 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc610305-b3c1-4a6b-a151-23142f3bd522 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9683 microversion: 2.1 time: 3.232375 Jul 19 19:39:58.709683 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 115/214] 10.222.0.23 () {58 vars in 1190 bytes} [Tue Jul 19 19:39:55 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9683 bytes in 3234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:39:58.714309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f71377b0-456d-4d54-896f-131b4960a0bb tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:58.715087 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:58.715087 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:39:58.729383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f71377b0-456d-4d54-896f-131b4960a0bb tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.018663 Jul 19 19:39:58.730145 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 116/215] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:39:58 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:58.745053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c23615e1-60a4-4e23-9efe-6d9638df8ff8 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] Calling method '.version_select at 0x7f23fc22aaf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:58.876106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98d9be6a-d564-4376-8317-3d5ce050bff7 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5/action" status: 202 len: 0 microversion: 2.1 time: 0.673458 Jul 19 19:39:58.881044 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 100/216] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:39:58 2022] POST /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:39:58.900121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a0173f2-99dd-4c1b-8cd2-93d31338c0d2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:39:58.903161 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:39:58.903161 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:39:58.926408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a0173f2-99dd-4c1b-8cd2-93d31338c0d2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:58.927433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a0173f2-99dd-4c1b-8cd2-93d31338c0d2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:59.187211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a0173f2-99dd-4c1b-8cd2-93d31338c0d2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.301514 Jul 19 19:39:59.188603 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 101/217] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:39:58 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:39:59.200137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:39:59.201908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:39:59.219444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:59.220136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:39:59.222229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:39:59.223453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:00.238050 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c23615e1-60a4-4e23-9efe-6d9638df8ff8 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.498026 Jul 19 19:40:00.241249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 117/218] 10.222.0.23 () {58 vars in 1190 bytes} [Tue Jul 19 19:39:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:00.246840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8252fc1c-a789-4e8d-8474-5f238011467b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:00.248134 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:00.248134 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:00.249964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:00.260053 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba6eb020-3587-46f4-8b5a-86af84dbc2a6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1470 microversion: 2.1 time: 1.069602 Jul 19 19:40:00.262639 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 102/219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:39:59 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1470 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:00.270007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:00.275285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:00.293682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:00.294480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:00.295590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:00.296161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:00.319729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8252fc1c-a789-4e8d-8474-5f238011467b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.077068 Jul 19 19:40:00.321764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 118/220] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:00 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:00.732118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-050807e8-c1a9-402b-a6d3-7b9a0297d9b5 req-55e3da22-ab33-41f3-9fa1-c8f5fb7e71a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfaffe29-9112-4b41-8e9a-3556b7c7b8ec", "tag": "683810a0-b10e-490c-b6b4-081f0d618475"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:00.742083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-050807e8-c1a9-402b-a6d3-7b9a0297d9b5 req-55e3da22-ab33-41f3-9fa1-c8f5fb7e71a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:00.742894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-050807e8-c1a9-402b-a6d3-7b9a0297d9b5 req-55e3da22-ab33-41f3-9fa1-c8f5fb7e71a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:00.771740 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-050807e8-c1a9-402b-a6d3-7b9a0297d9b5 req-55e3da22-ab33-41f3-9fa1-c8f5fb7e71a8 service nova] Creating event network-changed:683810a0-b10e-490c-b6b4-081f0d618475 for instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec on n-h1-843834-3 Jul 19 19:40:00.795570 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-050807e8-c1a9-402b-a6d3-7b9a0297d9b5 req-55e3da22-ab33-41f3-9fa1-c8f5fb7e71a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462190 Jul 19 19:40:00.831556 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 119/221] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:00.849436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1456a14b-4736-4799-aec8-e79960febe33 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] Calling method '.version_select at 0x7f23fc1a8550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:01.150612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:01.160581 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0845b075-6c6f-4936-aaaa-e5f5b024213b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 200 len: 1586 microversion: 2.1 time: 0.896068 Jul 19 19:40:01.163956 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 103/222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:00 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 1586 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:01.174575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61436350-172f-41ba-89bd-7d4e9abab357 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-564070996"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:01.176663 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:01.176663 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:01.177792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-61436350-172f-41ba-89bd-7d4e9abab357 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid f94726c8-5c67-4226-9979-93d64e082d87 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:01.238051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61436350-172f-41ba-89bd-7d4e9abab357 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071966 Jul 19 19:40:01.240096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 104/223] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:01.253039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8a6ee1c-5ee4-4a6a-bace-e7507f435034 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:01.259155 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:01.259155 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:01.281701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8a6ee1c-5ee4-4a6a-bace-e7507f435034 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:01.282560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8a6ee1c-5ee4-4a6a-bace-e7507f435034 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:01.454053 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8a6ee1c-5ee4-4a6a-bace-e7507f435034 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.207358 Jul 19 19:40:01.455456 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 105/224] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:40:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:01.461262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:01.464361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:01.479203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:01.479654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:01.480602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:01.481209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:02.011351 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1456a14b-4736-4799-aec8-e79960febe33 tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8740f7d2-5e9d-4f9f-9ad2-b664e64d6ff4" status: 202 len: 0 microversion: 2.1 time: 1.175117 Jul 19 19:40:02.018956 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 120/225] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:40:00 2022] DELETE /compute/v2.1/os-security-groups/8740f7d2-5e9d-4f9f-9ad2-b664e64d6ff4 => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:02.025509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9811f36d-6b2e-400f-9f3b-0ce4383549bf tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:02.027054 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:02.027054 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:02.053060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9811f36d-6b2e-400f-9f3b-0ce4383549bf tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.032584 Jul 19 19:40:02.055446 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 121/226] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:40:02 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:02.075720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7ff8bef-d9ec-464d-b74e-c0b9b762c07e tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] Calling method '.version_select at 0x7f23fc2b4820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:02.145137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:02.157998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f975b4c-bca8-476d-9b40-c61c90f31b84 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1470 microversion: 2.1 time: 0.701153 Jul 19 19:40:02.158657 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 106/227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:01 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1470 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:02.174591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34e7b2d6-3bc0-4169-bc6b-5babdd0b88b8 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:02.176465 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:02.176465 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:02.186471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e7b2d6-3bc0-4169-bc6b-5babdd0b88b8 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:02.187456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e7b2d6-3bc0-4169-bc6b-5babdd0b88b8 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:02.380606 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34e7b2d6-3bc0-4169-bc6b-5babdd0b88b8 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.220425 Jul 19 19:40:02.381486 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 107/228] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 19 19:40:02 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:02.391773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d9df351-708b-49ac-b1ae-d1971f4660b5 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:02.392775 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:02.392775 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:02.432100 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d9df351-708b-49ac-b1ae-d1971f4660b5 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.043880 Jul 19 19:40:02.433390 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 108/229] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:02 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:02.445030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c8da06fd-fcc9-4565-b028-ffd45ca0a6b6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-399794718"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:02.446977 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:02.446977 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:02.448886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-c8da06fd-fcc9-4565-b028-ffd45ca0a6b6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid 305887a9-7f8e-498b-8e49-9513997a63ca for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:02.457195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:02.480510 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c8da06fd-fcc9-4565-b028-ffd45ca0a6b6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040553 Jul 19 19:40:02.481633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 109/230] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:02.495567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f16cf2e-0bb2-4b82-b9ee-4ac32862c545 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:02.497614 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:02.497614 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:02.509052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f16cf2e-0bb2-4b82-b9ee-4ac32862c545 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:02.510242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f16cf2e-0bb2-4b82-b9ee-4ac32862c545 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:02.679812 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f16cf2e-0bb2-4b82-b9ee-4ac32862c545 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.191443 Jul 19 19:40:02.680931 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 110/231] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:02 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:02.800644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1771653480", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:02.867151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:03.271698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7ff8bef-d9ec-464d-b74e-c0b9b762c07e tempest-SecurityGroupsTestAdminJSON-177763621 tempest-SecurityGroupsTestAdminJSON-177763621-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/02eac003-f86b-404b-b249-4631aa1453a7" status: 202 len: 0 microversion: 2.1 time: 1.209157 Jul 19 19:40:03.272271 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 122/232] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:40:02 2022] DELETE /compute/v2.1/os-security-groups/02eac003-f86b-404b-b249-4631aa1453a7 => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:03.277088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-613c81ad-1d59-4346-b60e-ae31d2f9d481 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:03.278379 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:03.278379 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:03.287099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-613c81ad-1d59-4346-b60e-ae31d2f9d481 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:03.287906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-613c81ad-1d59-4346-b60e-ae31d2f9d481 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:03.403396 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-613c81ad-1d59-4346-b60e-ae31d2f9d481 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.129768 Jul 19 19:40:03.404720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 123/233] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:03 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:03.414655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:03.415708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:03.422067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:03.422510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:03.423334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:03.423744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:03.458190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:03.459247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:03.459809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:03.460852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:03.461640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:03.471169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:03.471808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:03.472609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:03.473074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:03.490562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Getting quotas for project 4601171dbe70469f92c46321f5bc303d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:03.494862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Getting quotas for user b6cf07e85a804d64be9ec9817cdbba00 and project 4601171dbe70469f92c46321f5bc303d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:03.506255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:03.508720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:03.555694 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7776e3d5-cd84-43a2-8fb4-db9d9fb9b45e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873432 Jul 19 19:40:03.561188 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 111/234] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:40:03.561188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c8667d2d-3121-48d1-9820-dd595a08de06 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] Calling method '.version_select at 0x7f23fc36dd30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:03.977630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:03.989965 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e0ec148-7f78-42b2-ba0b-e46235d42517 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1470 microversion: 2.1 time: 0.583384 Jul 19 19:40:03.990558 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 124/235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:03 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1470 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:03.999734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-27a8a39f-6ad8-437e-be41-1dbd843e32aa tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.000768 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.000768 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:04.013232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=5 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:04.032003 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-27a8a39f-6ad8-437e-be41-1dbd843e32aa tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039410 Jul 19 19:40:04.033320 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 125/236] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:03 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:04.051658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.052280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:04.063585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:04.064036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:04.065052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:04.065745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:04.361890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:04.370282 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12d45bde-d8b7-4d8f-9d65-6cec0ed1a328 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1215 microversion: 2.1 time: 0.335542 Jul 19 19:40:04.380009 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 126/237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:04 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:04.383851 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c8667d2d-3121-48d1-9820-dd595a08de06 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/53761f47-a4ff-4fbc-a42e-d21bb04dd823" status: 202 len: 0 microversion: 2.1 time: 0.826335 Jul 19 19:40:04.385207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c9d1579-fb0f-4639-98f8-306d342be4e2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1121524013"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.386839 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.386839 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:04.388113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-6c9d1579-fb0f-4639-98f8-306d342be4e2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid 408e9191-9ca9-40ac-9b9b-cd5d94132617 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:04.388272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 112/238] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:40:03 2022] DELETE /compute/v2.1/os-security-groups/53761f47-a4ff-4fbc-a42e-d21bb04dd823 => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:04.393156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62766e41-5fdf-4d15-8295-067a8d1f27e7 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936809543"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.397386 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.397386 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.398350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-62766e41-5fdf-4d15-8295-067a8d1f27e7 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Generated uuid 81862a98-1129-47d0-bc0e-999703b24738 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:04.415393 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c9d1579-fb0f-4639-98f8-306d342be4e2 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033409 Jul 19 19:40:04.416970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 127/239] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:04.423521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa1562ef-c671-4da6-b4cd-92d331262947 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] Calling method '.version_select at 0x7f23fc2b44c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.441234 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62766e41-5fdf-4d15-8295-067a8d1f27e7 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.051777 Jul 19 19:40:04.442160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 113/240] 10.222.0.23 () {62 vars in 1204 bytes} [Tue Jul 19 19:40:04 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:04.453250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ace5fbc4-0d41-44de-ac73-99e49de449ca tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.454056 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.454056 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.474201 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ace5fbc4-0d41-44de-ac73-99e49de449ca tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.030417 Jul 19 19:40:04.475878 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 114/241] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:04 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:04.481034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef5db9ef-75e0-4b13-baa5-912e9fc8e15a tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1091669452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.553067 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.553067 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.584376 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef5db9ef-75e0-4b13-baa5-912e9fc8e15a tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.107117 Jul 19 19:40:04.585608 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 115/242] 10.222.0.23 () {62 vars in 1212 bytes} [Tue Jul 19 19:40:04 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:04.591116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d5dedd9-e3ba-4670-8a89-88352761edbe tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.591910 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.591910 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.599573 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7d5dedd9-e3ba-4670-8a89-88352761edbe tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d5dedd9-e3ba-4670-8a89-88352761edbe tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Request method failure captured: Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wheV6hQ_YYVB-hIcAaeRK8fbj2vwgCm-9471ozuel0hYgWnfJLjzwgrsDgfzq1DlhF9NuIWEfgKea0tez3lE9alei7EXiOlHqPzBNoVXJhxofHR0HR1Q5AvkWpGvvvjWHGEHB7n4guRZtxQ0LYyDQrm4fH5YF7FZbVqxqkF__X2fdo Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:40:04.602050 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: fe4edd65c4eb42cb9739e717f852ff23 Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: exception: Aggregate 11 could not be found. Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '11'} Jul 19 19:40:04.603662 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.604380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.605475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d5dedd9-e3ba-4670-8a89-88352761edbe tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:04.607122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d5dedd9-e3ba-4670-8a89-88352761edbe tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.017432 Jul 19 19:40:04.607122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 116/243] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:04 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:04.613599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a24a3cc4-f6f0-41fd-85d9-aec6a1f63d24 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.623434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a24a3cc4-f6f0-41fd-85d9-aec6a1f63d24 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.015730 Jul 19 19:40:04.624020 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 117/244] 10.222.0.23 () {60 vars in 1192 bytes} [Tue Jul 19 19:40:04 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:04.630290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-862a6fda-0acc-444d-8ebf-b4cae121a07b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:04.631118 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.631118 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.641799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-862a6fda-0acc-444d-8ebf-b4cae121a07b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-862a6fda-0acc-444d-8ebf-b4cae121a07b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Request method failure captured: Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wheV6hQ_YYVB-hIcAaeRK8fbj2vwgCm-9471ozuel0hYgWnfJLjzwgrsDgfzq1DlhF9NuIWEfgKea0tez3lE9alei7EXiOlHqPzBNoVXJhxofHR0HR1Q5AvkWpGvvvjWHGEHB7n4guRZtxQ0LYyDQrm4fH5YF7FZbVqxqkF__X2fdo Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:40:04.643669 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: fe4edd65c4eb42cb9739e717f852ff23 Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: exception: Aggregate 11 could not be found. Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '11'} Jul 19 19:40:04.644831 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:04.645543 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:04.646615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-862a6fda-0acc-444d-8ebf-b4cae121a07b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-862a6fda-0acc-444d-8ebf-b4cae121a07b tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.020051 Jul 19 19:40:04.648454 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 118/245] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:04 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:04.654287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ed471cc-0efa-4898-8de8-68ffe1efad8c tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.655645 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.655645 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.666641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ed471cc-0efa-4898-8de8-68ffe1efad8c tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:04.667713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ed471cc-0efa-4898-8de8-68ffe1efad8c tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:04.671507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:04.825433 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ed471cc-0efa-4898-8de8-68ffe1efad8c tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.178794 Jul 19 19:40:04.826567 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 119/246] 10.222.0.23 () {62 vars in 1234 bytes} [Tue Jul 19 19:40:04 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:04.835463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bea73e65-a2d8-428d-a4b8-94843d7dd289 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-682800612", "name": "tempest-test_aggregate-1878336157"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.862073 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.862073 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.863445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-bea73e65-a2d8-428d-a4b8-94843d7dd289 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid d0571930-3ee5-4130-acec-f914a2c0f6ff for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:04.897326 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bea73e65-a2d8-428d-a4b8-94843d7dd289 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.069568 Jul 19 19:40:04.903344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 120/247] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Jul 19 19:40:04 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:04.910252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e5cef33c-3ad8-465c-b73c-f10a203cb4f4 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:04.913639 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:04.913639 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:04.929535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5cef33c-3ad8-465c-b73c-f10a203cb4f4 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:04.929992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5cef33c-3ad8-465c-b73c-f10a203cb4f4 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.060010 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e5cef33c-3ad8-465c-b73c-f10a203cb4f4 tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.159861 Jul 19 19:40:05.061627 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 121/248] 10.222.0.23 () {62 vars in 1234 bytes} [Tue Jul 19 19:40:04 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:05.066604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83b89882-b3b7-4130-8f96-dc488a9f988d tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.068262 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.068262 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.095321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83b89882-b3b7-4130-8f96-dc488a9f988d tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.032149 Jul 19 19:40:05.096817 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 122/249] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:05 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:05.103017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.103873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:05.112119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.112579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.113474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.113976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.152813 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa1562ef-c671-4da6-b4cd-92d331262947 tempest-SecurityGroupsTestAdminJSON-1614092176 tempest-SecurityGroupsTestAdminJSON-1614092176-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3f948587-9440-47de-b852-c1508680b5a0" status: 202 len: 0 microversion: 2.1 time: 0.733609 Jul 19 19:40:05.154273 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 128/250] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:40:04 2022] DELETE /compute/v2.1/os-security-groups/3f948587-9440-47de-b852-c1508680b5a0 => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:05.159605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5aa1d19b-9f20-4435-9be3-1b6e6fbfd3ed tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.161126 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.161126 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.205786 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5aa1d19b-9f20-4435-9be3-1b6e6fbfd3ed tempest-AggregatesAdminTestV241-255548650 tempest-AggregatesAdminTestV241-255548650-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.050199 Jul 19 19:40:05.209238 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 129/251] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Jul 19 19:40:05 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.221903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35566a4e-3af3-4524-87c5-5b8a7c4a4411 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.222674 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.222674 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.237898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-35566a4e-3af3-4524-87c5-5b8a7c4a4411 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35566a4e-3af3-4524-87c5-5b8a7c4a4411 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Request method failure captured: Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wheV6hQ_YYVB-hIcAaeRK8fbj2vwgCm-9471ozuel0hYgWnfJLjzwgrsDgfzq1DlhF9NuIWEfgKea0tez3lE9alei7EXiOlHqPzBNoVXJhxofHR0HR1Q5AvkWpGvvvjWHGEHB7n4guRZtxQ0LYyDQrm4fH5YF7FZbVqxqkF__X2fdo Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:05.244050 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: fe4edd65c4eb42cb9739e717f852ff23 Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate 13 could not be found. Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '13'} Jul 19 19:40:05.245424 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.246152 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 19 19:40:05.247212 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.250475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35566a4e-3af3-4524-87c5-5b8a7c4a4411 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:05.251781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35566a4e-3af3-4524-87c5-5b8a7c4a4411 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.037066 Jul 19 19:40:05.255619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 130/252] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:05 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:05.265130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49c27215-9906-4dfe-85ff-dc237c33f773 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1101352692"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.266939 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.266939 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.268211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-49c27215-9906-4dfe-85ff-dc237c33f773 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 32c80e4d-8faa-4263-bcd5-45feb0ff7aef for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:05.314370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49c27215-9906-4dfe-85ff-dc237c33f773 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053204 Jul 19 19:40:05.315280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 131/253] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.328100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-423a4389-6560-4178-af71-ab34c4214c6a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.328876 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.328876 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.353054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-423a4389-6560-4178-af71-ab34c4214c6a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-423a4389-6560-4178-af71-ab34c4214c6a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Request method failure captured: Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wheV6hQ_YYVB-hIcAaeRK8fbj2vwgCm-9471ozuel0hYgWnfJLjzwgrsDgfzq1DlhF9NuIWEfgKea0tez3lE9alei7EXiOlHqPzBNoVXJhxofHR0HR1Q5AvkWpGvvvjWHGEHB7n4guRZtxQ0LYyDQrm4fH5YF7FZbVqxqkF__X2fdo Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:05.356179 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cfd3aec6024a0ea6dd00fa93aacce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 88cfd3aec6024a0ea6dd00fa93aacce1 Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-38431680 Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: fe4edd65c4eb42cb9739e717f852ff23 Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminTestJSON-38431680-project-admin Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: exception: Aggregate 13 could not be found. Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '13'} Jul 19 19:40:05.357706 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:05.358573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.360532 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.363551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-423a4389-6560-4178-af71-ab34c4214c6a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:05.364693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-423a4389-6560-4178-af71-ab34c4214c6a tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.048254 Jul 19 19:40:05.365301 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 132/254] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:05 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:05.381407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c915ed3-2da0-4627-9c28-e2c2f41a7e8f tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.382692 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.382692 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.398419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c915ed3-2da0-4627-9c28-e2c2f41a7e8f tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.398970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c915ed3-2da0-4627-9c28-e2c2f41a7e8f tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.505301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:05.515233 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91a07625-081d-47a9-bdc3-4858765d41e9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.416902 Jul 19 19:40:05.515698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 123/255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:05 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:05.532940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33daecd9-1549-4a96-9ad1-368395698e81 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1742303400"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.534533 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.534533 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.535739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-33daecd9-1549-4a96-9ad1-368395698e81 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid 9c224ec1-6b94-4699-a51f-153acbfb323c for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:05.565722 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-33daecd9-1549-4a96-9ad1-368395698e81 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036464 Jul 19 19:40:05.584289 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 124/256] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.585352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1c915ed3-2da0-4627-9c28-e2c2f41a7e8f tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 243 microversion: 2.1 time: 0.214769 Jul 19 19:40:05.586876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 133/257] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates/14/action => generated 243 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.596642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa1bd0d4-103e-4806-acac-67ad8c2d212f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.598283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.598930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:05.600562 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.600562 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.608025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.608529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.609686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.610459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.616533 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa1bd0d4-103e-4806-acac-67ad8c2d212f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.028180 Jul 19 19:40:05.625857 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 134/258] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:05 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.631204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b32e79e5-092c-4b50-9f67-492ee8a8f0bb tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.632660 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.632660 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.635021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b32e79e5-092c-4b50-9f67-492ee8a8f0bb tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd504fd1dc8424716babe75d66be42951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a3cfcdab84cf9bb35dfb6ad31c747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b32e79e5-092c-4b50-9f67-492ee8a8f0bb tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Request method failure captured: Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 42 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whZ-Q3mK2L35daDUlB0wC-AZZqfBHtlAaDK4wAY0JPKeflMveI6I5HYHoXuNlOKx9UPzglD9DJaboG1uYuE5Ap5a-nvM_udOMyCviY2koYkfiQnKKXMGNUlPykQ2RsauQ3roypVn6ken76KtAoviGBc3Kld6dCyDMbXgU9bbVFa5jU Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:05.646989 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc1a3cfcdab84cf9bb35dfb6ad31c747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dc1a3cfcdab84cf9bb35dfb6ad31c747 Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-543207510 Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d504fd1dc8424716babe75d66be42951 Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-543207510-project Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: {"remove_host": {"host": "n-h1-843834-3"}} Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:05.648773 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'n-h1-843834-3'}}} Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:05.650398 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 19:40:05.653058 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:05.656871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b32e79e5-092c-4b50-9f67-492ee8a8f0bb tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:05.658390 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b32e79e5-092c-4b50-9f67-492ee8a8f0bb tempest-AggregatesAdminNegativeTestJSON-543207510 tempest-AggregatesAdminNegativeTestJSON-543207510-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/14/action" status: 403 len: 121 microversion: 2.1 time: 0.031504 Jul 19 19:40:05.659115 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 135/259] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates/14/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:05.666036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d644a489-506d-406f-a1ed-23b8f74339f6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.668272 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.668272 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.704699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d644a489-506d-406f-a1ed-23b8f74339f6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.044174 Jul 19 19:40:05.705598 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 136/260] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.718607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07cb59e6-1a0d-4cbf-90f6-5875648cc582 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.720172 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.720172 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.728097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:05.728999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb59e6-1a0d-4cbf-90f6-5875648cc582 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.729439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb59e6-1a0d-4cbf-90f6-5875648cc582 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.739729 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c1b1e2f-1d8d-4af0-9c4c-653f4041a82f tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1277 microversion: 2.1 time: 0.152718 Jul 19 19:40:05.740354 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 125/261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:05 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:05.746512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16e0cd14-a941-4329-afb9-8fbf6cbfc25f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.747313 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.747313 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.766231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16e0cd14-a941-4329-afb9-8fbf6cbfc25f tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.024488 Jul 19 19:40:05.766458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 126/262] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:40:05 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.777988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d55015ca-240b-4b13-9fe9-6117fa212eba tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.778999 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.778999 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.804782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d55015ca-240b-4b13-9fe9-6117fa212eba tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.031717 Jul 19 19:40:05.805410 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 127/263] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:05 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:05.820058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41d74603-d8ff-41e4-9a82-d4b837a530e6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254840651", "availability_zone": "tempest-test_az-1664101093"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.823422 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.823422 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.824730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-41d74603-d8ff-41e4-9a82-d4b837a530e6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid 330d2ef8-29ba-40df-8001-55f52691a7f8 for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:05.859806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41d74603-d8ff-41e4-9a82-d4b837a530e6 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.047678 Jul 19 19:40:05.861340 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 128/264] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:05.885374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e5f5a36b-e34c-4a58-a92c-0703478b2405 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254840651_new", "availability_zone": "tempest-test_az-1664101093_new"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:05.891996 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.891996 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:05.900244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:05.918891 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07cb59e6-1a0d-4cbf-90f6-5875648cc582 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 228 microversion: 2.1 time: 0.206161 Jul 19 19:40:05.921612 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 137/265] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:05 2022] POST /compute/v2.1/os-aggregates/14/action => generated 228 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:05.940264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-161d7231-7d62-4534-b090-26823adef97c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:05.943385 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:05.943385 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:05.952658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5f5a36b-e34c-4a58-a92c-0703478b2405 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:05.952976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5f5a36b-e34c-4a58-a92c-0703478b2405 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:05.995593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-161d7231-7d62-4534-b090-26823adef97c tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.066792 Jul 19 19:40:05.996948 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 138/266] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:05 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:06.021949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84c8ee05-e973-487f-8477-d634a686eb9b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2088634338"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:06.024393 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.024393 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:06.026512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-84c8ee05-e973-487f-8477-d634a686eb9b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Generated uuid 795a4b39-aa1c-4bc3-bd54-58147c16a6a9 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:06.037288 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e5f5a36b-e34c-4a58-a92c-0703478b2405 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.167804 Jul 19 19:40:06.043722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 129/267] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 19:40:05 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:06.050435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f222e2de-1c07-4618-bbfe-412d26556062 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.052522 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.052522 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:06.063477 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f222e2de-1c07-4618-bbfe-412d26556062 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.017656 Jul 19 19:40:06.064193 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 130/268] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:40:06 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:06.077293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-654b34ca-6050-4638-92fa-d53fac7cca47 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.078660 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.078660 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:06.083778 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84c8ee05-e973-487f-8477-d634a686eb9b tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074344 Jul 19 19:40:06.090709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 139/269] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:06.106044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:06.108716 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.108716 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:06.127054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.127407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.133931 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-654b34ca-6050-4638-92fa-d53fac7cca47 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053743 Jul 19 19:40:06.138499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:06 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:06.148810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c53bc681-0b33-4c06-908f-c5b6d5c0bd6c tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105664533"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:06.149985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.150440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.155778 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.155778 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:06.158022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.aggregate [None req-c53bc681-0b33-4c06-908f-c5b6d5c0bd6c tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Generated uuid d4b5ebc3-c279-4cf8-aa74-9ba347a88cad for aggregate {{(pid=131230) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 19:40:06.182309 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.compute.aggregates [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 19:40:06.184307 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Request method failure captured: Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 42 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whbElZ7obXch2e4IVhaUMGf42wvh5m3GMguvjx_HGSGqZAK0nyKjQN703ZmgiQ2XCyQZC19g-fjnUHC0gp2SSou4AzdwxcosUne515hE9EDiUkCju22jqvdIGPjJl_ZS1OogM48xl6fFeY-asCSlqCxmPLfgnRq1yqXhhAWZoi0Ds8 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:06.187055 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5025808822894e13a3496041f9426ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5025808822894e13a3496041f9426ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5025808822894e13a3496041f9426ea6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5025808822894e13a3496041f9426ea6 Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208 Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 150ad9e54e84416e9422fb8e721f9472 Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: {"remove_host": {"host": "nonexist_host"}} Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:06.188375 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 19:40:06.189084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 19 19:40:06.190157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.193649 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Jul 19 19:40:06.196651 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.199266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:06.200384 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54c68402-aa96-4487-a14c-637ab39553d9 tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.107110 Jul 19 19:40:06.204553 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 140/271] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 19:40:06 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:06.210659 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c53bc681-0b33-4c06-908f-c5b6d5c0bd6c tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069487 Jul 19 19:40:06.212307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a85b5434-aacc-4cde-9be2-5f3d05e12aeb tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.212871 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 132/272] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 19:40:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:06.213603 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.213603 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:06.224340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a61ea68-009e-439e-a272-a9524661ce66 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.226026 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.226026 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:06.238223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a61ea68-009e-439e-a272-a9524661ce66 tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.020501 Jul 19 19:40:06.239243 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:40:06 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:06.247901 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a85b5434-aacc-4cde-9be2-5f3d05e12aeb tempest-AggregatesAdminNegativeTestJSON-1850263208 tempest-AggregatesAdminNegativeTestJSON-1850263208-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.042031 Jul 19 19:40:06.254607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3cbfe1af-5d72-48a6-b1de-8c8d0420c9dc tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.254607 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:06.254607 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:06.270675 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:06 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:06.281431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3cbfe1af-5d72-48a6-b1de-8c8d0420c9dc tempest-AggregatesAdminTestJSON-38431680 tempest-AggregatesAdminTestJSON-38431680-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034884 Jul 19 19:40:06.286288 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 134/275] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:40:06 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:06.296403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.296993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:06.307009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.307507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.308605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.309096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.334698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] HTTP exception thrown: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Request method failure captured: Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 HTTP/1.1 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whcWgRzRcMmWdMqqPEgNZZ3AbPAawXuR8gCpDye10iV5lMyPlhNZ9z3ZhFValfL29t9DaJ7hypJumAQOrur60O7jOpU0FmjFMvH3DnT_-n8FrNvd7P_43udInnBBqyrQx_SYWVgjZFEBHn-xeUmQr_lMeeX1TnVOSgdIZhBPzoz9N0 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:06.337518 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d8b7bf8b38cc4511adc0923410b02d3d Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.339016 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0962b8af-0f27-411e-a220-45ca41f51493'} Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:06.339861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.341125 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.342820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Returning 404 to user: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:06.342820 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-34c80c33-f390-4106-8cd9-2178fb74cb4b tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 404 len: 111 microversion: 2.1 time: 0.053010 Jul 19 19:40:06.342820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 142/276] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:06 2022] DELETE /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:06.355330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.356305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] [instance: 0962b8af-0f27-411e-a220-45ca41f51493] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:06.371470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.371470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.373377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.373833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.406874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] HTTP exception thrown: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Request method failure captured: Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 HTTP/1.1 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whcWgRzRcMmWdMqqPEgNZZ3AbPAawXuR8gCpDye10iV5lMyPlhNZ9z3ZhFValfL29t9DaJ7hypJumAQOrur60O7jOpU0FmjFMvH3DnT_-n8FrNvd7P_43udInnBBqyrQx_SYWVgjZFEBHn-xeUmQr_lMeeX1TnVOSgdIZhBPzoz9N0 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:40:06.413941 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c418f69e6aed48fdb23e24686b09ce69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c418f69e6aed48fdb23e24686b09ce69 Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-805064892 Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d8b7bf8b38cc4511adc0923410b02d3d Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AggregatesAdminTestJSON-805064892-project Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.415305 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0962b8af-0f27-411e-a220-45ca41f51493'} Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:06.416083 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. Jul 19 19:40:06.417332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:06.419131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] Returning 404 to user: Instance 0962b8af-0f27-411e-a220-45ca41f51493 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:06.423880 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8e2b266-958f-4e3d-8571-3804ddda7cac tempest-AggregatesAdminTestJSON-805064892 tempest-AggregatesAdminTestJSON-805064892-project] 10.222.0.23 "GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493" status: 404 len: 111 microversion: 2.1 time: 0.073928 Jul 19 19:40:06.428495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 135/277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:06 2022] GET /compute/v2.1/servers/0962b8af-0f27-411e-a220-45ca41f51493 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:06.533384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.534223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:06.542399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.546185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.547730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.550183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.913190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2018852174", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "e1fb5a5d-f185-4eab-959a-40101db7e714"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:06.931476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:06.943854 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb571902-b8c0-4c22-9dfb-cdfa36ba5ded tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.415040 Jul 19 19:40:06.947772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 136/278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:06 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:06.970828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:06.974185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:06.997342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.997949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:06.998777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:06.999240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:07.062292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] validate_networks() for [('e1fb5a5d-f185-4eab-959a-40101db7e714', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:07.418308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:07.426367 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d807bae-fd56-4b19-941c-d168561105fd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.469961 Jul 19 19:40:07.427161 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 137/279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:06 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:07.966450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:07.967206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:07.980066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:07.983947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:07.986153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:07.987768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:08.756465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:08.768249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72391116-894a-4475-8064-fe35709b3e46 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.806089 Jul 19 19:40:08.769447 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 138/280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:07 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:08.782304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:08.784132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:08.798242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:08.807668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:08.808921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:08.809587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:08.919063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:08.920834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:08.921602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:08.922347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:08.923241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:08.941630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:08.945430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:08.951264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:08.953266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:08.987045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:08.994651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for user df971d67f21747f2afa56647d78a7fa5 and project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:09.010624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:09.013878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:09.164654 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65cc39a9-143d-4fe0-a045-1ccb1375281b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.690367 Jul 19 19:40:09.171729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 143/281] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:40:09.226537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:09.228752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:09.893566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:09.896629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:09.905970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d016a877-446e-4e58-97a5-fce8ac44c8e3 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 1.129561 Jul 19 19:40:09.910621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:08 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:09.922793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-dab5547b-1e1b-458a-815f-1140a01129a6 req-22947018-2bec-439a-b5cd-d67dddc80f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200c5698-0752-4fcd-adf7-80faef3e88f4", "tag": "6823b436-0731-475e-94b7-324ea5a00ffd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:09.926383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:09.938766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:09.948016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dab5547b-1e1b-458a-815f-1140a01129a6 req-22947018-2bec-439a-b5cd-d67dddc80f89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:09.949356 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e87c4ca3-a12c-4c82-8088-3b974af90c57 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1262 microversion: 2.25 time: 0.766099 Jul 19 19:40:09.951687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 144/283] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:09 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1262 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:09.952312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dab5547b-1e1b-458a-815f-1140a01129a6 req-22947018-2bec-439a-b5cd-d67dddc80f89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:09.956964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:09.967162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:09.981420 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-dab5547b-1e1b-458a-815f-1140a01129a6 req-22947018-2bec-439a-b5cd-d67dddc80f89 service nova] Creating event network-changed:6823b436-0731-475e-94b7-324ea5a00ffd for instance 200c5698-0752-4fcd-adf7-80faef3e88f4 on n-h2-843834-3 Jul 19 19:40:09.988009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:09.988434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:09.989241 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-dab5547b-1e1b-458a-815f-1140a01129a6 req-22947018-2bec-439a-b5cd-d67dddc80f89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077019 Jul 19 19:40:09.990055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 140/284] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:09.996401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:09.996849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:10.048940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:10.348996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:10.361332 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d2509a7-b5ab-48a4-8d2c-ae08c8273d91 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.408182 Jul 19 19:40:10.362299 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 145/285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:09 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:10.927783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:10.929260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:10.943776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:10.944725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:10.945607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:10.946050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:10.980234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:10.981659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:10.995158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:10.995631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:10.996517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:10.996944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:11.102990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:11.121141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:11.122818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:11.124582 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-377adb2c-1c79-41ed-b5fb-592bb9aae75f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1332 microversion: 2.25 time: 0.149808 Jul 19 19:40:11.126021 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 146/286] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:10 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:11.244662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:11.257239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-521f3a3b-b741-49eb-adad-4f81f488328e tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.334018 Jul 19 19:40:11.259766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 141/287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:10 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:11.381838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:11.383734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:11.392088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:11.392542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:11.393318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:11.394046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:11.738544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:11.756215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04697ab3-08b7-4d4a-bfe0-8c7e074b5683 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.381030 Jul 19 19:40:11.757366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 147/288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:11 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:12.144210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:12.144812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:12.154062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.154506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:12.157027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.157484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:12.277163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:12.277788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:12.283872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.284370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:12.285395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.285975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:12.650399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:12.661063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:12.662862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:12.664640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-931b7cb5-10f4-4c39-ab81-00f7922999b7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.524359 Jul 19 19:40:12.665713 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 142/289] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:12 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:12.705513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:12.716088 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-768fb887-53cc-4493-915f-5eef043e18bd tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.443650 Jul 19 19:40:12.717367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 148/290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:12 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:12.773957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:12.774435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:12.786110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.786967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:12.787403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:12.788958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.024782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.026349 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:13.026349 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:13.027616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.028074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.028880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.031324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.047995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:13.065065 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28c4f557-6281-406d-a3bf-22c193709e05 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.377085 Jul 19 19:40:13.073005 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:40:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:13.083585 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95adc7b4-ec63-4198-abd9-ef656ea3e444 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.314023 Jul 19 19:40:13.085711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.087331 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:13.087331 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:13.090146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.090955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.092190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.095996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.096849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:12 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:40:13.133621 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-79c8c249-6016-4ae2-bebf-f52f73f20855 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-843834-3" status: 200 len: 578 microversion: 2.1 time: 0.059166 Jul 19 19:40:13.145688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 144/293] 10.222.0.23 () {58 vars in 1171 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/os-services?host=n-d-843834-3 => generated 578 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:13.155697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.158279 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:13.158279 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:13.160652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.161323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.162334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.163015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.219370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07cb8a46-6f28-48fc-9cdf-152abdcf9c3a tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072440 Jul 19 19:40:13.222365 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 150/294] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:13.234444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.237641 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:13.237641 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:13.239439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.240118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.241309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.241992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.277277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e65bd4a-f03c-4ff8-8cf3-a8e63b158d21 tempest-ServicesAdminTestJSON-2029390312 tempest-ServicesAdminTestJSON-2029390312-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047685 Jul 19 19:40:13.278884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:13.306436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3f7bca91-2570-4ed3-a650-4ffd20f5e7c4 req-e86e8c80-45ad-41be-913e-f1daa4514c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:13.328355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3f7bca91-2570-4ed3-a650-4ffd20f5e7c4 req-e86e8c80-45ad-41be-913e-f1daa4514c0b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.330112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3f7bca91-2570-4ed3-a650-4ffd20f5e7c4 req-e86e8c80-45ad-41be-913e-f1daa4514c0b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.353370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3f7bca91-2570-4ed3-a650-4ffd20f5e7c4 req-e86e8c80-45ad-41be-913e-f1daa4514c0b service nova] Creating event network-changed:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h1-843834-3 Jul 19 19:40:13.359111 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3f7bca91-2570-4ed3-a650-4ffd20f5e7c4 req-e86e8c80-45ad-41be-913e-f1daa4514c0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062098 Jul 19 19:40:13.360444 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 151/296] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:13.501467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:13.698515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.700249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.700766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.701626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.702124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.734003 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71cb7ad8-82a2-429f-8f4f-c2facda61cca tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.397960 Jul 19 19:40:13.740314 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 146/297] 10.222.0.23 () {58 vars in 1163 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:40:13.746037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.747006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:13.754858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.755761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.756742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.757403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.897811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-542efc0c-b751-4a9c-a0d2-681a2d02d109 tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-397384473", "id": 111068661, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:13.900222 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:13.900222 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:13.903525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:13.921030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-542efc0c-b751-4a9c-a0d2-681a2d02d109 tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.434271 Jul 19 19:40:13.921639 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 152/298] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:40:13 2022] POST /compute/v2.1/flavors => generated 464 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:40:13.932231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:13.932949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:13.939391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.939835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:13.940602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:13.941029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:14.261697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.263631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.272827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.273063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b06afe13-6da3-4913-95ae-42d3e1134fb7 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.350211 Jul 19 19:40:14.273822 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 153/299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:14.275767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.277241 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-afe68454-7f5b-4e3e-ae49-961c77c04bb8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.535692 Jul 19 19:40:14.278292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 147/300] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:13 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:14.278639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.279726 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:14.279726 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:14.281083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:14.281667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:14.282583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:14.283218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:14.311242 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-450decbb-aec0-4552-a2a4-3326fd2111f3 tempest-AZAdminV2TestJSON-440127158 tempest-AZAdminV2TestJSON-440127158-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.036242 Jul 19 19:40:14.314943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 154/301] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:14.421985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b8ad6c8-a1ac-4670-b3ab-08012ef49dcb tempest-AZAdminNegativeTestJSON-2143226733 tempest-AZAdminNegativeTestJSON-2143226733-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.422844 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:14.422844 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:14.424112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7b8ad6c8-a1ac-4670-b3ab-08012ef49dcb tempest-AZAdminNegativeTestJSON-2143226733 tempest-AZAdminNegativeTestJSON-2143226733-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '240a713e8a314358ab6ad76993e6f909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85e9d94646a4d45916c880de4ce94a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b8ad6c8-a1ac-4670-b3ab-08012ef49dcb tempest-AZAdminNegativeTestJSON-2143226733 tempest-AZAdminNegativeTestJSON-2143226733-project] Request method failure captured: Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wib_ahGfueeIONGEVIZKspBDGmH5SUFnRmHBZPGTeQjD1CKoFvHmkC8IMNbY1eI-hIVcu6IskzgCLViaw78QGIRjCv0Ie8nbqlBfrc0rlhC6dui_m3L6FJasBy32KU1aZ_Xfesu53IQZs_9mSXT5wMl15y3xKtixvDDKcVdT_DZWrk Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b85e9d94646a4d45916c880de4ce94a3 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2143226733 Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:40:14.426351 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b85e9d94646a4d45916c880de4ce94a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b85e9d94646a4d45916c880de4ce94a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b85e9d94646a4d45916c880de4ce94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b85e9d94646a4d45916c880de4ce94a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AZAdminNegativeTestJSON-2143226733 Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b85e9d94646a4d45916c880de4ce94a3 Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2143226733 Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AZAdminNegativeTestJSON-2143226733-project Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 240a713e8a314358ab6ad76993e6f909 Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AZAdminNegativeTestJSON-2143226733-project Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:40:14.427824 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:14.428718 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:14.430290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b8ad6c8-a1ac-4670-b3ab-08012ef49dcb tempest-AZAdminNegativeTestJSON-2143226733 tempest-AZAdminNegativeTestJSON-2143226733-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:14.431722 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7b8ad6c8-a1ac-4670-b3ab-08012ef49dcb tempest-AZAdminNegativeTestJSON-2143226733 tempest-AZAdminNegativeTestJSON-2143226733-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.149346 Jul 19 19:40:14.431722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 148/302] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 152 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:14.436334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.437036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:14.444628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:14.445324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:14.446083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:14.446674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:14.580951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:14.589067 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-59eee363-bb97-40b1-b237-ac889059ded8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.156379 Jul 19 19:40:14.592051 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 149/303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:14.612417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac126098-6616-4146-972b-6bfb39638203 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.630718 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac126098-6616-4146-972b-6bfb39638203 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] 10.222.0.23 "GET /compute/v2.1/flavors/111068661" status: 200 len: 464 microversion: 2.61 time: 0.316524 Jul 19 19:40:14.633080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 155/304] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/flavors/111068661 => generated 464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:14.643434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad1012dc-009d-46a7-bba6-bee09f5bad56 tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] Action: 'update', calling method: .version_select at 0x7f23fe5dc3a0>, body: {"flavor": {"description": "new"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:14.654540 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:14.654540 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:14.688879 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad1012dc-009d-46a7-bba6-bee09f5bad56 tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/111068661" status: 200 len: 465 microversion: 2.61 time: 0.049000 Jul 19 19:40:14.690678 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 150/305] 10.222.0.23 () {62 vars in 1215 bytes} [Tue Jul 19 19:40:14 2022] PUT /compute/v2.1/flavors/111068661 => generated 465 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:14.703825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76a41bd3-edd9-4c19-ba4e-229e9d414401 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.739471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76a41bd3-edd9-4c19-ba4e-229e9d414401 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.041292 Jul 19 19:40:14.741282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 156/306] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:40:14.762721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4dafed8a-05eb-4f3a-8aa0-26a24a01b5d8 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.802878 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4dafed8a-05eb-4f3a-8aa0-26a24a01b5d8 tempest-FlavorsV261TestJSON-753554534 tempest-FlavorsV261TestJSON-753554534-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.047147 Jul 19 19:40:14.803882 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 151/307] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:14.821207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68f81199-536f-4fa7-8fd1-75127c67f4ad tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.829218 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:14.829218 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:14.857688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68f81199-536f-4fa7-8fd1-75127c67f4ad tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/111068661" status: 202 len: 0 microversion: 2.61 time: 0.043206 Jul 19 19:40:14.859394 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 157/308] 10.222.0.23 () {60 vars in 1198 bytes} [Tue Jul 19 19:40:14 2022] DELETE /compute/v2.1/flavors/111068661 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:14.868057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2db4410e-fba4-414f-b5b2-d132bccf89fe tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:14.912807 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2db4410e-fba4-414f-b5b2-d132bccf89fe tempest-FlavorsV261TestJSON-586443244 tempest-FlavorsV261TestJSON-586443244-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6701 microversion: 2.61 time: 0.048928 Jul 19 19:40:14.915181 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 152/309] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:14 2022] GET /compute/v2.1/flavors/detail => generated 6701 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:40:15.301944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:15.303266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:15.304564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:15.306418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:15.343686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.345070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.345531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:15.347117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:15.350678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.351148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:15.352152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.354730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:15.715803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:15.725747 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0196db02-5277-4565-bbc4-3e1574454494 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.438784 Jul 19 19:40:15.727171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 158/310] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:15 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:15.728424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:15.733115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:15.733959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:15.739441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:15.741120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:15.742713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.743536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:15.744174 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f2e35e7-5e5e-4b57-a228-817b15ac15b2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.452556 Jul 19 19:40:15.744752 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 153/311] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:15 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:15.745087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:15.745917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:16.107750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:16.117610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc98b823-f716-4cf4-aa0f-33db4bb2bebf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.389096 Jul 19 19:40:16.128154 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 159/312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:15 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:16.743250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:16.743863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:16.755170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:16.755557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:16.762395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:16.762558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:16.763265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:16.764428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:16.774358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:16.775482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:16.777236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:16.778768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:17.133644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:17.151951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:17.158774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:17.161045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:17.163058 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3a038716-c8a3-499b-a3c9-ad9e3ae58d4d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.405013 Jul 19 19:40:17.164273 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 160/313] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:16 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:17.174593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cb7c2ec-3de2-4440-8d31-58e9658c50a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.435249 Jul 19 19:40:17.184266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 154/314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:16 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:17.191654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-36a7a411-78ab-4d09-a683-450ffeb8fc97 req-a1077907-9f11-4690-9549-45a89be5038d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200c5698-0752-4fcd-adf7-80faef3e88f4", "name": "network-vif-plugged", "status": "completed", "tag": "6823b436-0731-475e-94b7-324ea5a00ffd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:17.203243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-36a7a411-78ab-4d09-a683-450ffeb8fc97 req-a1077907-9f11-4690-9549-45a89be5038d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:17.204097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-36a7a411-78ab-4d09-a683-450ffeb8fc97 req-a1077907-9f11-4690-9549-45a89be5038d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:17.224660 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-36a7a411-78ab-4d09-a683-450ffeb8fc97 req-a1077907-9f11-4690-9549-45a89be5038d service nova] Creating event network-vif-plugged:6823b436-0731-475e-94b7-324ea5a00ffd for instance 200c5698-0752-4fcd-adf7-80faef3e88f4 on n-h2-843834-3 Jul 19 19:40:17.232864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-36a7a411-78ab-4d09-a683-450ffeb8fc97 req-a1077907-9f11-4690-9549-45a89be5038d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045479 Jul 19 19:40:17.233979 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 155/315] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:17.253378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:17.254113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:17.265003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:17.265976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:17.267579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:17.268339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:17.407220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-558c408e-1369-414c-af4c-ca7024eda2bb tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:17.421642 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-558c408e-1369-414c-af4c-ca7024eda2bb tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.252415 Jul 19 19:40:17.422291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 161/316] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:40:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:17.540668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:17.544949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:17.552421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bcdd059c-83af-4875-ae33-918e52957a3e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.316355 Jul 19 19:40:17.555177 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 156/317] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:17 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:18.181694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:18.182434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:18.190077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.190682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.191567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.192217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:18.192975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.193166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:18.200245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.200758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.201481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.201921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.414196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:18.423610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:18.425370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:18.426656 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50249327-9cd9-4892-8dd8-7092596ff530 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.249006 Jul 19 19:40:18.430227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 162/318] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:18 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:18.432246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:18.435619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-49893415", "imageRef": "25ba460a-1f9d-4e3a-ad49-47fc85359808", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:18.443805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5dc194f-0e00-4cae-8c7b-432469593d61 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1319 microversion: 2.1 time: 0.255725 Jul 19 19:40:18.444386 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 157/319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:18 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:18.510795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:18.576779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:18.578171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:18.585873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.586683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.588054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:18.588993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:18.843232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:18.851468 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22f9b00c-c695-473a-a090-fdd8a41e3a81 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.282643 Jul 19 19:40:18.852041 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:18 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] Request method failure captured: Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 141 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wigT-Oqo1M9C_Nmq3GTm52gRpfW8XN8wFrQA5dIl8d-OXQPvi40u0oSKAU4e0wjEFx0k6lkYbNQ958yIiwyclnI7d08sHI5QgtDHmHNDnDYG4T-wAUt4VV2OqTt6lx14ghbUNIesKtqSHUeXSqMragxmB_h3YASLPsyDdkJuYvkzDs Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: fb386d6f56114fd1beacee2471802779 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsV2NegativeTest-1598560862 Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:18.870353 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb386d6f56114fd1beacee2471802779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb386d6f56114fd1beacee2471802779"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb386d6f56114fd1beacee2471802779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb386d6f56114fd1beacee2471802779"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsV2NegativeTest-1598560862 Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: fb386d6f56114fd1beacee2471802779 Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1598560862 Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsV2NegativeTest-1598560862-project Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 4560e2e110704f6f901913bacf2b587d Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsV2NegativeTest-1598560862-project Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-49893415", "imageRef": "25ba460a-1f9d-4e3a-ad49-47fc85359808", "flavorRef": "452"}} Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:18.871915 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor's memory is too small for requested image. Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-49893415', 'imageRef': '25ba460a-1f9d-4e3a-ad49-47fc85359808', 'flavorRef': '452'}}} Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:18.872707 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:18.874003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f82b29a0-00e4-4f71-b883-7480bdbae5aa tempest-FlavorsV2NegativeTest-1598560862 tempest-FlavorsV2NegativeTest-1598560862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.440299 Jul 19 19:40:18.875729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 163/321] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:18 2022] POST /compute/v2.1/servers => generated 93 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:40:19.448511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:19.449387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:19.461803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:19.462418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:19.477049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:19.477494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:19.478312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:19.478748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:19.481105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:19.483824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:19.484726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:19.485261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:19.714712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:19.728792 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebeb1b38-050b-49d4-8ad8-17f05067d9ec tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1468 microversion: 2.1 time: 0.271309 Jul 19 19:40:19.730407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 164/322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:19 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1468 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:19.737322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-fb3eda60-5fb8-4fa1-8085-95167ac69c62 req-a4f9e9cd-1d84-4bf8-ac68-e041f23a3670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "name": "network-vif-plugged", "status": "completed", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:19.738263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:19.748187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:19.748433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fb3eda60-5fb8-4fa1-8085-95167ac69c62 req-a4f9e9cd-1d84-4bf8-ac68-e041f23a3670 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:19.748898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fb3eda60-5fb8-4fa1-8085-95167ac69c62 req-a4f9e9cd-1d84-4bf8-ac68-e041f23a3670 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:19.749787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:19.750967 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-493357ee-fd6e-4af1-b8e3-fe5ae3a951ba tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.306454 Jul 19 19:40:19.751709 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 159/323] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:19 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:19.769159 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-fb3eda60-5fb8-4fa1-8085-95167ac69c62 req-a4f9e9cd-1d84-4bf8-ac68-e041f23a3670 service nova] Creating event network-vif-plugged:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h1-843834-3 Jul 19 19:40:19.776332 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-fb3eda60-5fb8-4fa1-8085-95167ac69c62 req-a4f9e9cd-1d84-4bf8-ac68-e041f23a3670 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044091 Jul 19 19:40:19.777979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 165/324] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:19.904585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:20.142559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-306119049", "block_migration": true, "disk_over_commit": false}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.144209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:20.151607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.152062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.152842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.153278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.179724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e25c970-caa3-48fa-a606-e0e9ebb5c030 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1233513186", "ram": 512, "vcpus": 1, "disk": 10, "id": 751338982, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.183825 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.183825 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:20.204866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e25c970-caa3-48fa-a606-e0e9ebb5c030 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.348588 Jul 19 19:40:20.206782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 166/325] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:19 2022] POST /compute/v2.1/flavors => generated 413 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:20.214130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.215386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:20.219923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lazy-loading 'flavor' on Instance uuid 200c5698-0752-4fcd-adf7-80faef3e88f4 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:20.223777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.224625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.225660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.226397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.271503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Going to try to live migrate instance to tempest-host-306119049 {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:40:20.279034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] HTTP exception thrown: Compute host tempest-host-306119049 could not be found. Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Request method failure captured: Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4/action HTTP/1.1 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 106 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wiSd5D3qtjksln6F9rxDiRFjwI056gyLdhrUMMkRyKdc3wZZDRdhCYgivWt517tU3rcDawXYL-ZAkd7Op8B03hfYxS_eYP0yt7Wnx73jZB3BWm1tYSgBiilpi1-Sga3vI6HWvrXPpvhIfOD3zStq9SrfhhCAEUJWibGXFB2a4uzEFw Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: af9144a21cfd4d2e8de464929fbcf2b3 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:40:20.283310 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: af9144a21cfd4d2e8de464929fbcf2b3 Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-LiveMigrationNegativeTest-1087640236-project-admin Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d75cd0f0c6c54ad6895b43bbc4b54407 Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-LiveMigrationNegativeTest-1087640236-project-admin Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: {"os-migrateLive": {"host": "tempest-host-306119049", "block_migration": true, "disk_over_commit": false}} Jul 19 19:40:20.284692 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: exception: Compute host tempest-host-306119049 could not be found. Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '200c5698-0752-4fcd-adf7-80faef3e88f4', 'body': {'os-migrateLive': {'host': 'tempest-host-306119049', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:20.285506 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-306119049 could not be found. Jul 19 19:40:20.286754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-306119049 could not be found. Jul 19 19:40:20.288174 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-306119049 could not be found. Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:20.289538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Returning 400 to user: Compute host tempest-host-306119049 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:20.290251 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-055045f9-cfdb-4510-ba90-8e858e1f10c7 tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4/action" status: 400 len: 99 microversion: 2.1 time: 0.535418 Jul 19 19:40:20.293646 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 160/326] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Jul 19 19:40:19 2022] POST /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4/action => generated 99 bytes in 539 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:40:20.387946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:20.395967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b6011f8-e2d9-478d-b981-4b5a834bf9b7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.187917 Jul 19 19:40:20.397042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 167/327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:20.410036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9613ebc8-5a7f-4bbc-9928-25bb2bda93dd tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.411799 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.411799 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:20.434045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-233394bf-4f93-4423-8f61-6f6b4fd0f35b tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-654574286", "id": 1484331225, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.435918 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.435918 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:20.438818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9613ebc8-5a7f-4bbc-9928-25bb2bda93dd tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040243 Jul 19 19:40:20.444374 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 168/328] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:40:20 2022] POST /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:20.457203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-233394bf-4f93-4423-8f61-6f6b4fd0f35b tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.165267 Jul 19 19:40:20.457808 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 161/329] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:20 2022] POST /compute/v2.1/flavors => generated 429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:20.478254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.479040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:20.488117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.488942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.490321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.491089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.502931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Calling method '.version_select at 0x7f23fc2599d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.504372 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.504372 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:20.505806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.506429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.523557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.524002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.545921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.546389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.557851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.558300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.579862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.580324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.587339 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-732ee281-1921-47cd-b88a-0113c6efdbce tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.146374 Jul 19 19:40:20.587911 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 169/330] 10.222.0.23 () {60 vars in 1242 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:20.668979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:20.677775 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b40dade-6a55-4311-b338-7183e73058db tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1468 microversion: 2.1 time: 0.212348 Jul 19 19:40:20.678344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 162/331] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:20.700166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d0805fb-4024-449a-a26a-7a1c08d1a4e7 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.701124 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.701124 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:20.708421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:20.717576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8deec5c2-a871-42e1-aac8-d460caa11218 tempest-FlavorsExtraSpecsTestJSON-792155381 tempest-FlavorsExtraSpecsTestJSON-792155381-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.723243 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d0805fb-4024-449a-a26a-7a1c08d1a4e7 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1484331225" status: 202 len: 0 microversion: 2.1 time: 0.025673 Jul 19 19:40:20.724458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:20 2022] DELETE /compute/v2.1/flavors/1484331225 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:20.732563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Calling method '.version_select at 0x7f23fc030e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.733358 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.733358 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:20.734623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.735102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.736268 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8deec5c2-a871-42e1-aac8-d460caa11218 tempest-FlavorsExtraSpecsTestJSON-792155381 tempest-FlavorsExtraSpecsTestJSON-792155381-project] 10.222.0.23 "GET /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.147350 Jul 19 19:40:20.739477 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 170/333] 10.222.0.23 () {58 vars in 1199 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:20.746905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ff9f505-04af-47f8-926e-1eb57eb95710 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.759136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.759620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.768709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ff9f505-04af-47f8-926e-1eb57eb95710 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.027276 Jul 19 19:40:20.769564 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 171/334] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:20.785864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d1839c57-1dd7-4f48-a833-711062f5b97f tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.787529 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.787529 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:20.795307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.795835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.812704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.813175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.813940 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d1839c57-1dd7-4f48-a833-711062f5b97f tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031694 Jul 19 19:40:20.815026 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 172/335] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:40:20 2022] POST /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:20.821533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.822184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:20.828498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.828953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.829735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.830170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.851235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:20.851753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:20.858776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98b2a7de-7ddc-4af8-8af4-649e126179fc tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.132710 Jul 19 19:40:20.859318 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 164/336] 10.222.0.23 () {60 vars in 1221 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:20.864533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44d744ad-6569-4a26-9545-0953d9906b79 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1710411998", "id": 363549366, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.866356 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:20.866356 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:20.882809 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44d744ad-6569-4a26-9545-0953d9906b79 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022369 Jul 19 19:40:20.883475 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 165/337] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:20 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:20.888314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e8fe376-f45a-4200-8f33-2dfb20598348 tempest-FlavorsExtraSpecsTestJSON-792155381 tempest-FlavorsExtraSpecsTestJSON-792155381-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:20.898477 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e8fe376-f45a-4200-8f33-2dfb20598348 tempest-FlavorsExtraSpecsTestJSON-792155381 tempest-FlavorsExtraSpecsTestJSON-792155381-project] 10.222.0.23 "GET /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013863 Jul 19 19:40:20.899474 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes => generated 22 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:20.905276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1450786117", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:20.962477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:21.011248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:21.028619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:21.030126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:21.031318 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed534f87-6335-48cd-9277-f934a834de75 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1362 microversion: 2.25 time: 0.214940 Jul 19 19:40:21.031873 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 173/339] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:20 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:21.036386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Calling method '.version_select at 0x7f23fc1ee280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.037699 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.037699 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.039128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.039815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.042159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:21.057677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.058228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.064695 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-863c1857-3754-4bda-89b1-fed493b7172b tempest-HypervisorAdminV253TestBase-1615760980 tempest-HypervisorAdminV253TestBase-1615760980-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/db9a3357-4a73-4311-8a7b-47071f5b2a01" status: 200 len: 792 microversion: 2.53 time: 0.031616 Jul 19 19:40:21.065538 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 174/340] 10.222.0.23 () {60 vars in 1297 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/os-hypervisors/db9a3357-4a73-4311-8a7b-47071f5b2a01 => generated 792 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:21.070852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b0a8ad9-beeb-43cd-aff0-95a2efdbeb9e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.092830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b0a8ad9-beeb-43cd-aff0-95a2efdbeb9e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6628 microversion: 2.1 time: 0.025980 Jul 19 19:40:21.093837 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 175/341] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 6628 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.117161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c042093a-b975-495a-a787-5d43bf1e6fc7 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:21.119293 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.119293 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.155705 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c042093a-b975-495a-a787-5d43bf1e6fc7 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060400 Jul 19 19:40:21.156659 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 176/342] 10.222.0.23 () {60 vars in 1220 bytes} [Tue Jul 19 19:40:21 2022] POST /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:21.162423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6963b8c-9736-41f0-8db6-c3730d27e5f4 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.163587 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.163587 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.199292 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6963b8c-9736-41f0-8db6-c3730d27e5f4 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/363549366" status: 202 len: 0 microversion: 2.1 time: 0.027636 Jul 19 19:40:21.201818 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 177/343] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/363549366 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:21.210335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1df2e45-1f73-4815-b189-b40968ff9150 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.218428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=78,nova_api:DELETE=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:21.223860 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1df2e45-1f73-4815-b189-b40968ff9150 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020606 Jul 19 19:40:21.224440 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 178/344] 10.222.0.23 () {58 vars in 1199 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:21.229163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb3be438-abb0-4981-9028-84bec6ff31f2 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.250980 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb3be438-abb0-4981-9028-84bec6ff31f2 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.025424 Jul 19 19:40:21.255592 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 179/345] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.261708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67afa2af-9099-4b41-a0c0-0ec3ebe2ec3e tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:21.263909 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.263909 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.278245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:21.278672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:21.279156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:21.279877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:21.280557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:21.293240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.293799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.294640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.295108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.300679 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67afa2af-9099-4b41-a0c0-0ec3ebe2ec3e tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.047981 Jul 19 19:40:21.305551 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 180/346] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:40:21 2022] PUT /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:21.309705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-38b68b9b-6aac-4f3c-a8d3-d8eb76fd3d5a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-751536557", "id": 1676302830, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:21.310831 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.310831 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.315225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Getting quotas for project 4601171dbe70469f92c46321f5bc303d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:21.320590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Getting quotas for user b6cf07e85a804d64be9ec9817cdbba00 and project 4601171dbe70469f92c46321f5bc303d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:21.330381 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-38b68b9b-6aac-4f3c-a8d3-d8eb76fd3d5a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.027163 Jul 19 19:40:21.331825 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 181/347] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:21 2022] POST /compute/v2.1/flavors => generated 428 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:21.333662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:21.336249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:21.338433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5841f628-611b-47c8-af96-25476accd197 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.350873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5841f628-611b-47c8-af96-25476accd197 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017416 Jul 19 19:40:21.351853 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 182/348] 10.222.0.23 () {58 vars in 1199 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/751338982/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:21.360054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c014aeed-dbd1-44f0-b640-a3e6c3d89b96 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.382481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c014aeed-dbd1-44f0-b640-a3e6c3d89b96 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1676302830" status: 202 len: 0 microversion: 2.1 time: 0.028785 Jul 19 19:40:21.383299 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 183/349] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/1676302830 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:21.388573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f915ea8f-c889-4b16-9991-a899b89c6ba1 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.389860 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.389860 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.407419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb6631a1-f16c-4a5b-a9f3-9813cce37f98 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506625 Jul 19 19:40:21.413399 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 167/350] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:40:21.420485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-635f2d72-3340-4c8d-a825-36192708e598 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.429680 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f915ea8f-c889-4b16-9991-a899b89c6ba1 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045077 Jul 19 19:40:21.430269 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 184/351] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/751338982/os-extra_specs/hw:numa_nodes => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:21.436196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.436811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:21.444910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.445419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.446356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:21.446755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:21.495352 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-635f2d72-3340-4c8d-a825-36192708e598 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.080453 Jul 19 19:40:21.497757 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 168/352] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.502834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32594365-38e3-4fa4-88b0-82f2bc807417 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.503606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-32594365-38e3-4fa4-88b0-82f2bc807417 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:21.617995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-32594365-38e3-4fa4-88b0-82f2bc807417 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:21.629534 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-32594365-38e3-4fa4-88b0-82f2bc807417 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1219 microversion: 2.1 time: 0.129914 Jul 19 19:40:21.630523 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 169/353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.635792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27ebe05f-d649-4df9-9001-a622e5e35434 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.636652 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.636652 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:21.659868 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27ebe05f-d649-4df9-9001-a622e5e35434 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/751338982/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027788 Jul 19 19:40:21.661083 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 170/354] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/751338982/os-extra_specs/hw:cpu_policy => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 19:40:21.668110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ddc4c1c-0dfe-47ce-8886-f5042bed6eee tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-486995514", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:21.669975 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.669975 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:21.692980 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ddc4c1c-0dfe-47ce-8886-f5042bed6eee tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029011 Jul 19 19:40:21.694420 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 171/355] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:21.695146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:21.702028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c779f99-656b-4869-bd7d-008d80c34d0f tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.706206 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36d6e64a-2915-47bb-b7a7-2274c967047a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.274043 Jul 19 19:40:21.706788 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 185/356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.717531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d71194f-0e7f-4406-92c8-aca376e9a1ff tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.718296 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.718296 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:21.733864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c779f99-656b-4869-bd7d-008d80c34d0f tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/751338982/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036362 Jul 19 19:40:21.736015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 172/357] 10.222.0.23 () {58 vars in 1199 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/751338982/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:21.749859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2418ce7-14fe-476c-a186-f0d84fc147c4 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.751754 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:21.751754 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:21.767950 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d71194f-0e7f-4406-92c8-aca376e9a1ff tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/a92b1977-346e-4a2a-9fbe-6d6046765ba5" status: 202 len: 0 microversion: 2.1 time: 0.059867 Jul 19 19:40:21.772516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2418ce7-14fe-476c-a186-f0d84fc147c4 tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/751338982" status: 202 len: 0 microversion: 2.1 time: 0.028531 Jul 19 19:40:21.772670 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 186/358] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/a92b1977-346e-4a2a-9fbe-6d6046765ba5 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:21.773672 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 173/359] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/751338982 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:40:21.777626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebf2f4ca-3e08-4c6c-a552-38f087b5446a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.781372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-559ba992-169c-4188-9c8b-3e5a16df22af tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.801740 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-559ba992-169c-4188-9c8b-3e5a16df22af tempest-FlavorsExtraSpecsTestJSON-10391632 tempest-FlavorsExtraSpecsTestJSON-10391632-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.023935 Jul 19 19:40:21.802405 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 174/360] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.841946 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebf2f4ca-3e08-4c6c-a552-38f087b5446a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.067855 Jul 19 19:40:21.853693 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 187/361] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:21.858508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9502740-db8e-4383-b7f4-23ef879a52c1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1085336227", "id": "8fd449c4-c816-4fd8-96ae-54a76aa2f284", "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:21.889947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9502740-db8e-4383-b7f4-23ef879a52c1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035111 Jul 19 19:40:21.890620 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 175/362] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:21 2022] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:21.902047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-666c134c-73bd-4571-a71f-079ef5c3c85c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.945711 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-666c134c-73bd-4571-a71f-079ef5c3c85c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/8fd449c4-c816-4fd8-96ae-54a76aa2f284" status: 202 len: 0 microversion: 2.1 time: 0.047628 Jul 19 19:40:21.946556 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 188/363] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:21 2022] DELETE /compute/v2.1/flavors/8fd449c4-c816-4fd8-96ae-54a76aa2f284 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:21.955536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e5be4c9-f054-47a1-b4d9-c7d728c48ee1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:21.993426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e5be4c9-f054-47a1-b4d9-c7d728c48ee1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.041869 Jul 19 19:40:21.994488 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 176/364] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:21 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:22.010752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fb70d80c-64d5-4af2-8d58-abf0c2552356 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-77241534", "id": 1271688151, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:22.012714 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:22.012714 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:22.049906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.051023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:22.058670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fb70d80c-64d5-4af2-8d58-abf0c2552356 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.051820 Jul 19 19:40:22.069955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.071193 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 189/365] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:22 2022] POST /compute/v2.1/flavors => generated 412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:22.071974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.072984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.075013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.087941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab463a08-1c80-4234-90f7-3c17c6179449 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.103719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab463a08-1c80-4234-90f7-3c17c6179449 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1271688151" status: 200 len: 412 microversion: 2.1 time: 0.025947 Jul 19 19:40:22.110572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 190/366] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/flavors/1271688151 => generated 412 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:22.305912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:22.316997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:22.319119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:22.320394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0aa7cb98-be0e-482b-997b-efb6e3375d36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1557 microversion: 2.25 time: 0.274769 Jul 19 19:40:22.321481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 177/367] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1557 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:22.535946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-552f4280-0001-4b44-b7a0-ee79c01c8e35 tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.567358 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-552f4280-0001-4b44-b7a0-ee79c01c8e35 tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.454194 Jul 19 19:40:22.568927 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 191/368] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:22.585023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6fe2db9-03ed-4365-adef-ab3ea20fd9ae tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.614367 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6fe2db9-03ed-4365-adef-ab3ea20fd9ae tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1271688151" status: 202 len: 0 microversion: 2.1 time: 0.032724 Jul 19 19:40:22.618831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 192/369] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:22 2022] DELETE /compute/v2.1/flavors/1271688151 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:22.636375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae6858cb-b455-499f-97ea-e47a4721fb45 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.652198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.652850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:22.671274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.671730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.672533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.672989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.700882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae6858cb-b455-499f-97ea-e47a4721fb45 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.080794 Jul 19 19:40:22.702110 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 193/370] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:22.709453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.710268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:22.722501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.723139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.724085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:22.724658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:22.943303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:22.953741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da35326c-ae5e-4bef-ba36-edf469520f34 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1279 microversion: 2.1 time: 0.250400 Jul 19 19:40:22.955963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 194/371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:22.960956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1217f4c9-99e8-4898-8d04-28b9c0f473d2 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-28923861", "id": 2067642105, "os-flavor-access:is_public": "False"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:22.963388 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:22.963388 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:22.987373 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1217f4c9-99e8-4898-8d04-28b9c0f473d2 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.029691 Jul 19 19:40:22.988341 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 195/372] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:22 2022] POST /compute/v2.1/flavors => generated 428 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:22.995576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:22.996359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:23.004104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:23.004351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:23.005187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:23.005783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:23.525523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:23.536615 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d158b65-4845-43fa-915b-a797d6a24cb6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.545113 Jul 19 19:40:23.547574 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 196/373] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:23.549576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 8c02c0cd-21e3-4168-a62c-ee9954f13126 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:23.565213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78a2defd-56df-4c71-b2fc-16f68cdfaf8c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "2067642105"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:23.577539 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-78a2defd-56df-4c71-b2fc-16f68cdfaf8c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] HTTP exception thrown: Flavor 2067642105 could not be found. Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78a2defd-56df-4c71-b2fc-16f68cdfaf8c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Request method failure captured: Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 107 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiiy0_Ojzzd2bp3iKhNoJwxGkcfSiYQRzzGcgusyuwGF4oYdpNRiOL_xee82zDbgmUOc7hMgbRYz5x0qE0kBWMhsIiYNIdKQg4uRY4xoyFpr-qMu6T1mXOeb9N21i-82tHMcMbV52PdcMqmo8Lj3PdJiXB40P39AkkYpzMOcAEJnak Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 3ed968ef69a54c30b1f80eb894ac6774 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FlavorsAdminTestJSON-1287220943 Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:23.581075 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed968ef69a54c30b1f80eb894ac6774"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ed968ef69a54c30b1f80eb894ac6774"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ed968ef69a54c30b1f80eb894ac6774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed968ef69a54c30b1f80eb894ac6774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FlavorsAdminTestJSON-1287220943 Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 3ed968ef69a54c30b1f80eb894ac6774 Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1287220943 Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FlavorsAdminTestJSON-1287220943-project Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 43a13c49de19465193e8bb2157db910f Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FlavorsAdminTestJSON-1287220943-project Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "test", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "2067642105"}} Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:23.582263 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor 2067642105 could not be found. Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '2067642105'}}} Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2067642105 could not be found. Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:23.583031 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2067642105 could not be found. Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:23.584078 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2067642105 could not be found. Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78a2defd-56df-4c71-b2fc-16f68cdfaf8c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Returning 400 to user: Flavor 2067642105 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78a2defd-56df-4c71-b2fc-16f68cdfaf8c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.033298 Jul 19 19:40:23.585149 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 197/374] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:23 2022] POST /compute/v2.1/servers => generated 81 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:40:23.614195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8759ed02-8bda-431d-b587-33c6a3ff8f09 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:23.615030 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:23.615030 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:23.674230 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-042f1e6f-06cb-4050-877f-46739ab9dd05 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 2050 microversion: 2.25 time: 1.338408 Jul 19 19:40:23.676081 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 178/375] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:22 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 2050 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:40:23.682535 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8759ed02-8bda-431d-b587-33c6a3ff8f09 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2067642105" status: 202 len: 0 microversion: 2.1 time: 0.087427 Jul 19 19:40:23.683975 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 198/376] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:23 2022] DELETE /compute/v2.1/flavors/2067642105 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:23.699332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f9006e38-1caa-4140-9f9c-5669fe4d238c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:23.708105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:23.708879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:23.716875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:23.717326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:23.718611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:23.719082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:23.768515 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f9006e38-1caa-4140-9f9c-5669fe4d238c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.079576 Jul 19 19:40:23.784577 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 179/377] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:23 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:40:23.789788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cfe29818-fea7-43a8-9807-43cab0593b48 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1887739132", "id": 1426041455, "os-flavor-access:is_public": "False"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:23.792929 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:23.792929 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:23.817371 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cfe29818-fea7-43a8-9807-43cab0593b48 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.031510 Jul 19 19:40:23.827202 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 180/378] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:23 2022] POST /compute/v2.1/flavors => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:23.832799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61dd9d00-4c7e-4e07-8bb9-79b8fe2ca52f tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1688839286", "id": 620911352, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:23.885420 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61dd9d00-4c7e-4e07-8bb9-79b8fe2ca52f tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056223 Jul 19 19:40:23.890501 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 181/379] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:23 2022] POST /compute/v2.1/flavors => generated 411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:23.899241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81ea2cb6-765d-48f4-8c16-bf06325f1be3 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:23.952488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81ea2cb6-765d-48f4-8c16-bf06325f1be3 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.059434 Jul 19 19:40:23.956028 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 182/380] 10.222.0.23 () {58 vars in 1168 bytes} [Tue Jul 19 19:40:23 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:23.972394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1a4b72f-8957-4e5d-8870-f5ea13bcae51 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:23.977712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 8c02c0cd-21e3-4168-a62c-ee9954f13126 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:23.999733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1a4b72f-8957-4e5d-8870-f5ea13bcae51 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.034425 Jul 19 19:40:24.002206 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 183/381] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Jul 19 19:40:23 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:24.013756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.014363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:24.035308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.035826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.037978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.040628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.081354 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bba62cf-be68-44e8-9af8-ae5394f79dc9 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 2050 microversion: 2.25 time: 0.386547 Jul 19 19:40:24.082314 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 199/382] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:23 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 2050 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:24.088449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8473cb3-5fa1-429b-be1f-67209196b09e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.107899 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8473cb3-5fa1-429b-be1f-67209196b09e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.024247 Jul 19 19:40:24.109256 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 200/383] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:24.118770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.120036 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:24.120036 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:24.124875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.125343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.126197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.126606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.159859 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee387c39-80db-43e3-9b93-dbbf8bbe5e35 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049232 Jul 19 19:40:24.161749 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 201/384] 10.222.0.23 () {60 vars in 1216 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:24.168546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb391d96-8896-442d-9244-136c3dd249f1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.179726 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb391d96-8896-442d-9244-136c3dd249f1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.016494 Jul 19 19:40:24.186078 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 202/385] 10.222.0.23 () {58 vars in 1168 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:24.191989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843834-3", "block_migration": "auto"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:24.193455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:24.198949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=16 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:24.207546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.213178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.215260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.216538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.267800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:24.279901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4bf2ac36-8ebb-4a10-8188-f1982dbe7a66 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1277 microversion: 2.1 time: 0.275060 Jul 19 19:40:24.289750 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 184/386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:24.289750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16d70e69-0576-42bb-a137-fe41a3009d63 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.338812 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16d70e69-0576-42bb-a137-fe41a3009d63 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.051686 Jul 19 19:40:24.340470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 185/387] 10.222.0.23 () {58 vars in 1168 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:24.363643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb83398b-cfe1-4cb4-8d57-4f31fcd0acad tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.412935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'flavor' on Instance uuid 8c02c0cd-21e3-4168-a62c-ee9954f13126 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:24.417099 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb83398b-cfe1-4cb4-8d57-4f31fcd0acad tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.062894 Jul 19 19:40:24.417774 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 186/388] 10.222.0.23 () {58 vars in 1174 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:24.434429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76dcd318-ebe6-4054-98f6-59bad3ec0c63 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.464603 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76dcd318-ebe6-4054-98f6-59bad3ec0c63 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.034098 Jul 19 19:40:24.476181 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 187/389] 10.222.0.23 () {58 vars in 1172 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:24.482147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e2dfcf3-9be1-41c9-99de-4209e146c66a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.509481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e2dfcf3-9be1-41c9-99de-4209e146c66a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.030915 Jul 19 19:40:24.523809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 188/390] 10.222.0.23 () {58 vars in 1168 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:24.530924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5bb1d1c7-b769-45f3-9be3-1571e34a494c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.531757 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:24.531757 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:24.537220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Going to try to live migrate instance to n-h2-843834-3 {{(pid=131229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:40:24.542280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=84,nova_api:INSERT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:24.557674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5bb1d1c7-b769-45f3-9be3-1571e34a494c tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/620911352" status: 202 len: 0 microversion: 2.1 time: 0.032513 Jul 19 19:40:24.558987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 189/391] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:40:24 2022] DELETE /compute/v2.1/flavors/620911352 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:24.568844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:24.569533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:24.579820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.580380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:24.581077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:24.581526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:25.060515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:25.103781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49a80942-e25d-4d16-bf59-60df27f3cd00 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.540508 Jul 19 19:40:25.104649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 190/392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:24 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:25.109539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b59cfe25-935d-4b8e-85ac-a89f177d0cd1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.140632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b59cfe25-935d-4b8e-85ac-a89f177d0cd1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.034542 Jul 19 19:40:25.141618 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 191/393] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:25.157045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-692a0d35-ecc3-4e59-9de1-c86f4e52ed89 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.157920 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:25.157920 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:25.183720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-692a0d35-ecc3-4e59-9de1-c86f4e52ed89 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1426041455" status: 202 len: 0 microversion: 2.1 time: 0.031061 Jul 19 19:40:25.188739 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 192/394] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:25 2022] DELETE /compute/v2.1/flavors/1426041455 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:40:25.194346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae111d5e-f71b-4776-bb02-2d85dcdd0ddd tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.225829 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae111d5e-f71b-4776-bb02-2d85dcdd0ddd tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.035864 Jul 19 19:40:25.226715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 193/395] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:25.245136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce69b307-4b2a-4c8e-839f-9bd42b6e579a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-958671339", "id": 1765098849, "os-flavor-access:is_public": "False"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:25.246835 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:25.246835 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:25.269453 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce69b307-4b2a-4c8e-839f-9bd42b6e579a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028327 Jul 19 19:40:25.278737 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 194/396] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:25.288222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ace0b62d-f17e-49df-988e-3281e89b00bb tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.315536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ace0b62d-f17e-49df-988e-3281e89b00bb tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.035295 Jul 19 19:40:25.327346 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 195/397] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:25.333045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.333663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:25.340916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:25.341379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:25.342220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:25.342660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:25.847221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:25.861086 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-467dc20b-f38a-4a6c-bd81-4aa367ed0407 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 0.531280 Jul 19 19:40:25.863850 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 196/398] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:25 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:25.880216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e3bd287-2616-4e66-8b35-19398a1a404c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:25.911490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e3bd287-2616-4e66-8b35-19398a1a404c tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.046107 Jul 19 19:40:25.913273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 197/399] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:26.432070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Action: 'update', calling method: .version_select at 0x7f23fc0203a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:26.701830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:26.702626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:26.704079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:26.705065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:26.982496 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8325c97-7ac3-4ce0-a817-ab8ae80e4511 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9" status: 200 len: 240 microversion: 2.36 time: 1.067762 Jul 19 19:40:26.989005 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 198/400] 10.222.0.23 () {62 vars in 1302 bytes} [Tue Jul 19 19:40:25 2022] PUT /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9 => generated 240 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:26.998012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92e97b9e-3dcd-40b0-a9dc-c7f0cbebaef1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:27.002874 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:27.002874 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:27.087502 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92e97b9e-3dcd-40b0-a9dc-c7f0cbebaef1 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1765098849" status: 202 len: 0 microversion: 2.1 time: 0.095587 Jul 19 19:40:27.089429 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 199/401] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:26 2022] DELETE /compute/v2.1/flavors/1765098849 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:27.101691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:27.104860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:27.120800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:27.121464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:27.122523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:27.123277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:27.677729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:27.686781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f0c1f9f-4c8b-4f0f-ba7e-3c7844f3f931 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1475 microversion: 2.1 time: 0.595113 Jul 19 19:40:27.691313 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 200/402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:27 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1475 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:27.705276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-601c52be-b607-4411-bbb6-fc36d6e2e09f req-978cf045-afd2-4a45-81af-90e73303207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7f0e5b-032f-427a-8c4a-6d399a525a63", "tag": "f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:27.727612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-601c52be-b607-4411-bbb6-fc36d6e2e09f req-978cf045-afd2-4a45-81af-90e73303207f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:27.728303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-601c52be-b607-4411-bbb6-fc36d6e2e09f req-978cf045-afd2-4a45-81af-90e73303207f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:27.752253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-601c52be-b607-4411-bbb6-fc36d6e2e09f req-978cf045-afd2-4a45-81af-90e73303207f service nova] Creating event network-changed:f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1 for instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 on n-h2-843834-3 Jul 19 19:40:27.757735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-601c52be-b607-4411-bbb6-fc36d6e2e09f req-978cf045-afd2-4a45-81af-90e73303207f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064872 Jul 19 19:40:27.758353 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 201/403] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:27.763355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:27.764047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:27.781876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:27.782332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:27.783153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:27.783865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:28.601701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:28.612395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-816a86b4-dcfb-4b8a-8aed-15dc9137a720 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 0.852763 Jul 19 19:40:28.613278 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 202/404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:27 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:28.639362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Calling method '.version_select at 0x7f23efeb38b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:28.958716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:28.959521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:28.961567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:28.962123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:28.975622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=15 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:29.007729 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21b1bcbe-53da-4144-9e9e-5c7f32b9cf23 tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9/detail" status: 200 len: 672 microversion: 2.36 time: 0.383070 Jul 19 19:40:29.017074 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 203/405] 10.222.0.23 () {60 vars in 1303 bytes} [Tue Jul 19 19:40:28 2022] GET /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9/detail => generated 672 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:29.022189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d501bc9d-fc45-4a1c-b975-cf635a09d91e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:29.047030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-164e061d-e07e-4bea-9d88-3b0cd3c2232b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126/action" status: 202 len: 0 microversion: 2.25 time: 4.865511 Jul 19 19:40:29.051858 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 203/406] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:40:24 2022] POST /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126/action => generated 0 bytes in 4871 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:29.138334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d501bc9d-fc45-4a1c-b975-cf635a09d91e tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.119407 Jul 19 19:40:29.140879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 204/407] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:29 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:29.164544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:29.168276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:29.182099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.184904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:29.187334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.188717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:29.199510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:29.205969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52b5b3fb-0ca8-45d9-a6e0-bc94afe56083 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1697482103", "id": 2128314794, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:29.208261 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:29.208261 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:29.241448 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-52b5b3fb-0ca8-45d9-a6e0-bc94afe56083 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.188153 Jul 19 19:40:29.242114 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 204/408] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:40:29 2022] POST /compute/v2.1/flavors => generated 449 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:29.260304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:29.262814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:29.321623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.327296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:29.333864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.334327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:29.410630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:40:29.682239 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ebd5b88-f3d0-4281-bbee-4939e1f6a4f4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 204 len: 0 microversion: 2.1 time: 0.438846 Jul 19 19:40:29.683183 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 205/409] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:29 2022] DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:29.696288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:29.698775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:29.707600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.708403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:29.709614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:29.710323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.140432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:30.148749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e4040fcf-7a14-41c1-9f60-4cd48bff816f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1474 microversion: 2.1 time: 1.006575 Jul 19 19:40:30.149418 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 205/410] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:29 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1474 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:30.156979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b7953cc-ae84-4d96-9830-fe5e4bda1ced tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1638053396", "id": 1472477609, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:30.159885 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:30.159885 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:30.182084 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b7953cc-ae84-4d96-9830-fe5e4bda1ced tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.031394 Jul 19 19:40:30.183314 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 206/411] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:30.229638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:30.239024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:30.241148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:30.242879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54f31e12-9b97-421f-ae82-1c18dad2864f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.558395 Jul 19 19:40:30.244034 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 206/412] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:29 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:30.248976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Action: 'update', calling method: .version_select at 0x7f23efebae50>, body: {"quota_set": {"ram": "2048"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:30.305576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2974e102-9666-4401-a790-f16af5b57927 tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:30.321624 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2974e102-9666-4401-a790-f16af5b57927 tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] 10.222.0.23 "GET /compute/v2.1/flavors/2128314794" status: 200 len: 449 microversion: 2.55 time: 0.135953 Jul 19 19:40:30.322508 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 207/413] 10.222.0.23 () {60 vars in 1198 bytes} [Tue Jul 19 19:40:30 2022] GET /compute/v2.1/flavors/2128314794 => generated 449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:30.327258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:30.328108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:30.334275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.334790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.335115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.335771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.336141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.336645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.337149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.337789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.386737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.387392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.388366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.388823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.460844 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ff08df74-1e11-4841-a62f-272b3136af8d tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9?user_id=cf7f2089f6b842a586be45cb2295053d" status: 200 len: 240 microversion: 2.36 time: 0.215507 Jul 19 19:40:30.461490 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 207/414] 10.222.0.23 () {62 vars in 1383 bytes} [Tue Jul 19 19:40:30 2022] PUT /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9?user_id=cf7f2089f6b842a586be45cb2295053d => generated 240 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:30.468296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1533714323", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "1694819681", "adminPass": "***", "networks": [{"uuid": "0a02c0bb-966f-4bb6-b02a-6e8d0148e831"}], "security_groups": [{"name": "tempest-securitygroup--1374059101"}], "key_name": "tempest-keypair-671997608", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:30.706503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:30.715459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-233ba4c9-47cb-4c9e-947c-4b971418a2d5 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 0.391646 Jul 19 19:40:30.716040 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 208/415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:30 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:30.727790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "name": "network-vif-unplugged", "status": "completed", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:30.743580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:30.744665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:30.765095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] validate_networks() for [('0a02c0bb-966f-4bb6-b02a-6e8d0148e831', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:30.774282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] Creating event network-vif-unplugged:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h1-843834-3 Jul 19 19:40:30.788224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:40:30.805383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4e091a77-2ecd-4136-9334-02c5cf82238c req-b7653a14-8e3e-4234-87a7-6d7a29c35d13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087954 Jul 19 19:40:30.806262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 209/416] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:30.889731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8ac2786-b266-4909-a13c-58d52a427d5a tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Calling method '.version_select at 0x7f23efe50b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:31.290805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8ac2786-b266-4909-a13c-58d52a427d5a tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.483041 Jul 19 19:40:31.305537 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:40:30 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:40:31.318737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6aaeab9-63bd-4fb5-b45f-d9619fcf1c53 tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:31.371649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d6aaeab9-63bd-4fb5-b45f-d9619fcf1c53 tempest-FlavorsAdminTestJSON-1287220943 tempest-FlavorsAdminTestJSON-1287220943-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6643 microversion: 2.1 time: 0.060481 Jul 19 19:40:31.377099 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 211/418] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:31 2022] GET /compute/v2.1/flavors/detail => generated 6643 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:31.391006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d56e2322-4161-4fd3-b177-3312628cc002 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:31.394749 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:31.394749 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:31.447153 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d56e2322-4161-4fd3-b177-3312628cc002 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/2128314794" status: 200 len: 450 microversion: 2.55 time: 0.067280 Jul 19 19:40:31.447756 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 212/419] 10.222.0.23 () {62 vars in 1218 bytes} [Tue Jul 19 19:40:31 2022] PUT /compute/v2.1/flavors/2128314794 => generated 450 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:31.459529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d40abb35-c185-4be4-9c67-5aa30b01950e tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] Calling method '.version_select at 0x7f23efe50820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:31.568764 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d40abb35-c185-4be4-9c67-5aa30b01950e tempest-QuotasAdminTestV236-1367560498 tempest-QuotasAdminTestV236-1367560498-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9?user_id=cf7f2089f6b842a586be45cb2295053d" status: 200 len: 282 microversion: 2.36 time: 0.118064 Jul 19 19:40:31.571567 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 213/420] 10.222.0.23 () {60 vars in 1363 bytes} [Tue Jul 19 19:40:31 2022] GET /compute/v2.1/os-quota-sets/23dc82367c6a4d30ab3cf3e30682b7c9?user_id=cf7f2089f6b842a586be45cb2295053d => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:40:31.583055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:31.585277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:31.605723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:31.607421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:31.608256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:31.608697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:32.348443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:32.349675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:32.355518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:32.356329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:32.357075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:32.373405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:32.374128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:32.386000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:32.391218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:32.395675 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d73dd99e-f73e-42c6-a51e-c48f89d29488 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1474 microversion: 2.1 time: 0.822839 Jul 19 19:40:32.396400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:32.410653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 214/421] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:31 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1474 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:32.420717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:32.422276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:32.446206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:32.446667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:32.452348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:32.455489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:32.470447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:32.489871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Getting quotas for user 2813b3164f34435ab921bd3ffc8f910a and project 44f88ce38c2e4f7e9fcb95f2c2cb5950. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:32.555749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:32.578042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:32.692242 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-789a859f-bc25-4686-bb13-2098d481494b tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.229665 Jul 19 19:40:32.695503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 208/422] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:40:32.705705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4566d0f-7ca8-4536-ba9f-6dff32ce85e0 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Action: 'create', calling method: .version_select at 0x7f23efdc0a60>, body: {"pool": "non_exist_pool"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:33.121064 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e4566d0f-7ca8-4536-ba9f-6dff32ce85e0 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] HTTP exception thrown: Floating IP pool not found. Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4566d0f-7ca8-4536-ba9f-6dff32ce85e0 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Request method failure captured: Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 26 Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1witeZ3XRaw-TFEoF6lNvA4_DPjSPlaqBnNA6gyU0TObabTWAx822-LIPEJiZu0AEJAxhbnYFgnULrNbnCmXl5gwoHOTcZzMa3ErzsxF15Qxl0KTlRPSQbZ7FO97BjNai-39vzW3jwFZ5BvbnOM6vMDPSR7ZMAjiK9fGQ_SaN1lcfEc Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: cc567194938545de92ba5d0fbb720cfb Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:33.124460 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: cc567194938545de92ba5d0fbb720cfb Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsNegativeTestJSON-1167263906-project Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: adf132672d024891a82273c5ca665944 Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1167263906-project Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: {"pool": "non_exist_pool"} Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: exception: Floating IP pool not found. Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 19 19:40:33.125835 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:33.126860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4566d0f-7ca8-4536-ba9f-6dff32ce85e0 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Returning 404 to user: Floating IP pool not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:33.128263 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4566d0f-7ca8-4536-ba9f-6dff32ce85e0 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.429431 Jul 19 19:40:33.132395 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 209/423] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:40:32 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:33.140002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3177da48-0e30-4de4-9b80-4b751830ff6a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:33.140891 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:33.140891 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:33.207619 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3177da48-0e30-4de4-9b80-4b751830ff6a tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1472477609" status: 202 len: 0 microversion: 2.1 time: 0.074107 Jul 19 19:40:33.208553 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 210/424] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:40:33 2022] DELETE /compute/v2.1/flavors/1472477609 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:33.215029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd24bf78-3363-49af-9476-0b8676e68d3b tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:33.279289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd24bf78-3363-49af-9476-0b8676e68d3b tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6597 microversion: 2.55 time: 0.069966 Jul 19 19:40:33.292669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 211/425] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:33 2022] GET /compute/v2.1/flavors/detail => generated 6597 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:33.308494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:33.309117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:33.329691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:33.330147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:33.332833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:33.333287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:33.840318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:33.854108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:33.860395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:33.861639 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f85e137-7620-4a62-b4ae-ae42f2d13113 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 1.449374 Jul 19 19:40:33.865716 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 215/426] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:32 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:33.879571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ef36fb53-40f1-4477-bb31-d04255a53d77 req-271e5d42-49f8-4735-bd58-a2fd1e7a7124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaffe29-9112-4b41-8e9a-3556b7c7b8ec", "name": "network-vif-deleted", "tag": "683810a0-b10e-490c-b6b4-081f0d618475"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:33.903385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ef36fb53-40f1-4477-bb31-d04255a53d77 req-271e5d42-49f8-4735-bd58-a2fd1e7a7124 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:33.904092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ef36fb53-40f1-4477-bb31-d04255a53d77 req-271e5d42-49f8-4735-bd58-a2fd1e7a7124 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:33.928426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ef36fb53-40f1-4477-bb31-d04255a53d77 req-271e5d42-49f8-4735-bd58-a2fd1e7a7124 service nova] Creating event network-vif-deleted:683810a0-b10e-490c-b6b4-081f0d618475 for instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec on n-h1-843834-3 Jul 19 19:40:33.940821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ef36fb53-40f1-4477-bb31-d04255a53d77 req-271e5d42-49f8-4735-bd58-a2fd1e7a7124 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073134 Jul 19 19:40:33.943688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 216/427] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:33.954246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:33.954865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:33.969840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:33.971631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:33.976106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:33.976702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:34.139741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:34.159437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d41a9a4-3af6-4cb5-bd13-bc126e3ff9e8 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 0.866920 Jul 19 19:40:34.160222 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 212/428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:33 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:34.190617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}, {"server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:34.217236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:34.218103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:34.234770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:34.266788 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Creating event network-changed:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h1-843834-3 Jul 19 19:40:34.268214 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Creating event network-vif-unplugged:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h1-843834-3 Jul 19 19:40:34.268759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5378d50e-35fb-4ead-8e00-1bb96ff9f51e tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1260 microversion: 2.1 time: 0.298816 Jul 19 19:40:34.269544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 217/429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:33 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1260 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:34.304337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:40:34.319466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Calling method '.version_select at 0x7f23efe50ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.340972 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-72cbf6fb-4f89-495a-a8de-0082617f2d2f req-9e463bd2-8d74-4439-b5d0-c7169ce9e2ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.173702 Jul 19 19:40:34.342141 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 213/430] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:34.353118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75dd6166-cef0-46a5-98ba-d3aa8002dd96 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.413714 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75dd6166-cef0-46a5-98ba-d3aa8002dd96 tempest-FlavorsAdminTestJSON-1732584457 tempest-FlavorsAdminTestJSON-1732584457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.069583 Jul 19 19:40:34.415601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 214/431] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:40:34 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:34.424200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e509f329-5f48-4450-80a6-a4bd8427c097 tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.471348 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e509f329-5f48-4450-80a6-a4bd8427c097 tempest-FlavorsV255TestJSON-2023885512 tempest-FlavorsV255TestJSON-2023885512-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3687 microversion: 2.55 time: 0.053589 Jul 19 19:40:34.482557 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 215/432] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Jul 19 19:40:34 2022] GET /compute/v2.1/flavors => generated 3687 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:34.488772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.489866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:34.499138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:34.499773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:34.500716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:34.501464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:34.512154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1c0bbaec-9ede-4328-9921-0788d66b7eff could not be found", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:40:34.513142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] HTTP exception thrown: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Request method failure captured: Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-floating-ips/1c0bbaec-9ede-4328-9921-0788d66b7eff HTTP/1.1 Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1witeZ3XRaw-TFEoF6lNvA4_DPjSPlaqBnNA6gyU0TObabTWAx822-LIPEJiZu0AEJAxhbnYFgnULrNbnCmXl5gwoHOTcZzMa3ErzsxF15Qxl0KTlRPSQbZ7FO97BjNai-39vzW3jwFZ5BvbnOM6vMDPSR7ZMAjiK9fGQ_SaN1lcfEc Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc567194938545de92ba5d0fbb720cfb Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:40:34.533569 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc567194938545de92ba5d0fbb720cfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc567194938545de92ba5d0fbb720cfb Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1167263906 Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsNegativeTestJSON-1167263906-project Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: adf132672d024891a82273c5ca665944 Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1167263906-project Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: exception: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1c0bbaec-9ede-4328-9921-0788d66b7eff'} Jul 19 19:40:34.535063 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:40:34.535796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1c0bbaec-9ede-4328-9921-0788d66b7eff could not be found Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d429a4e0-ebf8-45db-a0fd-e92e52e236cf'] Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff. Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:34.536816 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:34.537887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:34.539155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff Jul 19 19:40:34.539155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:34.540125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] Returning 404 to user: Floating IP not found for ID 1c0bbaec-9ede-4328-9921-0788d66b7eff {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:34.541303 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-527c7604-50ff-4843-91f5-d616ad838081 tempest-FloatingIPsNegativeTestJSON-1167263906 tempest-FloatingIPsNegativeTestJSON-1167263906-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/1c0bbaec-9ede-4328-9921-0788d66b7eff" status: 404 len: 111 microversion: 2.1 time: 0.255284 Jul 19 19:40:34.542036 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 218/433] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:40:34 2022] DELETE /compute/v2.1/os-floating-ips/1c0bbaec-9ede-4328-9921-0788d66b7eff => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:34.550750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8158e824-600b-4554-a710-20844d4e0522 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.551821 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:34.551821 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:34.596090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:34.622218 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8158e824-600b-4554-a710-20844d4e0522 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2128314794" status: 202 len: 0 microversion: 2.55 time: 0.078965 Jul 19 19:40:34.622803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 219/434] 10.222.0.23 () {60 vars in 1201 bytes} [Tue Jul 19 19:40:34 2022] DELETE /compute/v2.1/flavors/2128314794 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:34.645729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5b65aa0-f605-4369-b738-acb3c5daaa61 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.682360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5b65aa0-f605-4369-b738-acb3c5daaa61 tempest-FlavorsV255TestJSON-430688767 tempest-FlavorsV255TestJSON-430688767-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6157 microversion: 2.55 time: 0.049354 Jul 19 19:40:34.690404 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 220/435] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:34 2022] GET /compute/v2.1/flavors/detail => generated 6157 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:34.881867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:34.883322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:34.894204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:34.911778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:34.912989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:34.921970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:35.358763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:35.371653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:35.375805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:35.379063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21856ce7-9830-4c2b-b70e-1266d4b1adfd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.501552 Jul 19 19:40:35.382858 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 221/436] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:34 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:40:35.384523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:35.395817 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c420f76-8155-4fe6-9062-4496be3cc742 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1474 microversion: 2.1 time: 0.911283 Jul 19 19:40:35.396480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:35.397115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:35.408738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 216/437] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:34 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1474 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:35.415367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:35.415834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:35.416677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:35.417114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:35.425240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:35.430596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:35.447718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:35.448166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:35.448947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:35.449378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:35.661472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:35.678078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:35.686157 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f346160d-20fa-41bc-b1a2-07915ed61e58 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1322 microversion: 2.1 time: 0.276306 Jul 19 19:40:35.696139 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 217/438] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:35 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:36.384134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4ae2a33a-8f8a-4a0b-8a53-8096e17faacf req-dc033805-c103-4859-83a6-a5984ce41a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:36.409305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ae2a33a-8f8a-4a0b-8a53-8096e17faacf req-dc033805-c103-4859-83a6-a5984ce41a4b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:36.410094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ae2a33a-8f8a-4a0b-8a53-8096e17faacf req-dc033805-c103-4859-83a6-a5984ce41a4b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:36.430098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4ae2a33a-8f8a-4a0b-8a53-8096e17faacf req-dc033805-c103-4859-83a6-a5984ce41a4b service nova] Creating event network-changed:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h1-843834-3 Jul 19 19:40:36.445045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4ae2a33a-8f8a-4a0b-8a53-8096e17faacf req-dc033805-c103-4859-83a6-a5984ce41a4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064351 Jul 19 19:40:36.445905 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 218/439] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:40:36.451237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:36.459570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:36.470049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:36.470500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:36.471344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:36.471770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:36.609925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:36.620159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81d12a1b-ccd1-4a9b-aec8-58dd2d5f4b24 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 1.235421 Jul 19 19:40:36.621011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 222/440] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:35 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:36.628494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:36.629416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:36.637683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:36.638502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:36.639587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:36.640216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:37.089533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:37.111236 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-008fecf2-a20b-4ef6-8057-280259cdab35 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1472 microversion: 2.1 time: 0.484231 Jul 19 19:40:37.115143 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 223/441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:36 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:37.131785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:37.132703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:37.145099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:37.145544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:37.146316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:37.146744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:37.150882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:37.161142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:37.167976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:37.170782 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab7e1d51-eaa7-4bb2-acb6-93d43bc79bf1 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.723632 Jul 19 19:40:37.173764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 219/442] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:36 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:37.187974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3f3969f7-37fc-49c8-ac2b-2f695a643e8c req-dffb5b9d-aca8-402a-b365-b8ebfb938bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f0e5b-032f-427a-8c4a-6d399a525a63", "name": "network-vif-plugged", "status": "completed", "tag": "f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:37.205732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3f3969f7-37fc-49c8-ac2b-2f695a643e8c req-dffb5b9d-aca8-402a-b365-b8ebfb938bb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:37.210616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3f3969f7-37fc-49c8-ac2b-2f695a643e8c req-dffb5b9d-aca8-402a-b365-b8ebfb938bb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:37.248041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3f3969f7-37fc-49c8-ac2b-2f695a643e8c req-dffb5b9d-aca8-402a-b365-b8ebfb938bb5 service nova] Creating event network-vif-plugged:f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1 for instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 on n-h2-843834-3 Jul 19 19:40:37.260013 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3f3969f7-37fc-49c8-ac2b-2f695a643e8c req-dffb5b9d-aca8-402a-b365-b8ebfb938bb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083888 Jul 19 19:40:37.264830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 220/443] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:37.615496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:37.638452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:37.640822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:37.645556 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a84eca5-96b3-4b60-ae6c-ef0861794057 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1322 microversion: 2.1 time: 0.525793 Jul 19 19:40:37.659831 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 224/444] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:37 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:37.660775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:37.661332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:37.662199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:37.662704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.137981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:38.138601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:38.149756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.152035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.155582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.156448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.455974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:38.467666 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d76eacef-9cba-42c1-8ebc-0ec1c60149b0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1319 microversion: 2.1 time: 0.833964 Jul 19 19:40:38.469869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 221/445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:37 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:40:38.483478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:38.484468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:38.492860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.493592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.494577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.495227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.911870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:38.926746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a1756a7a-4969-43ef-b00d-d2a9a8899501 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1469 microversion: 2.1 time: 0.792384 Jul 19 19:40:38.929200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 225/446] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:38 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1469 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:38.947430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:38.953826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:38.967668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.968765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:38.969767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:38.971223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.009094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:39.016330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:39.032751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:39.041935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:39.043772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01044315-2f73-4c39-a94f-bd2cbe8d5210 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.565511 Jul 19 19:40:39.044957 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 222/447] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:38 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:39.051029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:39.051664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:39.065156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.067720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.069919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.070981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.183438 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac54ad95-4423-4d3f-9c48-6b6c795365b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5/action" status: 204 len: 0 microversion: 2.1 time: 0.136736 Jul 19 19:40:39.188936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 223/448] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:40:39 2022] POST /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:39.205558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:39.206418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:39.225446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.227509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.228958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.231714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.268888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:39.280353 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac48f46b-d5f0-4c6f-a624-838d26198886 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.346411 Jul 19 19:40:39.294428 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 226/449] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:38 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:39.486661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:39.487352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:39.500971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.501475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.502379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.502880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.741405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:39.760870 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e3aba1e-90ac-42aa-9a4c-44d70a7337d6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1469 microversion: 2.1 time: 0.570019 Jul 19 19:40:39.761688 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 224/450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:39 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:39.776134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "name": "network-vif-plugged", "status": "completed", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:39.796293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:39.797396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:39.825617 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] Creating event network-vif-plugged:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h1-843834-3 Jul 19 19:40:39.841971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:40:39.871862 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-96df4bb7-31d9-4205-b9c4-49d2c1b76706 req-83713704-5de5-4c88-9a48-665813080e09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108235 Jul 19 19:40:39.879024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 225/451] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:40.069153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:40.070936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:40.088334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.088791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.090098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.091878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.428477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:40.445223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e89cc903-d0cc-4588-b78d-b4cb4138ba45 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1468 microversion: 2.1 time: 0.960427 Jul 19 19:40:40.452420 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 227/452] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:39 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1468 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:40:40.466834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:40.469247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:40.481347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.481989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.482987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.483754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.698789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:40.727078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:40.733549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:40.738723 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2a3c625-0fca-490a-abe7-f25d850dd061 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.679396 Jul 19 19:40:40.755340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 226/453] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:40 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:40.777928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:40.778986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:40.842243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.843146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.848622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:40.850152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:40.914956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lazy-loading 'flavor' on Instance uuid ca7f0e5b-032f-427a-8c4a-6d399a525a63 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:41.072817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:41.113502 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21890e25-0c56-4d26-94dd-22b4e6ddd04c tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.657590 Jul 19 19:40:41.128988 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 228/454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:40 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:41.142816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:41.143626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:41.155604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:41.156432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:41.170254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:41.174176 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-510473d9-13d1-4a68-a21c-3c45ff8e4f6a tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63/action" status: 202 len: 0 microversion: 2.1 time: 0.415055 Jul 19 19:40:41.177005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:41.192953 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 227/455] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:40:40 2022] POST /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:40:41.219789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:41.220397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:41.222436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:41.248943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:41.249883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:41.251061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:41.251712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:41.562716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=22 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:42.079133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.089286 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0340ed5d-e8d1-49ab-bcf4-1ad3891e6499 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1469 microversion: 2.1 time: 0.958068 Jul 19 19:40:42.090699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.094942 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 229/456] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:41 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1469 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:42.106665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b5f72db2-073b-4a4e-8b84-5f39f29066b4 req-86f8c39b-e0e9-4287-9484-eb0ed6adf33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eda853-e022-4da6-bc1d-c038149a4321", "tag": "35717b0a-329e-43b8-a123-7e3725aac9aa"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:42.113139 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30bc45b3-e443-4b05-b868-e977f55a8a1a tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1476 microversion: 2.1 time: 0.917972 Jul 19 19:40:42.123049 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 228/457] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:41 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1476 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:42.131077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:42.132186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:42.137934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b5f72db2-073b-4a4e-8b84-5f39f29066b4 req-86f8c39b-e0e9-4287-9484-eb0ed6adf33f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:42.138653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b5f72db2-073b-4a4e-8b84-5f39f29066b4 req-86f8c39b-e0e9-4287-9484-eb0ed6adf33f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:42.143785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:42.147253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:42.150813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:42.151848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:42.183434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b5f72db2-073b-4a4e-8b84-5f39f29066b4 req-86f8c39b-e0e9-4287-9484-eb0ed6adf33f service nova] Creating event network-changed:35717b0a-329e-43b8-a123-7e3725aac9aa for instance 17eda853-e022-4da6-bc1d-c038149a4321 on n-h1-843834-3 Jul 19 19:40:42.195679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b5f72db2-073b-4a4e-8b84-5f39f29066b4 req-86f8c39b-e0e9-4287-9484-eb0ed6adf33f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099390 Jul 19 19:40:42.196737 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 230/458] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:42.209200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:42.210457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:42.220237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:42.221660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:42.223613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:42.225002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:42.429997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=17 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:42.510660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=18 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:42.688824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.705019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df9a2d5f-2ec8-4858-8425-2c9491a63ba1 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.506240 Jul 19 19:40:42.706000 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 231/459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:42 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:42.766839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.775142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.789422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:42.791497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.666603 Jul 19 19:40:42.792975 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 229/460] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:42 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:42.794129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:42.795248 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9102496-c1fb-4cf8-8e97-8a4ecb1b7fb5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001287 Jul 19 19:40:42.795732 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 230/461] 10.222.0.23 () {56 vars in 885 bytes} [Tue Jul 19 19:40:42 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 19:40:43.113988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:43.115143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:43.135398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.138558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.139422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.140453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.143359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Calling method '.version_select at 0x7f23efe715e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:43.145035 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:43.145035 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:43.146273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.147064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.148132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.150068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.212808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f59a9d3-d014-4a08-b03d-6dc47074b0b1 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.503450 Jul 19 19:40:43.223088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 232/462] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:40:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:43.228818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:43.235344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:43.255283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.255852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.256765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:43.257315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:43.273549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:44.080764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:44.089191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8586ac4-3fcd-4590-bf01-6b1ab168a2a0 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1459 microversion: 2.1 time: 0.864615 Jul 19 19:40:44.090121 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 233/463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:43 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1459 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:44.130772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:44.147115 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ececab9-1e40-423f-b211-fa3f673437d1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1469 microversion: 2.1 time: 1.039000 Jul 19 19:40:44.163349 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 231/464] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:43 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1469 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:44.177386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a010ecc8-3e15-4f27-afbd-4dcbe0ce909d req-116fa899-edd9-48b7-b5f4-0490ba082a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:44.201152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a010ecc8-3e15-4f27-afbd-4dcbe0ce909d req-116fa899-edd9-48b7-b5f4-0490ba082a5d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:44.206182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a010ecc8-3e15-4f27-afbd-4dcbe0ce909d req-116fa899-edd9-48b7-b5f4-0490ba082a5d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:44.237882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a010ecc8-3e15-4f27-afbd-4dcbe0ce909d req-116fa899-edd9-48b7-b5f4-0490ba082a5d service nova] Creating event network-vif-unplugged:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h1-843834-3 Jul 19 19:40:44.258038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a010ecc8-3e15-4f27-afbd-4dcbe0ce909d req-116fa899-edd9-48b7-b5f4-0490ba082a5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091228 Jul 19 19:40:44.262062 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 232/465] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:44.276346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:44.279066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:44.296012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:44.296732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:44.300406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:44.300406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:44.562823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145e5fc6-1653-42f8-8759-715333d24c47 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Calling method '.version_select at 0x7f23efe71ca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:44.564360 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:44.564360 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:44.565666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-145e5fc6-1653-42f8-8759-715333d24c47 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145e5fc6-1653-42f8-8759-715333d24c47 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:40:44.568477 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 19:40:44.570046 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:44.571454 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 19:40:44.573526 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:44.578490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145e5fc6-1653-42f8-8759-715333d24c47 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:44.579695 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-145e5fc6-1653-42f8-8759-715333d24c47 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.488426 Jul 19 19:40:44.580797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 234/466] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:40:44 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 490 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:44.590738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:44.598524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:44.615237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:44.616102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:44.618575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:44.621772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:45.103989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:45.119729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:45.121343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:45.127796 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1caa9fb0-c82d-4cbc-a133-347da1db355b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.545537 Jul 19 19:40:45.143993 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 235/467] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:44 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:45.154807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:45.159893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:45.160804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:45.167561 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b63d48a-6238-446d-b053-11179fa48280 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.903734 Jul 19 19:40:45.169713 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 233/468] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:44 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:45.176500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-647efbac-cfb8-4941-bf60-3148d5930f56 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Calling method '.version_select at 0x7f23efdbeb80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:45.177796 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:45.177796 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:45.181122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-647efbac-cfb8-4941-bf60-3148d5930f56 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:45.184035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:45.184494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-647efbac-cfb8-4941-bf60-3148d5930f56 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/n-d-843834-3/reboot HTTP/1.1 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:45.184799 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3'} Jul 19 19:40:45.186046 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:45.186831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 19:40:45.187902 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:45.191965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:45.191965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:45.194597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-647efbac-cfb8-4941-bf60-3148d5930f56 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:45.197193 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-647efbac-cfb8-4941-bf60-3148d5930f56 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-843834-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024191 Jul 19 19:40:45.198765 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 234/469] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Jul 19 19:40:45 2022] GET /compute/v2.1/os-hosts/n-d-843834-3/reboot => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:45.204774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:45.206281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:45.216376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:45.217189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:45.218184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:45.218832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.003780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:46.020076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-160094a7-4863-4283-b011-282f843fd5a8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1461 microversion: 2.1 time: 0.820010 Jul 19 19:40:46.026450 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 235/470] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:45 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1461 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:46.041605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-afd56f81-03f8-4d0a-892b-e870424dbb12 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Calling method '.version_select at 0x7f23efdbed30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:46.049478 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:46.049478 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:46.074255 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-afd56f81-03f8-4d0a-892b-e870424dbb12 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-afd56f81-03f8-4d0a-892b-e870424dbb12 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:46.076163 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:40:46.077498 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:46.078288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:40:46.083047 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-afd56f81-03f8-4d0a-892b-e870424dbb12 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-afd56f81-03f8-4d0a-892b-e870424dbb12 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.049025 Jul 19 19:40:46.085868 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 236/471] 10.222.0.23 () {58 vars in 1211 bytes} [Tue Jul 19 19:40:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:46.088323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:46.088323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:46.096632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.097352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.098153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.098593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.123556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:46.840898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12e4d3c5-5699-4b76-a9a9-453ed384a2c9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1612 microversion: 2.1 time: 0.759651 Jul 19 19:40:46.857743 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 237/472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:46 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1612 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:46.863164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9135cecd-5dae-4181-82bd-5fe384c6b6b7 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Calling method '.version_select at 0x7f23efd733a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:46.872581 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:46.872581 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:46.877667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9135cecd-5dae-4181-82bd-5fe384c6b6b7 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9135cecd-5dae-4181-82bd-5fe384c6b6b7 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/n-d-843834-3 HTTP/1.1 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:46.882132 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3'} Jul 19 19:40:46.883527 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:46.884371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 19:40:46.885410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:46.909463 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11bd55a9-1ff0-47ca-a8a5-4b692ee7eaad tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1610 microversion: 2.1 time: 1.761139 Jul 19 19:40:46.916731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9135cecd-5dae-4181-82bd-5fe384c6b6b7 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:46.923986 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 236/473] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:45 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1610 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:46.926857 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9135cecd-5dae-4181-82bd-5fe384c6b6b7 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-843834-3" status: 403 len: 109 microversion: 2.1 time: 0.066814 Jul 19 19:40:46.931851 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 238/474] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:40:46 2022] GET /compute/v2.1/os-hosts/n-d-843834-3 => generated 109 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:46.937411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:46.949013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:46.950027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:46.955866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:46.962757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.963237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.964015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.964444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.968971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.970282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:46.975782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:46.977320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.667148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.700168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.702491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.708488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.713554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bce2ef7c-fa30-44e6-81cb-8d8b226bdfe6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1567 microversion: 2.25 time: 0.788266 Jul 19 19:40:47.714364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df18d4b9-c096-457d-8da3-c8074fcb154d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.772672 Jul 19 19:40:47.717228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 239/475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:46 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:47.731284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e4fa4a6-4988-449c-b7c8-8cc2b2bb36ab tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '.version_select at 0x7f23efd73790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.735933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e4fa4a6-4988-449c-b7c8-8cc2b2bb36ab tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:47.736081 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 237/476] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:46 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1567 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:47.736906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e4fa4a6-4988-449c-b7c8-8cc2b2bb36ab tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.754595 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e4fa4a6-4988-449c-b7c8-8cc2b2bb36ab tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.026540 Jul 19 19:40:47.755061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.755759 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 240/477] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:47.761519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bf5aed0-7e68-4afc-961e-04f72703d803 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Calling method '.version_select at 0x7f23fc0deaf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.762500 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:47.762500 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:47.768654 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:47.768654 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:40:47.768962 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0bf5aed0-7e68-4afc-961e-04f72703d803 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bf5aed0-7e68-4afc-961e-04f72703d803 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:47.770842 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:40:47.772389 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.773244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.774518 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.775766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:47.776246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.776770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bf5aed0-7e68-4afc-961e-04f72703d803 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.777780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bf5aed0-7e68-4afc-961e-04f72703d803 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020703 Jul 19 19:40:47.779001 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 241/478] 10.222.0.23 () {58 vars in 1190 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:47.783131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:47.789094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b070d0e4-8287-4813-a77f-3a41691f1c6a tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Calling method '.version_select at 0x7f23efd73ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.790091 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:47.790091 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:47.791309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.791882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b070d0e4-8287-4813-a77f-3a41691f1c6a tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b070d0e4-8287-4813-a77f-3a41691f1c6a tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/n-d-843834-3/shutdown HTTP/1.1 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:47.793630 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3'} Jul 19 19:40:47.795092 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:47.796052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 19:40:47.797405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.799408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b070d0e4-8287-4813-a77f-3a41691f1c6a tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.800421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b070d0e4-8287-4813-a77f-3a41691f1c6a tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-843834-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016406 Jul 19 19:40:47.801674 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 242/479] 10.222.0.23 () {58 vars in 1193 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-hosts/n-d-843834-3/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:40:47.813305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e83a332-6a46-402b-bc98-990d4f2f1ae4 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Calling method '.version_select at 0x7f23efd73040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.825491 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-9e83a332-6a46-402b-bc98-990d4f2f1ae4 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e83a332-6a46-402b-bc98-990d4f2f1ae4 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:47.827998 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:40:47.829468 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:47.830546 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:40:47.831904 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.833193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.835253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e83a332-6a46-402b-bc98-990d4f2f1ae4 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.836287 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e83a332-6a46-402b-bc98-990d4f2f1ae4 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.029198 Jul 19 19:40:47.837295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 243/480] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:47.841017 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e4f43ee-2364-4fa5-bc77-18f288ed392e tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101126 Jul 19 19:40:47.848452 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 238/481] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:47.851613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44edae32-f276-4bdf-ab06-83da078d00d3 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Calling method '.version_select at 0x7f23efdbed30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.853088 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:47.853088 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:47.854835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44edae32-f276-4bdf-ab06-83da078d00d3 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:47.856647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843834-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:47.860844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44edae32-f276-4bdf-ab06-83da078d00d3 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/n-d-843834-3/startup HTTP/1.1 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:47.872465 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3'} Jul 19 19:40:47.874089 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:47.875045 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 19:40:47.876909 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.878110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44edae32-f276-4bdf-ab06-83da078d00d3 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.878110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44edae32-f276-4bdf-ab06-83da078d00d3 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-843834-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.031834 Jul 19 19:40:47.878110 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 244/482] 10.222.0.23 () {58 vars in 1190 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-hosts/n-d-843834-3/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:47.880346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:47.881010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.882193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:47.883150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:47.888719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74e8dc7a-0e21-407b-a895-f15024a6da3f tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Calling method '.version_select at 0x7f23efd3aa60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:47.931749 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-74e8dc7a-0e21-407b-a895-f15024a6da3f tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74e8dc7a-0e21-407b-a895-f15024a6da3f tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:47.939954 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hostname'} Jul 19 19:40:47.941538 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:47.942792 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 19:40:47.944160 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:47.945456 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.947700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74e8dc7a-0e21-407b-a895-f15024a6da3f tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.948896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Lazy-loading 'flavor' on Instance uuid ca7f0e5b-032f-427a-8c4a-6d399a525a63 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:47.951955 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74e8dc7a-0e21-407b-a895-f15024a6da3f tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.068549 Jul 19 19:40:47.955958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 245/483] 10.222.0.23 () {58 vars in 1214 bytes} [Tue Jul 19 19:40:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:47.971817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-87895a30-c247-4995-abab-3efe6a8d71a6 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Action: 'update', calling method: .version_select at 0x7f23efd3a550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-87895a30-c247-4995-abab-3efe6a8d71a6 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-hosts/n-d-843834-3 HTTP/1.1 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 51 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:47.982815 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: {"status": "enable", "maintenance_mode": "invalid"} Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:47.984133 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.984923 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:47.986362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:47.987665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:47.987665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:40:47.987665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:40:47.987665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:47.987665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:47.990340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-87895a30-c247-4995-abab-3efe6a8d71a6 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:47.992023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-87895a30-c247-4995-abab-3efe6a8d71a6 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-843834-3" status: 400 len: 199 microversion: 2.1 time: 0.029830 Jul 19 19:40:47.993650 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 246/484] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:47 2022] PUT /compute/v2.1/os-hosts/n-d-843834-3 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:40:48.003876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-238d862d-555f-44e0-9f19-d9975de87e8d tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Action: 'update', calling method: .version_select at 0x7f23efdbed30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-238d862d-555f-44e0-9f19-d9975de87e8d tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-hosts/n-d-843834-3 HTTP/1.1 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 51 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:48.007485 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: {"status": "invalid", "maintenance_mode": "enable"} Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:48.008810 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.009572 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.010999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.017042 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.017042 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:40:48.017042 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:40:48.017042 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 19:40:48.017042 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.018876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-238d862d-555f-44e0-9f19-d9975de87e8d tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:48.019998 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-238d862d-555f-44e0-9f19-d9975de87e8d tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-843834-3" status: 400 len: 189 microversion: 2.1 time: 0.021253 Jul 19 19:40:48.021198 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 247/485] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:47 2022] PUT /compute/v2.1/os-hosts/n-d-843834-3 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:40:48.023271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 while it is in vm_state suspended Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Request method failure captured: Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63/action HTTP/1.1 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 97 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wiSd5D3qtjksln6F9rxDiRFjwI056gyLdhrUMMkRyKdc3wZZDRdhCYgivWt517tU3rcDawXYL-ZAkd7Op8B03hfYxS_eYP0yt7Wnx73jZB3BWm1tYSgBiilpi1-Sga3vI6HWvrXPpvhIfOD3zStq9SrfhhCAEUJWibGXFB2a4uzEFw Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: af9144a21cfd4d2e8de464929fbcf2b3 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:40:48.032101 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af9144a21cfd4d2e8de464929fbcf2b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: af9144a21cfd4d2e8de464929fbcf2b3 Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1087640236 Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-LiveMigrationNegativeTest-1087640236-project-admin Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d75cd0f0c6c54ad6895b43bbc4b54407 Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-LiveMigrationNegativeTest-1087640236-project-admin Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: {"os-migrateLive": {"host": "n-h1-843834-3", "block_migration": true, "disk_over_commit": false}} Jul 19 19:40:48.033492 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'os-migrateLive' instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 while it is in vm_state suspended Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ca7f0e5b-032f-427a-8c4a-6d399a525a63', 'body': {'os-migrateLive': {'host': 'n-h1-843834-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 19:40:48.034216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:48.035268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 while it is in vm_state suspended Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 while it is in vm_state suspended Jul 19 19:40:48.036436 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.042309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 while it is in vm_state suspended {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:48.043606 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-141aa420-5782-40bf-8f11-7c1e83acc70d tempest-LiveMigrationNegativeTest-1087640236 tempest-LiveMigrationNegativeTest-1087640236-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63/action" status: 409 len: 155 microversion: 2.1 time: 0.193959 Jul 19 19:40:48.044743 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 239/486] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:40:47 2022] POST /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63/action => generated 155 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:48.049292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dcdb0f6-dc4f-465b-870e-64cf7ff76d71 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Action: 'update', calling method: .version_select at 0x7f23efd068b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:48.056468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:48.057353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:48.058157 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:40:48.058157 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:40:48.060690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6dcdb0f6-dc4f-465b-870e-64cf7ff76d71 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'cf7a57c1d6414970afba0e27b5189749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d2be76b6e4598acc734eb2f6510ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dcdb0f6-dc4f-465b-870e-64cf7ff76d71 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Request method failure captured: Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-hosts/n-d-843834-3 HTTP/1.1 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 50 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi41Y5W64CysvGX6JPupI4fDspeIXHOjjdTi-e8tKZgtpZRTFkiOjI8rvaCsGWkEWPte6TZ6hgUxVmtSLGyqLmCJ3anVvYF7c_wkvtx2N1qpAp0dTImFeXZ2sXxFEg3EsGnTdWriIzXow7DXpsLmV8obCJ8GD_-Go9pH6jMG-V1OS0 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:48.062621 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/822d2be76b6e4598acc734eb2f6510ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 822d2be76b6e4598acc734eb2f6510ed Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1101221614 Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf7a57c1d6414970afba0e27b5189749 Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1101221614-project Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:40:48.064007 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:48.064857 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 19:40:48.065975 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.070703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dcdb0f6-dc4f-465b-870e-64cf7ff76d71 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:48.070703 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dcdb0f6-dc4f-465b-870e-64cf7ff76d71 tempest-HostsAdminNegativeTestJSON-1101221614 tempest-HostsAdminNegativeTestJSON-1101221614-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-843834-3" status: 403 len: 111 microversion: 2.1 time: 0.035097 Jul 19 19:40:48.075833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.076667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 248/487] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:48 2022] PUT /compute/v2.1/os-hosts/n-d-843834-3 => generated 111 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:48.076923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.078557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.079380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.085884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05f9c611-cfb0-4315-93f4-5868008c12ec tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Action: 'update', calling method: .version_select at 0x7f23efd3ab80>, body: {"status": null, "maintenance_mode": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05f9c611-cfb0-4315-93f4-5868008c12ec tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-hosts/n-d-843834-3 HTTP/1.1 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 42 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:48.088585 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: {"status": null, "maintenance_mode": null} Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:40:48.089940 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'n-d-843834-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance: Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi None Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.090763 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.092170 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05f9c611-cfb0-4315-93f4-5868008c12ec tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-05f9c611-cfb0-4315-93f4-5868008c12ec tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-843834-3" status: 400 len: 127 microversion: 2.1 time: 0.012297 Jul 19 19:40:48.097645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 249/488] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:40:48 2022] PUT /compute/v2.1/os-hosts/n-d-843834-3 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:40:48.100867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Action: 'update', calling method: .version_select at 0x7f23efd73310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:48.104470 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.hosts [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Enabling host nonexistent_hostname. Jul 19 19:40:48.120174 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Request method failure captured: Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 50 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wi6amb3i6sKt6-ACf3y3WJ3Oza05z2CUCbbqnjP0YjqP97K2J2RaXODfEyC4QOzkGeZA0i7-vBTvszwlYDj-s624D5guRPrBUpII0aJQzun95WU1j-_I8yjnozvJLVM_se1S2ar6HfISi3FqLAwDP-5bWhLBteLV1nCFKyY5mz8Hcg Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:40:48.125476 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8957eb0531fa4e9694bed571bef34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8957eb0531fa4e9694bed571bef34a64 Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1955391906 Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 24ab4a7eccf04f2cbc1db4b599a7b265 Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1955391906-project-admin Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:48.127046 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 19:40:48.129136 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:40:48.130383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 19:40:48.132279 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:48.136131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:48.138520 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1e5bfa6-f29b-4d2b-b93b-0707e9a3b176 tempest-HostsAdminNegativeTestJSON-1955391906 tempest-HostsAdminNegativeTestJSON-1955391906-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041069 Jul 19 19:40:48.146655 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 250/489] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:40:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:40:48.157314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-770852389", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:48.174223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:40:48.319143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:48.411796 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-955e3877-f9b3-4599-a124-59aa510d1374 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 204 len: 0 microversion: 2.1 time: 0.359073 Jul 19 19:40:48.412860 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 240/490] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:48 2022] DELETE /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:48.424681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:48.452648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:48.470312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.471131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.472416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.473050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.914133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:48.915491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:48.916217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:48.916856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:48.917711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:48.944623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.950348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.951927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:48.955712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:48.987915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:48.998492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41eac431-a99d-4570-9927-7623eed36765 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1465 microversion: 2.1 time: 0.581229 Jul 19 19:40:49.014760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:49.021780 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 241/491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:48 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1465 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:49.024982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for user f2e7f9d9c6ab4b20aa20b98a514bf701 and project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:49.028180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:49.030493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:49.039280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.039966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.041016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.043248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.054726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:49.061937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:49.161072 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9bd5ab7-50cd-48d1-be3c-de35862ac713 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012197 Jul 19 19:40:49.161720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 251/492] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:40:49.172222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:49.172832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:49.184805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.189797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.190944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.191544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.393641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:49.424545 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-520cd0c9-18ff-4dcf-a849-6396fafb9874 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.398345 Jul 19 19:40:49.425951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 242/493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:49 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:49.441956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70b5aaaa-f619-4c47-8079-6519253a35e2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:49.445239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70b5aaaa-f619-4c47-8079-6519253a35e2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:49.601336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-70b5aaaa-f619-4c47-8079-6519253a35e2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:49.608768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70b5aaaa-f619-4c47-8079-6519253a35e2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1212 microversion: 2.1 time: 0.181526 Jul 19 19:40:49.618595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 243/494] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:49 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1212 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:49.664631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:49.673288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:49.674811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:49.698392 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d58fde1f-4252-4c4e-a8a4-dfa90a0c7c8b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1557 microversion: 2.25 time: 0.535204 Jul 19 19:40:49.725181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79f8d953-70a5-4f7b-8be7-b600895dab33 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '.version_select at 0x7f23efdb4160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:49.727976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79f8d953-70a5-4f7b-8be7-b600895dab33 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.728436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79f8d953-70a5-4f7b-8be7-b600895dab33 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.729984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 252/495] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:49 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1557 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:49.767130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c3b9d3a7-d109-482b-b34d-01e8859de95d req-f2197822-5f9e-4864-8fc9-ba325aec15e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eda853-e022-4da6-bc1d-c038149a4321", "name": "network-vif-plugged", "status": "completed", "tag": "35717b0a-329e-43b8-a123-7e3725aac9aa"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:49.773603 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-79f8d953-70a5-4f7b-8be7-b600895dab33 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.052701 Jul 19 19:40:49.774305 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 244/496] 10.222.0.23 () {60 vars in 1183 bytes} [Tue Jul 19 19:40:49 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:49.795804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3b9d3a7-d109-482b-b34d-01e8859de95d req-f2197822-5f9e-4864-8fc9-ba325aec15e0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.796398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3b9d3a7-d109-482b-b34d-01e8859de95d req-f2197822-5f9e-4864-8fc9-ba325aec15e0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.796485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:49.797139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:49.817104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.819061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.820789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:49.821925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:49.843730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c3b9d3a7-d109-482b-b34d-01e8859de95d req-f2197822-5f9e-4864-8fc9-ba325aec15e0 service nova] Creating event network-vif-plugged:35717b0a-329e-43b8-a123-7e3725aac9aa for instance 17eda853-e022-4da6-bc1d-c038149a4321 on n-h1-843834-3 Jul 19 19:40:49.858789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c3b9d3a7-d109-482b-b34d-01e8859de95d req-f2197822-5f9e-4864-8fc9-ba325aec15e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095354 Jul 19 19:40:49.862503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 253/497] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:50.045393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:50.046129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:50.056150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:50.059280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:50.061109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:50.061698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:50.753229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 8c02c0cd-21e3-4168-a62c-ee9954f13126 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:40:50.803046 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eaee51b4-7d51-4977-9a57-bec42683c5c5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 2050 microversion: 2.25 time: 1.015822 Jul 19 19:40:50.803674 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 245/498] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:49 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 2050 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:40:50.826250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:50.828365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:50.839757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:50.840733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:50.842737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:50.843446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:51.063298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:51.072875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e74caef-4bff-4795-91f0-1c91ffcbcf09 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 200 len: 1465 microversion: 2.1 time: 1.052320 Jul 19 19:40:51.082273 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 254/499] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:50 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 1465 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:51.410801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-468577656", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "9beb335f-2416-419f-a2e8-afe5a9e87165"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:51.510591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] validate_networks() for [('9beb335f-2416-419f-a2e8-afe5a9e87165', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:51.701658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:51.710803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4fc4850-9d62-4492-a6bf-ba3671f39da4 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1390 microversion: 2.1 time: 0.901256 Jul 19 19:40:51.714552 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 246/500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:50 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1390 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:51.731291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:51.732203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:51.765164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:51.772606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:51.773587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:51.774209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:52.176798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:52.192637 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c90ee23c-3382-4805-96fd-1b64e79f6ad6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1270 microversion: 2.1 time: 0.476001 Jul 19 19:40:52.193192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 247/501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:51 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1270 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:52.207198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1021555852", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "e1fb5a5d-f185-4eab-959a-40101db7e714"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:52.291642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] validate_networks() for [('e1fb5a5d-f185-4eab-959a-40101db7e714', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:53.919549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:53.920508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:53.921128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:53.921733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:53.922478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:53.951161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:53.952155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:53.953250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:53.955278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:54.009030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Getting quotas for project d2b974b1f66344cc9a539ccbe7f391ab. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:54.021007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Getting quotas for user ea9cf9a38a804fdc8c053db13a1395be and project d2b974b1f66344cc9a539ccbe7f391ab. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:54.053320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:54.056024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:54.186215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-63abb709-aaf8-4718-a6e1-892b3433bffb tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.111336 Jul 19 19:40:54.186871 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 255/502] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:40:54.217067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:54.217901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: ca7f0e5b-032f-427a-8c4a-6d399a525a63] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:54.231420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:54.233798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:54.235928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:54.236616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:54.285824 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] HTTP exception thrown: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Request method failure captured: Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 HTTP/1.1 Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiRO4jL4Jd9zXA1whuKbzNp_Rg9yzko5X2-Tf20da3kxtlmONio9-n2rz1uVSfDjPY1xXfBjjw7YV-FKz_WGAB_MlBRpIMCgr7t1XnyLl88wNH9pqGvBt6ZUd4L40HJ8M80Ir7wFtJ2_QHpk47wI0K0VuEup5O-wr584KaSW4VFwdQ Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4601171dbe70469f92c46321f5bc303d Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:40:54.288601 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4601171dbe70469f92c46321f5bc303d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4601171dbe70469f92c46321f5bc303d Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveMigrationNegativeTest-937072335-project Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b6cf07e85a804d64be9ec9817cdbba00 Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveMigrationNegativeTest-937072335-project Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. Jul 19 19:40:54.289808 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ca7f0e5b-032f-427a-8c4a-6d399a525a63'} Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:40:54.290513 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. Jul 19 19:40:54.291730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:40:54.299844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Returning 404 to user: Instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:40:54.301626 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-576b6681-2424-4db5-be53-7deb41f3529d tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63" status: 404 len: 111 microversion: 2.1 time: 0.095930 Jul 19 19:40:54.305500 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 256/503] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:54 2022] GET /compute/v2.1/servers/ca7f0e5b-032f-427a-8c4a-6d399a525a63 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:40:54.323933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:54.330095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:54.353619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:54.360389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:54.361872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:54.364832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:55.308418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:55.321197 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7167c601-0ebc-41ee-b8e4-dc08b4603340 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1589 microversion: 2.1 time: 1.013447 Jul 19 19:40:55.335553 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 257/504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:54 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1589 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:55.358728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-626e72e3-0d94-46ec-a497-5318ef7308f7 req-74d42b19-2ee5-47fd-b7e4-2eb7b37d298f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f0e5b-032f-427a-8c4a-6d399a525a63", "name": "network-vif-deleted", "tag": "f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:55.397021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-626e72e3-0d94-46ec-a497-5318ef7308f7 req-74d42b19-2ee5-47fd-b7e4-2eb7b37d298f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:55.405731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-626e72e3-0d94-46ec-a497-5318ef7308f7 req-74d42b19-2ee5-47fd-b7e4-2eb7b37d298f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:55.448329 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-626e72e3-0d94-46ec-a497-5318ef7308f7 req-74d42b19-2ee5-47fd-b7e4-2eb7b37d298f service nova] Creating event network-vif-deleted:f4f48e0b-4d9a-49bf-aa3c-cdbd3ce62ca1 for instance ca7f0e5b-032f-427a-8c4a-6d399a525a63 on n-h2-843834-3 Jul 19 19:40:55.477246 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-626e72e3-0d94-46ec-a497-5318ef7308f7 req-74d42b19-2ee5-47fd-b7e4-2eb7b37d298f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136440 Jul 19 19:40:55.481687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 258/505] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:55.497126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:55.497510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:55.519015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:55.519479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:55.520275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:55.520940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.252487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:40:56.253489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:40:56.254477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:40:56.255474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:40:56.256097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:40:56.287745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.288362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.290811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.293688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.339771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:40:56.349596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for user df971d67f21747f2afa56647d78a7fa5 and project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:40:56.364616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:40:56.368807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:40:56.444365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:56.482951 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72eca66b-bdff-4640-b80f-3f4b79f26e7e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.999619 Jul 19 19:40:56.488930 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 259/506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:55 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:56.493258 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0fa84421-746f-4f57-8184-a69bea1c2dbd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.297688 Jul 19 19:40:56.507915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 248/507] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:40:56.512000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:56.515357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:56.517365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:56.518124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:56.525720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.526563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.527649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.528281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.539473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.541209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.543349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.545542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.608322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:40:56.827650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3692fe66-523c-4be1-8cad-3e5253640a39 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "DELETE /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 204 len: 0 microversion: 2.1 time: 0.317291 Jul 19 19:40:56.828286 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 249/508] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:40:56 2022] DELETE /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:40:56.842582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:56.844116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:56.878018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.881280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.883813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:56.887144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:56.904024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:56.918841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:56.935619 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-99af4e9a-67d5-4944-a8e3-3776c952eb76 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1293 microversion: 2.1 time: 0.439475 Jul 19 19:40:56.936473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 260/509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:56 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1293 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:56.980261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:56.983406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:57.449918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:57.461974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:57.475531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:57.477004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a4f928d-4032-48b5-96f2-b52683de9072 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1262 microversion: 2.25 time: 0.519199 Jul 19 19:40:57.478255 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 261/510] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:56 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1262 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:57.486009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:57.487211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:57.500242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:57.503977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:57.505276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:57.507495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:57.603263 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2eca317-656d-431f-ab8b-a1ea085f9ed5 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.772156 Jul 19 19:40:57.606872 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 250/511] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:40:56 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321/os-interface => generated 285 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:40:57.611957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:57.612842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:57.621883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:57.622554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:57.623670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:57.624296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:58.782157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:58.801083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:58.813241 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9468e10e-e284-438d-a63b-38a44f01f8ae tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1474 microversion: 2.1 time: 1.333566 Jul 19 19:40:58.815363 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 262/512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:57 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1474 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:58.817756 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8c84e4f-d6ba-4568-9d98-242ed7545a4c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 1.209195 Jul 19 19:40:58.818568 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 251/513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:57 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:58.825843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:58.826452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:58.845013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:58.845472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:58.846252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:58.846690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:59.274233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:59.296295 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43fe6892-3a46-4fa4-b768-3d04443d280c tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1281 microversion: 2.1 time: 0.476285 Jul 19 19:40:59.297222 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 252/514] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:58 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1281 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:40:59.316369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:59.316996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:59.333160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:59.333603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:59.334413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:59.334927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:59.489496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-194509427", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:40:59.573814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:40:59.779064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:59.805529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:59.809692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:40:59.811453 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-015f733f-35d1-4a18-920e-fdb830e6e62d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1320 microversion: 2.25 time: 0.512984 Jul 19 19:40:59.825043 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 253/515] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:40:59 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1320 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:40:59.837215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:40:59.839908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:40:59.843371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:40:59.851198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:59.852284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:40:59.853184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:40:59.853712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:00.755033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cf07e85a804d64be9ec9817cdbba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4601171dbe70469f92c46321f5bc303d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:00.765330 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-79d0e17d-3fca-4e78-9cfb-800f1b0d2007 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 200 len: 1432 microversion: 2.1 time: 0.935268 Jul 19 19:41:00.769308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 254/516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:40:59 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 1432 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:00.781890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:00.784731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:00.800136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:00.800607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:00.802659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:00.805284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.468850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:01.479559 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2593dea-f466-4e32-9565-a134c94effb9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.708201 Jul 19 19:41:01.480715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 255/517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:00 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:01.486687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a0434689-aae5-4cee-8644-2f1e35b1b971 req-7c056c39-dac6-49b6-b8c8-609d61a85fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200c5698-0752-4fcd-adf7-80faef3e88f4", "name": "network-vif-deleted", "tag": "6823b436-0731-475e-94b7-324ea5a00ffd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:01.497334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a0434689-aae5-4cee-8644-2f1e35b1b971 req-7c056c39-dac6-49b6-b8c8-609d61a85fda service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.497847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a0434689-aae5-4cee-8644-2f1e35b1b971 req-7c056c39-dac6-49b6-b8c8-609d61a85fda service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.516577 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a0434689-aae5-4cee-8644-2f1e35b1b971 req-7c056c39-dac6-49b6-b8c8-609d61a85fda service nova] Creating event network-vif-deleted:6823b436-0731-475e-94b7-324ea5a00ffd for instance 200c5698-0752-4fcd-adf7-80faef3e88f4 on n-h2-843834-3 Jul 19 19:41:01.524018 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a0434689-aae5-4cee-8644-2f1e35b1b971 req-7c056c39-dac6-49b6-b8c8-609d61a85fda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041275 Jul 19 19:41:01.525671 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 256/518] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:01.535340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:01.537014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:01.546771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.547704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.549363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.551298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.741470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:01.773482 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa8e96b5-9381-4389-ab12-ff4451e77a03 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1281 microversion: 2.1 time: 0.246366 Jul 19 19:41:01.778932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 257/519] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:01 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:01.793242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:01.794216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:01.808603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.809957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.811471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.812457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.879271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:01.880303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:01.881222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:01.882386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:01.883368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:01.895107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.895842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.896985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:01.897689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:01.922144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Getting quotas for project 18380558db0c48d5b36915e4d6762a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:01.927950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Getting quotas for user 26c9a76c91e24c16ad70bf0434eb0dd6 and project 18380558db0c48d5b36915e4d6762a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:01.942643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:01.946294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:02.011208 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b598049-de9d-4bfb-970a-1792b0ac44da tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.194535 Jul 19 19:41:02.012666 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 263/520] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:41:02.022170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:02.023238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] [instance: 200c5698-0752-4fcd-adf7-80faef3e88f4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:02.033179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:02.034560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:02.035679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:02.036501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:02.056984 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] HTTP exception thrown: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Request method failure captured: Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 HTTP/1.1 Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiRO4jL4Jd9zXA1whuKbzNp_Rg9yzko5X2-Tf20da3kxtlmONio9-n2rz1uVSfDjPY1xXfBjjw7YV-FKz_WGAB_MlBRpIMCgr7t1XnyLl88wNH9pqGvBt6ZUd4L40HJ8M80Ir7wFtJ2_QHpk47wI0K0VuEup5O-wr584KaSW4VFwdQ Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4601171dbe70469f92c46321f5bc303d Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:41:02.059428 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4601171dbe70469f92c46321f5bc303d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4601171dbe70469f92c46321f5bc303d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4601171dbe70469f92c46321f5bc303d Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-937072335 Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveMigrationNegativeTest-937072335-project Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b6cf07e85a804d64be9ec9817cdbba00 Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveMigrationNegativeTest-937072335-project Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. Jul 19 19:41:02.060851 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '200c5698-0752-4fcd-adf7-80faef3e88f4'} Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:02.061561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. Jul 19 19:41:02.062732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:02.068919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] Returning 404 to user: Instance 200c5698-0752-4fcd-adf7-80faef3e88f4 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:02.078221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ce99b90-e21f-4ea5-9f94-ca831e3e12d9 tempest-LiveMigrationNegativeTest-937072335 tempest-LiveMigrationNegativeTest-937072335-project] 10.222.0.23 "GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4" status: 404 len: 111 microversion: 2.1 time: 0.064039 Jul 19 19:41:02.079417 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 264/521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:02 2022] GET /compute/v2.1/servers/200c5698-0752-4fcd-adf7-80faef3e88f4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:02.090509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-107de792-7429-4818-8836-9b54560e04e0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:02.091166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-107de792-7429-4818-8836-9b54560e04e0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:02.102323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:02.518372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-107de792-7429-4818-8836-9b54560e04e0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:02.526332 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-107de792-7429-4818-8836-9b54560e04e0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1221 microversion: 2.1 time: 0.444890 Jul 19 19:41:02.538365 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 265/522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:02 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1221 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:02.543321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:02.543937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:02.551185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:02.551641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:02.552613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:02.552860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:03.137203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:03.153182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:03.158493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:03.162127 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84010393-8cb7-46e7-9578-49c72e23c3be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 1.380604 Jul 19 19:41:03.165851 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 258/523] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:01 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:03.178892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:03.183717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:03.203559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:03.204013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:03.206305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:03.207088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:03.925772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:03.958786 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-815371c4-3b08-46b5-9bb7-239ebc3d5169 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 1.417946 Jul 19 19:41:03.959510 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 266/524] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:02 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:03.972227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4a1367ea-546c-4d4a-82ad-52cfbb60a554 req-2e7328a1-5f38-4013-8911-fae9449cc65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:04.021002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4a1367ea-546c-4d4a-82ad-52cfbb60a554 req-2e7328a1-5f38-4013-8911-fae9449cc65f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.021460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4a1367ea-546c-4d4a-82ad-52cfbb60a554 req-2e7328a1-5f38-4013-8911-fae9449cc65f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:04.066519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4a1367ea-546c-4d4a-82ad-52cfbb60a554 req-2e7328a1-5f38-4013-8911-fae9449cc65f service nova] Creating event network-changed:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h2-843834-3 Jul 19 19:41:04.092155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4a1367ea-546c-4d4a-82ad-52cfbb60a554 req-2e7328a1-5f38-4013-8911-fae9449cc65f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127795 Jul 19 19:41:04.095613 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 267/525] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:04.102975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e44c6802-2d2a-46b0-8f10-586736549e31 req-b94e3bb0-0821-4b36-b593-45d007a57dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:04.112151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e44c6802-2d2a-46b0-8f10-586736549e31 req-b94e3bb0-0821-4b36-b593-45d007a57dc3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.112818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e44c6802-2d2a-46b0-8f10-586736549e31 req-b94e3bb0-0821-4b36-b593-45d007a57dc3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:04.139056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e44c6802-2d2a-46b0-8f10-586736549e31 req-b94e3bb0-0821-4b36-b593-45d007a57dc3 service nova] Creating event network-changed:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h2-843834-3 Jul 19 19:41:04.144476 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e44c6802-2d2a-46b0-8f10-586736549e31 req-b94e3bb0-0821-4b36-b593-45d007a57dc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047338 Jul 19 19:41:04.145296 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 268/526] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:04.151233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:04.151934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:04.158847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.159355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:04.160140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.160578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:04.802818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:04.817489 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06854269-60ea-4938-8fff-4e55399ad08a tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1291 microversion: 2.1 time: 0.670233 Jul 19 19:41:04.818435 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 269/527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:04 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1291 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:04.833720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:04.835231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:04.859169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.868775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:04.870448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:04.871072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:05.221736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:05.252785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-86047c54-4765-41b8-944d-16f734884b32 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 2.084317 Jul 19 19:41:05.253542 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 259/528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:03 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:05.270065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:05.270682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:05.310557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:05.313520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:05.314573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:05.319927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:05.753342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:05.771486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:05.773400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:05.779132 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9c8a3bb-ed72-43cc-b5cb-db659622c686 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 0.955253 Jul 19 19:41:05.781685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 270/529] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:04 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:05.804312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:05.804957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:05.814867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:05.816037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:05.817534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:05.818189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.265786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:06.275470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35c8f8a5-77af-48b1-8b58-06dd07f8827f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 1.017922 Jul 19 19:41:06.276448 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 260/530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:05 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:06.297235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:06.297918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:06.311671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.312123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.316163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.316835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.370771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:06.373835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:06.542296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:06.550580 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f829bc1c-b55d-4bab-942f-ae8f908ab978 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1279 microversion: 2.1 time: 0.271468 Jul 19 19:41:06.554993 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 261/531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:06 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:06.569447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9afa6051-62aa-4e36-939a-974a3f1a09a0 req-61c8b1a0-f82e-47cb-b408-7f359195bcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eda853-e022-4da6-bc1d-c038149a4321", "tag": "35717b0a-329e-43b8-a123-7e3725aac9aa"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:06.570544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:06.586127 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0bd63a0-9e83-40e6-8d92-913a280a5016 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1589 microversion: 2.1 time: 0.802902 Jul 19 19:41:06.591198 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 271/532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:05 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1589 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:06.601437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:06.604305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:06.604490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9afa6051-62aa-4e36-939a-974a3f1a09a0 req-61c8b1a0-f82e-47cb-b408-7f359195bcb8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.606181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9afa6051-62aa-4e36-939a-974a3f1a09a0 req-61c8b1a0-f82e-47cb-b408-7f359195bcb8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.621489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.622265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.624183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.626879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.640425 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9afa6051-62aa-4e36-939a-974a3f1a09a0 req-61c8b1a0-f82e-47cb-b408-7f359195bcb8 service nova] Creating event network-changed:35717b0a-329e-43b8-a123-7e3725aac9aa for instance 17eda853-e022-4da6-bc1d-c038149a4321 on n-h1-843834-3 Jul 19 19:41:06.656947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9afa6051-62aa-4e36-939a-974a3f1a09a0 req-61c8b1a0-f82e-47cb-b408-7f359195bcb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100338 Jul 19 19:41:06.667362 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 262/533] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:06.802486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:06.803696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:06.818765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.820697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:06.822760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:06.825522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:07.479738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:07.497259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:07.501925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:07.506370 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03dbe8d4-fd49-4f6a-bcd8-8b815f7ce429 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 0.707933 Jul 19 19:41:07.509164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 263/534] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:06 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:41:07.533357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:07.534356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:07.545705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:07.548014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:07.549772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:07.550424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:08.086045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:08.103904 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-11369458-dce5-4ec4-a419-7e8fc67085d0 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 1.510960 Jul 19 19:41:08.116167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 272/535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:06 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:08.121609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:08.122417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:08.133237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:08.135824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:08.137340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:08.139656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:08.183908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:08.192340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:08.217228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-77af697a-6e03-432e-94fd-d2eb87bafd1b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.705883 Jul 19 19:41:08.219607 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 264/536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:07 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:08.530792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:08.531705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:08.548191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:08.549038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:08.551169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:08.553514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:08.837552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:08.846548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5123871a-5f36-464e-8e59-1494de02e798 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.728905 Jul 19 19:41:08.847182 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 273/537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:08 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:08.946166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e3dac1d2-96f3-4522-9591-d70d2e27affd req-77327880-435d-49a8-9050-7900901584ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:08.971499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e3dac1d2-96f3-4522-9591-d70d2e27affd req-77327880-435d-49a8-9050-7900901584ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:08.972065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e3dac1d2-96f3-4522-9591-d70d2e27affd req-77327880-435d-49a8-9050-7900901584ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:09.004360 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e3dac1d2-96f3-4522-9591-d70d2e27affd req-77327880-435d-49a8-9050-7900901584ef service nova] Creating event network-changed:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:41:09.015785 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e3dac1d2-96f3-4522-9591-d70d2e27affd req-77327880-435d-49a8-9050-7900901584ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073592 Jul 19 19:41:09.016762 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 274/538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:41:09.123205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:09.123205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:09.138507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:09.139768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:09.140469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:09.140907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:09.835631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:09.848414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:09.853918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:09.856743 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0fc43b33-dd6e-4e2e-a5cc-a138fcd31b6b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 1.329499 Jul 19 19:41:09.858530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 265/539] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:08 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:09.873403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:09.874269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:09.884714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:09.887412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:09.889496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:09.903908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:10.110509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:10.120325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd00f3f8-a21e-477c-a0b9-0391d4dd82f3 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 1.002030 Jul 19 19:41:10.123345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 275/540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:09 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:10.137385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:10.138264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:10.156808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:10.157492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:10.159450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:10.163024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:10.645028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:10.653385 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa936ff3-8b4e-494c-b786-cecfab593133 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.791950 Jul 19 19:41:10.653968 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 266/541] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:09 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:10.659111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b18e25e3-c2c8-475d-97d9-c80e700851c4 req-baec463e-28bf-4892-b889-e8f3a2724184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07331d7e-a7dd-4e6b-97d8-7900fd948d0d", "tag": "0294373d-4a74-4d08-82a4-7b894a11394c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:10.676365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b18e25e3-c2c8-475d-97d9-c80e700851c4 req-baec463e-28bf-4892-b889-e8f3a2724184 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:10.677059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b18e25e3-c2c8-475d-97d9-c80e700851c4 req-baec463e-28bf-4892-b889-e8f3a2724184 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:10.710198 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b18e25e3-c2c8-475d-97d9-c80e700851c4 req-baec463e-28bf-4892-b889-e8f3a2724184 service nova] Creating event network-changed:0294373d-4a74-4d08-82a4-7b894a11394c for instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d on n-h1-843834-3 Jul 19 19:41:10.720211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b18e25e3-c2c8-475d-97d9-c80e700851c4 req-baec463e-28bf-4892-b889-e8f3a2724184 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064474 Jul 19 19:41:10.721409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 267/542] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:10.902494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:10.914366 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44c73f7d-ff4a-4b1b-bc87-92ebe164d2c9 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.786530 Jul 19 19:41:10.916154 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 276/543] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:10 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:10.941233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:10.944653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:10.961520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:10.963656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25c17a00-5193-4118-840f-c25af8b05084 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] Calling method '.version_select at 0x7f23fc0203a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:10.966273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:10.967509 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:10.967509 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:41:10.968968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:10.972749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:11.003351 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25c17a00-5193-4118-840f-c25af8b05084 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.280443 Jul 19 19:41:11.011688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 268/544] 10.222.0.23 () {60 vars in 1225 bytes} [Tue Jul 19 19:41:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:11.023166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca80e99d-6f01-448a-8fda-cada7dd964ec tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] Action: 'update', calling method: .version_select at 0x7f23efdad820>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:11.032067 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:11.032067 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:41:11.488337 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca80e99d-6f01-448a-8fda-cada7dd964ec tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.468959 Jul 19 19:41:11.494962 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 269/545] 10.222.0.23 () {62 vars in 1246 bytes} [Tue Jul 19 19:41:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:11.502941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:11.503922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:11.513204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:11.513957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:11.514995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:11.515618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:11.719453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:11.737760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:11.754422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:11.770878 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-deec4f40-88ea-4f46-a09c-0ea56513c78e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 0.837450 Jul 19 19:41:11.772313 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 277/546] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:10 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:11.778068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61bc42c3-58b6-4d78-8f31-911221ae3539 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] Calling method '.version_select at 0x7f23efcff700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:11.779301 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:11.779301 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:41:11.795930 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61bc42c3-58b6-4d78-8f31-911221ae3539 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021378 Jul 19 19:41:11.797406 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 278/547] 10.222.0.23 () {60 vars in 1225 bytes} [Tue Jul 19 19:41:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:11.806613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:11.810280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:11.818831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:11.819703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:11.821136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:11.821784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:11.867825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:11.878427 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af53c7d4-ea8f-4010-b2ed-01762b6e955b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.381486 Jul 19 19:41:11.879936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 270/548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:11 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:11.884709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e3209c0-44f6-4088-90a7-4fb0fe686ee6 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] Action: 'update', calling method: .version_select at 0x7f23fc0203a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:11.889264 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:11.889264 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:41:11.916556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:12.022074 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e3209c0-44f6-4088-90a7-4fb0fe686ee6 tempest-QuotaClassesAdmin257Test-954106280 tempest-QuotaClassesAdmin257Test-954106280-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.140928 Jul 19 19:41:12.023941 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 271/549] 10.222.0.23 () {62 vars in 1246 bytes} [Tue Jul 19 19:41:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:12.030073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c2e83300-239a-4c26-95a4-ef65192e542b req-b976e301-366f-4576-98e8-bb7251e8834d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "name": "network-vif-plugged", "status": "completed", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:12.042312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c2e83300-239a-4c26-95a4-ef65192e542b req-b976e301-366f-4576-98e8-bb7251e8834d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.043471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c2e83300-239a-4c26-95a4-ef65192e542b req-b976e301-366f-4576-98e8-bb7251e8834d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.060850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:12.063454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c2e83300-239a-4c26-95a4-ef65192e542b req-b976e301-366f-4576-98e8-bb7251e8834d service nova] Creating event network-vif-plugged:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h2-843834-3 Jul 19 19:41:12.072028 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c2e83300-239a-4c26-95a4-ef65192e542b req-b976e301-366f-4576-98e8-bb7251e8834d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044748 Jul 19 19:41:12.073360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 272/550] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:12.097086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:12.098184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:12.148223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:12.149123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.149836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.151967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.153715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.163823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5d482a8-9b96-4f9b-9402-674d3a19c918 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.364448 Jul 19 19:41:12.168178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 279/551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:11 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:12.410987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:12.432651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7940dec-6aa8-45d6-8db9-f66cafa7cfc5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.355973 Jul 19 19:41:12.436901 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 273/552] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:12 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:12.798671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:12.800277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:12.813449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.813901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.814694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.815156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.898625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:12.900507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:12.913104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.913805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:12.915481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:12.916096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:13.529098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:13.552147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:13.573056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:13.577593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e61b58b-e7b3-4e6d-ad67-3998fcd826fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1362 microversion: 2.25 time: 0.785430 Jul 19 19:41:13.579471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 280/553] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:12 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1362 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:13.585269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:13.586263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:13.597269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:13.598480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:13.600873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:13.601749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:13.766227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:13.796219 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c36d6c9d-b53a-414b-9f40-92e19f9ca2ee tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.902476 Jul 19 19:41:13.806658 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 274/554] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:12 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:41:13.812208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:13.813038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:13.825439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:13.826141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:13.829287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:13.829996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.014860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:14.031345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f148abba-1ab0-436e-a53d-348f498ca3ce tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.450520 Jul 19 19:41:14.032600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 281/555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:13 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:14.153494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c87712aa-9a3f-4f03-ae61-21a07db0eca8 req-276a94c3-ae8a-41c8-80fb-3ce21d379122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "name": "network-vif-plugged", "status": "completed", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:14.174628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c87712aa-9a3f-4f03-ae61-21a07db0eca8 req-276a94c3-ae8a-41c8-80fb-3ce21d379122 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.175423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c87712aa-9a3f-4f03-ae61-21a07db0eca8 req-276a94c3-ae8a-41c8-80fb-3ce21d379122 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.191109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c87712aa-9a3f-4f03-ae61-21a07db0eca8 req-276a94c3-ae8a-41c8-80fb-3ce21d379122 service nova] Creating event network-vif-plugged:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h2-843834-3 Jul 19 19:41:14.197159 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c87712aa-9a3f-4f03-ae61-21a07db0eca8 req-276a94c3-ae8a-41c8-80fb-3ce21d379122 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047642 Jul 19 19:41:14.198411 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 282/556] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:14.418704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:14.429997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f42b937f-91ec-4794-84e1-235a1d425cd1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.621803 Jul 19 19:41:14.430595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 275/557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:13 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:14.597086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:14.597965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:14.609922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.610657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.612780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.615479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.813436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:14.814067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:14.820948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.821681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.822620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.823246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.858784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:14.872485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:14.874353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:14.876115 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2699a8c-6ee2-4ff9-85b9-a5b3eb473972 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1558 microversion: 2.25 time: 0.283359 Jul 19 19:41:14.878075 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 283/558] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:14 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:14.897717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:14.898776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:14.906379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.907366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:14.908406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:14.909055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.158555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:15.168946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92ddf440-159a-4a96-b08d-355dabb3782e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.359297 Jul 19 19:41:15.172931 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 276/559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:14 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:15.185168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:15.186602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:15.200229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.200701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.201492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.201933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.278841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid fc6ca356-1a3a-4e44-b72f-59efa620c174 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:15.320688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f180cf2c-201c-421d-89eb-925886f53749 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 2051 microversion: 2.25 time: 0.424618 Jul 19 19:41:15.324205 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 284/560] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:14 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 2051 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:41:15.345861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:15.347246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:15.371390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.372232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.373431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.374461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.626772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:15.644984 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d93a55fb-bd38-4e1b-880c-7b2361c1faf0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1312 microversion: 2.1 time: 0.465238 Jul 19 19:41:15.657232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 277/561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:15 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:15.668454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:15.670999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:15.684714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid fc6ca356-1a3a-4e44-b72f-59efa620c174 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:15.690245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.691021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.692451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:15.693080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:15.712837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9912e29-5902-4405-bdd2-3d57ef2f8fcb tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 2051 microversion: 2.25 time: 0.371504 Jul 19 19:41:15.725042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 285/562] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:15 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 2051 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:41:15.987240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1113559152", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "45b415df-4896-4487-90b1-97e9e05cd7c2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:16.012733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:16.022166 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cb179ed-6592-4656-8c03-5581247b5ca0 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.361409 Jul 19 19:41:16.023990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 278/563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:15 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:16.041132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:16.050509 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:16.050509 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:41:16.057848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.069222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:16.072707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.073458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:16.111424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] validate_networks() for [('45b415df-4896-4487-90b1-97e9e05cd7c2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:16.152089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:16.167783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7261416a-75b6-4a2a-ab7b-78487360078f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.142556 Jul 19 19:41:16.175703 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 279/564] 10.222.0.23 () {60 vars in 1216 bytes} [Tue Jul 19 19:41:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:16.190081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:16.190950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:16.204739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.205389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:16.207161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.208117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:16.377840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8359a1e7-bc8b-4daa-9f79-4425f8c68959 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174/action" status: 202 len: 0 microversion: 2.25 time: 0.200447 Jul 19 19:41:16.382453 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 280/565] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:41:16 2022] POST /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:41:16.412068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:16.414015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:16.456684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.457160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:16.462619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:16.463459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.339151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:17.353863 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb681f0f-be49-4cdc-bfed-729e0708b772 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.956356 Jul 19 19:41:17.354832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 281/566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:16 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:17.364113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:17.365969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:17.379254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.380002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.381019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.381609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.783258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:17.783767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:17.784135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:17.784557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:17.784961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:17.804883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=25 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:17.807727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.808447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.808990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.809428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.846221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:17.875356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for user cf462f1353f342b395e856a1f3cbafb2 and project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:17.914529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:17.934144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid fc6ca356-1a3a-4e44-b72f-59efa620c174 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:17.952447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:17.962947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b909e96-0cd5-47a1-91d3-ce497c606382 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 2036 microversion: 2.25 time: 0.606948 Jul 19 19:41:17.964813 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 282/567] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:17 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 2036 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:17.970981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:17.971952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:17.993888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.995750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:17.998234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:17.998709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.025357 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c819f2d-7f7e-4055-9a53-a3774902de00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.310302 Jul 19 19:41:18.029487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 286/568] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:41:18.040839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:18.041470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:18.061826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.061949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.062661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.063146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.737459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:18.748668 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88c6376f-7e34-46d0-a944-ae61b77fc28e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1462 microversion: 2.1 time: 0.782636 Jul 19 19:41:18.752424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 283/569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:17 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1462 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:18.772841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843834-3", "block_migration": "auto"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:18.774570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:18.782823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.783688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.785670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.786376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.831120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:18.848624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc494040-d473-4209-b565-8407c119f7fa tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.812462 Jul 19 19:41:18.864425 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 287/570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:18 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:18.882056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:18.882670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:18.918611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.920693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'flavor' on Instance uuid fc6ca356-1a3a-4e44-b72f-59efa620c174 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:18.921232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.925011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:18.928741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:18.972469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Going to try to live migrate instance to n-h1-843834-3 {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:41:19.146372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:19.158733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0517c243-49bb-47a3-87be-047ac2a75ace tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1212 microversion: 2.1 time: 0.291521 Jul 19 19:41:19.174122 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 288/571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:18 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1212 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:19.187982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:19.193010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:19.225355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:19.227436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:19.233289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:19.235216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:19.667237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:19.690105 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c827697-95db-4198-a1dc-1b61ae7e1405 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.511283 Jul 19 19:41:19.692917 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 289/572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:19 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:19.711476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:19.713473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:19.720824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:19.721645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:19.722640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:19.723511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:20.308953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:20.316521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:41:20.334669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:20.335111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:20.335588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:20.336031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:20.336406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:20.604162 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b84c2c96-9467-4839-8910-1b3a6bd23dbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8/action" status: 202 len: 0 microversion: 2.1 time: 0.908575 Jul 19 19:41:20.606348 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 290/573] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:19 2022] POST /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8/action => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:20.613122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:20.615949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:20.627992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:20.636339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:20.639313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:20.639776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:20.669433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:21.041548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:21.051734 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8fea2813-1900-4f5e-a991-be4ef457f481 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.444186 Jul 19 19:41:21.066532 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 291/574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:20 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:21.073678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:21.076589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:21.099226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.099824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:21.100785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.101464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:21.296048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:21.309576 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6aca08bc-df6c-447e-acb1-a97f8b898ec9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1266 microversion: 2.1 time: 0.240319 Jul 19 19:41:21.310505 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 292/575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:21 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:21.315826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:21.316669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:21.333961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.334418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:21.339758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.340258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:21.796809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:21.813538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68e804f1-77f3-4a73-aa21-922465196098 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1471 microversion: 2.1 time: 0.500934 Jul 19 19:41:21.814833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 293/576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:21 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:21.828934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:21.830390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:21.839686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.840441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:21.842023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:21.843339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.022012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:22.128282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:22.135993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18790bba-e6e2-48cc-982f-07976fdc6f0f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.319775 Jul 19 19:41:22.136532 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 294/577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:21 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:22.145144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-93b35e85-7b00-4840-b172-d6f448c39c49 req-1a48015e-027f-4c41-b656-d42ec9ac6f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07331d7e-a7dd-4e6b-97d8-7900fd948d0d", "name": "network-vif-plugged", "status": "completed", "tag": "0294373d-4a74-4d08-82a4-7b894a11394c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:22.169158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-93b35e85-7b00-4840-b172-d6f448c39c49 req-1a48015e-027f-4c41-b656-d42ec9ac6f90 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:22.169708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-93b35e85-7b00-4840-b172-d6f448c39c49 req-1a48015e-027f-4c41-b656-d42ec9ac6f90 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.215990 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-93b35e85-7b00-4840-b172-d6f448c39c49 req-1a48015e-027f-4c41-b656-d42ec9ac6f90 service nova] Creating event network-vif-plugged:0294373d-4a74-4d08-82a4-7b894a11394c for instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d on n-h1-843834-3 Jul 19 19:41:22.236388 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-93b35e85-7b00-4840-b172-d6f448c39c49 req-1a48015e-027f-4c41-b656-d42ec9ac6f90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096030 Jul 19 19:41:22.240722 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 295/578] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:22.267899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:22.275522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:22.295780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:22.301431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.302856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:22.303547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.525814 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4da4685c-0ab5-4446-9bb6-f19e9618a2d5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174/action" status: 202 len: 0 microversion: 2.25 time: 3.757944 Jul 19 19:41:22.528673 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 284/579] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:41:18 2022] POST /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174/action => generated 0 bytes in 3776 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:41:22.540809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:22.542704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:22.556081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:22.559715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.561356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:22.562043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:22.982634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:22.993417 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30fe19c5-56dc-4ae9-9740-10870fe6dea5 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.748052 Jul 19 19:41:23.003655 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 296/580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:22 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:23.003655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:23.003655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:23.010860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.011461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.012363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.013040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.233659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:23.244756 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f40dec5d-a3f3-465a-ad9f-33abd769f55c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.714663 Jul 19 19:41:23.251808 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 285/581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:22 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:23.262729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:23.263386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:23.271365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.272040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.272968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.273557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.597085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:23.612208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:23.613772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:23.620065 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b352168-792d-4a9d-8816-4560be4e151b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1568 microversion: 2.25 time: 0.618507 Jul 19 19:41:23.621146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 297/582] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:22 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1568 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:23.635916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:23.636539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:23.647370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.647830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.648641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:23.652731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:23.776844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:23.784485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:23.790132 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cb2efea-37fc-4990-b2f0-3a3798374507 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1471 microversion: 2.1 time: 0.535021 Jul 19 19:41:23.791260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 286/583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:23 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1471 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:24.013738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:24.014788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:24.020939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:24.028357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:24.029484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:24.030676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:24.032455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:24.039144 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9c51e5a-8832-4381-9ced-9bf706497723 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.404885 Jul 19 19:41:24.046658 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 298/584] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:23 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:24.274506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ba3eb15d-f54f-42c8-bbbf-daa5971f3b5e req-295a7c71-56d2-423b-8b51-2c477f925caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "name": "network-vif-plugged", "status": "completed", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:24.289295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ba3eb15d-f54f-42c8-bbbf-daa5971f3b5e req-295a7c71-56d2-423b-8b51-2c477f925caf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:24.290120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ba3eb15d-f54f-42c8-bbbf-daa5971f3b5e req-295a7c71-56d2-423b-8b51-2c477f925caf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:24.306741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ba3eb15d-f54f-42c8-bbbf-daa5971f3b5e req-295a7c71-56d2-423b-8b51-2c477f925caf service nova] Creating event network-vif-plugged:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:41:24.312376 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ba3eb15d-f54f-42c8-bbbf-daa5971f3b5e req-295a7c71-56d2-423b-8b51-2c477f925caf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050410 Jul 19 19:41:24.313723 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 299/585] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:41:24.321908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:24.322805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:24.330817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:24.331619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:24.332652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:24.333300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:24.825381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:24.856435 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65cb43cd-e1bd-4f5c-901d-8f28e27b486d tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1321 microversion: 2.1 time: 0.847727 Jul 19 19:41:24.857414 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 287/586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:24 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:24.992747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-558740290", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:25.049196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:25.230487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:25.258606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b62a9f1-cb71-42b2-9235-d234ac7139dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.943369 Jul 19 19:41:25.271936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 300/587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:24 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:25.278387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:25.279774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:25.290693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.291841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.293008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.293602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.734785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:25.735741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:25.736358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:25.737386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:25.740198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:25.750833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.751430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.752255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.752684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.767987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:25.772686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Getting quotas for project cdaf8ef9f1624f89b42a0d469639a42d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:25.777848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Getting quotas for user 7a21174a3ac24bd7879b0cca7753f0af and project cdaf8ef9f1624f89b42a0d469639a42d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:25.788673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:25.790235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:25.791184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:25.791647 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dde2ba21-eda8-4726-9b5a-5266188c8ad6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1568 microversion: 2.25 time: 0.518883 Jul 19 19:41:25.793629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:25.803641 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 301/588] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:25 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:25.809203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b29abf48-f8d7-4d33-b7e6-14d2f4de2585 req-1715b819-2873-4031-a8ea-bb9b0ee772f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff7eeea-caec-4195-bc05-20d03a396763", "tag": "50297935-5077-4746-8d82-c394ebb3d29f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:25.819128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b29abf48-f8d7-4d33-b7e6-14d2f4de2585 req-1715b819-2873-4031-a8ea-bb9b0ee772f8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.819975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b29abf48-f8d7-4d33-b7e6-14d2f4de2585 req-1715b819-2873-4031-a8ea-bb9b0ee772f8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.833299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b29abf48-f8d7-4d33-b7e6-14d2f4de2585 req-1715b819-2873-4031-a8ea-bb9b0ee772f8 service nova] Creating event network-changed:50297935-5077-4746-8d82-c394ebb3d29f for instance 3ff7eeea-caec-4195-bc05-20d03a396763 on n-h2-843834-3 Jul 19 19:41:25.839139 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b29abf48-f8d7-4d33-b7e6-14d2f4de2585 req-1715b819-2873-4031-a8ea-bb9b0ee772f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 Jul 19 19:41:25.840315 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 302/589] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:25.844537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99688865-cb0b-4068-914e-ac8788b353cd tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985661 Jul 19 19:41:25.845499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 288/590] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:41:25.852244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:25.852698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:25.853204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:25.853564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:25.860949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.861146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.861390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.861552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.862180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.862488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:25.862935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:25.863114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.253224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:26.255937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:26.263206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-833b4d99-ce67-4706-b23b-65bc487fd10b tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1323 microversion: 2.1 time: 0.415957 Jul 19 19:41:26.264056 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 289/591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:25 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:26.271543 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f67263a-e7a4-4b61-9c07-76564679d18d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.429665 Jul 19 19:41:26.281426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f536bc36-7771-4258-af84-275a1b44ac31 req-de82fabe-88cd-44f7-a0f1-f8a6f4980214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "name": "network-vif-unplugged", "status": "completed", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:26.281992 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 303/592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:25 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:26.287033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cabf9b0e-9b60-493f-aaa9-25fbb0637665 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:26.287820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cabf9b0e-9b60-493f-aaa9-25fbb0637665 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:26.289035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f536bc36-7771-4258-af84-275a1b44ac31 req-de82fabe-88cd-44f7-a0f1-f8a6f4980214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.289552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f536bc36-7771-4258-af84-275a1b44ac31 req-de82fabe-88cd-44f7-a0f1-f8a6f4980214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.305126 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f536bc36-7771-4258-af84-275a1b44ac31 req-de82fabe-88cd-44f7-a0f1-f8a6f4980214 service nova] Creating event network-vif-unplugged:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h2-843834-3 Jul 19 19:41:26.311267 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f536bc36-7771-4258-af84-275a1b44ac31 req-de82fabe-88cd-44f7-a0f1-f8a6f4980214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045561 Jul 19 19:41:26.318335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 290/593] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:26.327535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:26.328481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:26.336796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.337684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.338471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.338905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.364733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabf9b0e-9b60-493f-aaa9-25fbb0637665 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:26.372249 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cabf9b0e-9b60-493f-aaa9-25fbb0637665 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1213 microversion: 2.1 time: 0.088982 Jul 19 19:41:26.372831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 304/594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:26 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:26.388912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:26.389631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:26.392244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:26.406187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.406943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.408423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.408727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.644164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:26.651963 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cb18f2e-399c-49af-8794-c435dd9489ef tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1471 microversion: 2.1 time: 0.330612 Jul 19 19:41:26.652776 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 291/595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:26 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:26.688665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:26.702270 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6da4aa0-9fe9-4953-96c0-7c1cd6b3b7f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.327022 Jul 19 19:41:26.703238 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 305/596] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:26 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:26.814825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:26.817126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:26.825275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.826112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.827606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:26.828308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:26.830989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:26.831600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] [instance: 6235adb5-6952-43d2-8bdc-05ffd5363152] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:26.838578 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] HTTP exception thrown: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Request method failure captured: Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/6235adb5-6952-43d2-8bdc-05ffd5363152/action HTTP/1.1 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 15 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjJ21_SwtsP7soHZcQdlmGT_mwj9G9NL8d0Tv-ItJSydMbMBaU9usyTV_8neqfcyHZX_HmvHoh1LFF6lyUq7O1_xYRnOZWcx-1SbiarjmueLH5p6plVTMVlCIhR4g3Cts9X566ofx6rsetFflCIYHaJk90mwfhmjpmJwNRulRcO3l4 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:41:26.840389 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faef2728380045ccaf6e58ec80538629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faef2728380045ccaf6e58ec80538629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2260a0b6814a4cd7a7802e3acc8209cb Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: {"migrate": {}} Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:26.841794 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6235adb5-6952-43d2-8bdc-05ffd5363152', 'body': {'migrate': {}}} Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:26.842633 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. Jul 19 19:41:26.843991 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:26.845546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Returning 404 to user: Instance 6235adb5-6952-43d2-8bdc-05ffd5363152 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:26.845546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c40eebd-9bdc-40d1-bb15-ca985d6b433c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6235adb5-6952-43d2-8bdc-05ffd5363152/action" status: 404 len: 111 microversion: 2.1 time: 0.176385 Jul 19 19:41:26.845546 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 292/597] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:26 2022] POST /compute/v2.1/servers/6235adb5-6952-43d2-8bdc-05ffd5363152/action => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:26.945465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-149381360", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:27.008200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:27.113713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:27.126472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:27.131568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:27.133501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-73958fd2-6b6f-42f3-8d91-33f3518502be tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1568 microversion: 2.25 time: 0.327459 Jul 19 19:41:27.134288 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 306/598] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:26 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:27.284502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:27.285154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:27.295788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:27.298450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:27.299716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:27.301455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:27.817799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:27.922312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:27.927647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:27.928542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:27.929700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:27.933115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:27.951924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:27.952642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:27.953632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:27.954231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:27.967909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:27.979924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Getting quotas for project 18380558db0c48d5b36915e4d6762a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:27.988731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Getting quotas for user 26c9a76c91e24c16ad70bf0434eb0dd6 and project 18380558db0c48d5b36915e4d6762a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:27.991922 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6deebae-ab0f-4756-8265-4b9885e0a6e5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1519 microversion: 2.1 time: 0.714024 Jul 19 19:41:27.992545 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 307/599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:27 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1519 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:41:27.997383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:27.998176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:28.004843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.005294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.006124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.006558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.020803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:28.023242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:28.118222 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7142427a-5afd-4456-bc9d-afb0be699c44 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176648 Jul 19 19:41:28.119752 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 293/600] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:41:28.131391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:28.135780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:28.158335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.159137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.160133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.160775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.420621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:28.430519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cd45157-789c-4e3a-9630-746b7e505611 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.436723 Jul 19 19:41:28.431151 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 308/601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:27 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:28.437653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:28.438658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:28.454977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.455642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.456522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:28.457187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:28.532510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:28.542063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-63c4ff9b-a060-46fb-9772-db882b8f24c3 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1313 microversion: 2.1 time: 0.420833 Jul 19 19:41:28.543241 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 294/602] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:28 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:28.551463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-477dc62d-bc8f-44c7-be08-73ae9976c378 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'create', calling method: .version_select at 0x7f23efd33d30>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:29.059050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:29.066670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc85456f-aef0-4fc1-a218-84d0e57ba870 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.634469 Jul 19 19:41:29.071436 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 309/603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:28 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:29.079241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:29.079844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:29.099047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.099554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.100327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.100751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.232076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:29.236061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:29.248192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-88afa23c-3058-474b-95d6-2cbea17a2c1e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1273 microversion: 2.1 time: 0.175401 Jul 19 19:41:29.248797 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 310/604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:29 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:29.258627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:29.263756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:29.276310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.291641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.294458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.296080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.749746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:29.759721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:29.761656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:29.762840 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad876845-4fc1-4382-98cb-842d0e8610e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1568 microversion: 2.25 time: 0.513103 Jul 19 19:41:29.763654 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 311/605] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:29 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1568 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:29.771642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a962cbac-b959-4af4-b78b-26944f6f325c req-9cfebad4-76ae-4bc2-b63a-cbd65d52b508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:29.782502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a962cbac-b959-4af4-b78b-26944f6f325c req-9cfebad4-76ae-4bc2-b63a-cbd65d52b508 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.783532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a962cbac-b959-4af4-b78b-26944f6f325c req-9cfebad4-76ae-4bc2-b63a-cbd65d52b508 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.795733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a962cbac-b959-4af4-b78b-26944f6f325c req-9cfebad4-76ae-4bc2-b63a-cbd65d52b508 service nova] Creating event network-changed:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h2-843834-3 Jul 19 19:41:29.801655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a962cbac-b959-4af4-b78b-26944f6f325c req-9cfebad4-76ae-4bc2-b63a-cbd65d52b508 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036652 Jul 19 19:41:29.802538 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 312/606] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:29.808742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:29.809337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:29.816456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.817585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:29.818491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:29.819054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:30.645671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:30.670337 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7290274-511c-48d3-b0dc-b913cb25b575 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.866197 Jul 19 19:41:30.672439 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 313/607] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:29 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:30.679264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:30.680151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:30.687581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:30.688572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:30.690236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:30.690862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.111656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:31.145291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9968fe4-f63a-4232-885f-b1774c827da8 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1313 microversion: 2.1 time: 0.467566 Jul 19 19:41:31.158991 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 314/608] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:30 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:31.166415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:31.167349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:31.174082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.174965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.176597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.177303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.230620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:41:31.364550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8a1ab43-b3d5-4588-81d9-43a2d29134c9 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 204 len: 0 microversion: 2.1 time: 0.203844 Jul 19 19:41:31.366969 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 315/609] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:31 2022] DELETE /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:41:31.374109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:31.375193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:31.389746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.390436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.392649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.393308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.826652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:31.835154 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-633a6683-d059-442a-bbf2-3e76f70c9e95 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.466799 Jul 19 19:41:31.844953 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 316/610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:31 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:31.849508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:31.851009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:31.856832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.857278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:31.858542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:31.858542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.285471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:32.300440 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9285e50-6ffc-4da6-be61-3c428a2a9b98 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.454741 Jul 19 19:41:32.301674 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 317/611] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:31 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:32.308740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:32.310380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:32.321107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.321891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.322853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.323313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.681459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:32.690111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:32.691695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:32.693266 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6412bc0f-923d-4cc6-989a-dca9c37ee518 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1568 microversion: 2.25 time: 0.390372 Jul 19 19:41:32.694298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 318/612] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:32 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:32.699375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0172ed8a-43e1-4e48-9bb2-b5957f846603 req-d595dbb5-8106-42aa-b2a3-51a120de320f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff7eeea-caec-4195-bc05-20d03a396763", "name": "network-vif-plugged", "status": "completed", "tag": "50297935-5077-4746-8d82-c394ebb3d29f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:32.708065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0172ed8a-43e1-4e48-9bb2-b5957f846603 req-d595dbb5-8106-42aa-b2a3-51a120de320f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.708472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0172ed8a-43e1-4e48-9bb2-b5957f846603 req-d595dbb5-8106-42aa-b2a3-51a120de320f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.720389 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0172ed8a-43e1-4e48-9bb2-b5957f846603 req-d595dbb5-8106-42aa-b2a3-51a120de320f service nova] Creating event network-vif-plugged:50297935-5077-4746-8d82-c394ebb3d29f for instance 3ff7eeea-caec-4195-bc05-20d03a396763 on n-h2-843834-3 Jul 19 19:41:32.725811 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0172ed8a-43e1-4e48-9bb2-b5957f846603 req-d595dbb5-8106-42aa-b2a3-51a120de320f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030151 Jul 19 19:41:32.726601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 319/613] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:32.734693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:32.736346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:32.744010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.744895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.745864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.746457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.746594 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-477dc62d-bc8f-44c7-be08-73ae9976c378 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.201875 Jul 19 19:41:32.747349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 295/614] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:41:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:32.780154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:32.782443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:32.797166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.804201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:32.805069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:32.806423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:33.482632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:33.503052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3efe2561-aed0-4158-b5c1-bc54e2c3d979 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1713 microversion: 2.1 time: 0.774772 Jul 19 19:41:33.504538 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 320/615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:32 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1713 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:33.519673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fdc5b8-9659-42e9-8113-4a6c8416adad", "tag": "8fc3406f-6507-433f-b7c2-77d3584f8c1b"}, {"server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "name": "network-vif-unplugged", "status": "completed", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:33.536296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:33.542850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:33.570663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] Creating event network-changed:8fc3406f-6507-433f-b7c2-77d3584f8c1b for instance 25fdc5b8-9659-42e9-8113-4a6c8416adad on n-h1-843834-3 Jul 19 19:41:33.571344 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] Creating event network-vif-unplugged:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h1-843834-3 Jul 19 19:41:33.578842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:33.580938 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8715324a-81e5-45d5-8cdc-6f0289a5e8f2 req-f2bfff9c-1fa2-4911-85cf-4ea106eeeacf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.072688 Jul 19 19:41:33.582599 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 321/616] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:33.590025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f9f4a9fc-22aa-457c-b4d9-0ddfbf0919a7 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.824794 Jul 19 19:41:33.590644 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 296/617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:32 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:33.591696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:33.593865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:33.604244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:33.608173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:33.609392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:33.609506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:33.613858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:33.616146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:33.632573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:33.633321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:33.634276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:33.635689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:34.172043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:34.180527 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcdcdd05-ef78-49df-aa21-abad02bdbcb4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1308 microversion: 2.1 time: 0.576769 Jul 19 19:41:34.181520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 297/618] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:33 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:34.186289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-865264744", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "9beb335f-2416-419f-a2e8-afe5a9e87165"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:34.213051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:34.221766 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81c64fe1-a369-4433-b2cf-1f5911c8e948 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1313 microversion: 2.1 time: 0.637727 Jul 19 19:41:34.222569 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 322/619] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:33 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:34.235055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:34.235767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:34.242228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:34.242741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:34.243643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:34.244136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:34.293346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] validate_networks() for [('9beb335f-2416-419f-a2e8-afe5a9e87165', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:34.817680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:34.830379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-075a1984-8643-48a3-b55a-aaf99ef0e222 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.605925 Jul 19 19:41:34.831404 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 323/620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:34 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:34.864515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:34.866621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:34.885266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:34.885783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:34.886594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:34.887128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:35.477438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:35.487536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:35.489705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:35.490947 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f00d698-b263-419d-bd87-64d99eb92ae6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1543 microversion: 2.25 time: 0.657837 Jul 19 19:41:35.491608 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 324/621] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:34 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1543 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:35.509464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:35.510080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:35.516962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:35.517413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:35.518207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:35.518645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:35.941596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:35.950339 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab202f0a-0e32-4305-961a-1b612b89a54d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1645 microversion: 2.1 time: 0.444826 Jul 19 19:41:35.950939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 325/622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:35 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1645 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:35.960309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:35.961693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:35.967926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:35.968370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:35.969142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:35.969552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.099423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:36.099914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:36.100309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:36.100740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:36.101149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:36.110649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.111144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.111945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.112380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.141315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Getting quotas for project d2b974b1f66344cc9a539ccbe7f391ab. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:36.146471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Getting quotas for user ea9cf9a38a804fdc8c053db13a1395be and project d2b974b1f66344cc9a539ccbe7f391ab. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:36.159365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:36.161497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:36.210902 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-77bf32aa-b45e-458a-b57f-bbc8e8e5b279 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027923 Jul 19 19:41:36.216662 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 298/623] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:41:36.217122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-12a7400d-c76b-416b-a66f-c52db56e2779 req-00423a00-7486-4284-b132-01200cc4c043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c9fe9d9-5f46-4c61-9c4d-99360dfa8831", "tag": "7a5ad2cc-2ba8-43a2-a488-b8a420dea90d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:36.225489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-12a7400d-c76b-416b-a66f-c52db56e2779 req-00423a00-7486-4284-b132-01200cc4c043 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.225927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-12a7400d-c76b-416b-a66f-c52db56e2779 req-00423a00-7486-4284-b132-01200cc4c043 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.238839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-12a7400d-c76b-416b-a66f-c52db56e2779 req-00423a00-7486-4284-b132-01200cc4c043 service nova] Creating event network-changed:7a5ad2cc-2ba8-43a2-a488-b8a420dea90d for instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 on n-h2-843834-3 Jul 19 19:41:36.243950 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-12a7400d-c76b-416b-a66f-c52db56e2779 req-00423a00-7486-4284-b132-01200cc4c043 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031270 Jul 19 19:41:36.245114 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 299/624] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:36.250222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:36.250898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:36.257478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.258162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.259250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.259837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.298639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:36.312048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d74106d1-67fe-4033-9f42-e61ca5d3cb1c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.359634 Jul 19 19:41:36.312738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 326/625] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:35 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:36.322154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:36.322839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:36.329477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.329985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.331141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.331584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.372160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:36.609736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:36.624009 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1d2dab3-7329-43e9-9b89-749f45ffc3c1 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1488 microversion: 2.1 time: 0.377296 Jul 19 19:41:36.626185 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 300/626] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:36 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:36.628345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:36.638114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:36.638454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8db1a596-bfe9-4ced-beea-73805be2385e req-2f66fe5c-83de-4792-b777-00f790defaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fdc5b8-9659-42e9-8113-4a6c8416adad", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3406f-6507-433f-b7c2-77d3584f8c1b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:36.646763 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1aadedcd-9f8c-464d-8e93-a447be345048 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1313 microversion: 2.1 time: 0.329678 Jul 19 19:41:36.648573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 327/627] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:36 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:36.666005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8db1a596-bfe9-4ced-beea-73805be2385e req-2f66fe5c-83de-4792-b777-00f790defaaa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.666473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8db1a596-bfe9-4ced-beea-73805be2385e req-2f66fe5c-83de-4792-b777-00f790defaaa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.678894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8db1a596-bfe9-4ced-beea-73805be2385e req-2f66fe5c-83de-4792-b777-00f790defaaa service nova] Creating event network-vif-plugged:8fc3406f-6507-433f-b7c2-77d3584f8c1b for instance 25fdc5b8-9659-42e9-8113-4a6c8416adad on n-h1-843834-3 Jul 19 19:41:36.684120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8db1a596-bfe9-4ced-beea-73805be2385e req-2f66fe5c-83de-4792-b777-00f790defaaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056659 Jul 19 19:41:36.685504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 301/628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:36.691186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9511b734-aa9c-40c6-a98b-69f820a08844 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '.version_select at 0x7f23efdad310>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:36.695594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9511b734-aa9c-40c6-a98b-69f820a08844 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.696044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9511b734-aa9c-40c6-a98b-69f820a08844 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.705818 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9511b734-aa9c-40c6-a98b-69f820a08844 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.019110 Jul 19 19:41:36.706508 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 302/629] 10.222.0.23 () {60 vars in 1183 bytes} [Tue Jul 19 19:41:36 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:36.713748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:36.713748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:36.719373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.720002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.720976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.721558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.860047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Action: 'update', calling method: .version_select at 0x7f23efbbad30>, body: {"quota_set": {"ram": "5120"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:36.922553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:36.929218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.929926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.930499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b9dca4f-5789-4e6b-9e1a-c2dbf56f8ac4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.222737 Jul 19 19:41:36.931229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.931434 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 303/630] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:36 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:36.932275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.937391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:36.937980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:36.944963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.945421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.946213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:36.946631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:36.996076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d18bdc96-12b3-4782-8999-10576a6472d5 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2" status: 200 len: 148 microversion: 2.57 time: 0.344812 Jul 19 19:41:37.001248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 328/631] 10.222.0.23 () {62 vars in 1302 bytes} [Tue Jul 19 19:41:36 2022] PUT /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2 => generated 148 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:37.001637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:37.002166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.008637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.009085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.009854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.010285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.018020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:37.026507 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1cb99a1b-5017-452e-b76f-db792f5690e7 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1227 microversion: 2.1 time: 0.094102 Jul 19 19:41:37.027325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 304/632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:36 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1227 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:37.032267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.033091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.041148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.041594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.042391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.042824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.108121 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef7dd6ff-944a-454b-8940-3d2ee97a9fef tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763/action" status: 202 len: 0 microversion: 2.1 time: 0.109911 Jul 19 19:41:37.111907 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 329/633] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:36 2022] POST /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:37.114821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.115564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.122422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.122532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.123356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.123824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.159483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.159935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.160388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lazy-loading 'fault' on Instance uuid 17eda853-e022-4da6-bc1d-c038149a4321 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:37.234304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2813b3164f34435ab921bd3ffc8f910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f88ce38c2e4f7e9fcb95f2c2cb5950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:37.244835 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a154d309-884b-4f5b-9e5d-2085d6d89c34 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 200 len: 1354 microversion: 2.1 time: 0.134695 Jul 19 19:41:37.255376 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 330/634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 1354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:37.262687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Calling method '.version_select at 0x7f23efbc60d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.269946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid fc6ca356-1a3a-4e44-b72f-59efa620c174 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:37.289112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f44d6e6e-1eda-4d00-ae47-2f737ddc0686 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 2036 microversion: 2.25 time: 0.260581 Jul 19 19:41:37.289959 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 305/635] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 2036 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:37.294735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.295742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.305929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.305929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.305929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.305929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.345161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.345768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.346566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.347097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.367285 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26899b00-a0d7-4723-8a51-b189eb1589e3 tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2/detail" status: 200 len: 463 microversion: 2.57 time: 0.110459 Jul 19 19:41:37.368001 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 331/636] 10.222.0.23 () {60 vars in 1303 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2/detail => generated 463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:37.372933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64785f98-1ba6-4c7a-9a6c-81bdc51abe32 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: .version_select at 0x7f23efbed0d0>, body: {"keypair": {"name": "tempest-keypair-448706897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8g2UU2xR2zDj9ipnDPhmufrXqRu6J6rg098qAwtI/u3gEktH3j94FNz+SRuKf/nlR9Me/NHI5j3gurprQv/1BORgbClz+UQhWhvXQEv/RgmHMlC0N/kbUIkaszOWH96w=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:37.388666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-64785f98-1ba6-4c7a-9a6c-81bdc51abe32 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:37.396839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-64785f98-1ba6-4c7a-9a6c-81bdc51abe32 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for user df971d67f21747f2afa56647d78a7fa5 and project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:37.436778 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64785f98-1ba6-4c7a-9a6c-81bdc51abe32 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.067421 Jul 19 19:41:37.439565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 332/637] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:41:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:41:37.450240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.450857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.461393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.461961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.463122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.463736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.475508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:37.491701 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a48199cc-eb9f-4b8f-bb14-73d3dcddb49f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1493 microversion: 2.1 time: 0.199728 Jul 19 19:41:37.492397 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 306/638] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1493 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:37.573893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Action: 'update', calling method: .version_select at 0x7f23efccfaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:37.677914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.678637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.679501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.680054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.693943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:37.702212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:37.725269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.725934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.726870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.727475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.800981 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05423ba0-f1cd-4e58-b362-0ee1e45ed0ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2?user_id=534cb71fbcf34b9e9c839dcbfb4290a7" status: 200 len: 148 microversion: 2.57 time: 0.231328 Jul 19 19:41:37.806567 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 307/639] 10.222.0.23 () {62 vars in 1383 bytes} [Tue Jul 19 19:41:37 2022] PUT /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2?user_id=534cb71fbcf34b9e9c839dcbfb4290a7 => generated 148 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 19:41:37.806567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.807126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.823209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.823662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.824473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.825024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.835747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:37.848128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51515833-6aa7-43ce-9df1-c01bc835c25a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.407490 Jul 19 19:41:37.859487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 333/640] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:37.866699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c28ad87d-fc93-4c47-9af4-57271d11d9ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] Calling method '.version_select at 0x7f23efbba3a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.958450 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c28ad87d-fc93-4c47-9af4-57271d11d9ce tempest-QuotasAdminTestV257-454282467 tempest-QuotasAdminTestV257-454282467-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2?user_id=534cb71fbcf34b9e9c839dcbfb4290a7" status: 200 len: 190 microversion: 2.57 time: 0.097287 Jul 19 19:41:37.964186 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 334/641] 10.222.0.23 () {60 vars in 1363 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/os-quota-sets/e9a7070ecb53413fbdde76c0ea764db2?user_id=534cb71fbcf34b9e9c839dcbfb4290a7 => generated 190 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:41:37.964186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:37.965805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:37.973833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.974951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:37.976041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:37.976464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.124570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:38.140225 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e07f6fe2-89ae-4a58-847c-9210f25c85cf tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1313 microversion: 2.1 time: 0.337326 Jul 19 19:41:38.141102 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 308/642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:38.159629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.160472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.167668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.168352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.169426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.170261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.290943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:38.306770 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0fcce1fb-a89a-4fe9-84e9-6d86dec2d5ce tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1275 microversion: 2.1 time: 0.153674 Jul 19 19:41:38.316262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 309/643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:38 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:38.322215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:38.323345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.324391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.329709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6870a2bd-7f9e-47a1-9f98-ef3e9b860fe4 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.369498 Jul 19 19:41:38.336937 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 335/644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:37 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:38.341845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7a918210-275e-49c7-8f6d-c77d7eb839a4 req-28270c79-8186-443b-a7ed-c05772b74834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eda853-e022-4da6-bc1d-c038149a4321", "name": "network-vif-deleted", "tag": "35717b0a-329e-43b8-a123-7e3725aac9aa"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:38.356253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.357114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.358298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.358936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.359086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:38.361539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7a918210-275e-49c7-8f6d-c77d7eb839a4 req-28270c79-8186-443b-a7ed-c05772b74834 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.362320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7a918210-275e-49c7-8f6d-c77d7eb839a4 req-28270c79-8186-443b-a7ed-c05772b74834 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.391247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7a918210-275e-49c7-8f6d-c77d7eb839a4 req-28270c79-8186-443b-a7ed-c05772b74834 service nova] Creating event network-vif-deleted:35717b0a-329e-43b8-a123-7e3725aac9aa for instance 17eda853-e022-4da6-bc1d-c038149a4321 on n-h1-843834-3 Jul 19 19:41:38.397118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:38.399322 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:38.401568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7a918210-275e-49c7-8f6d-c77d7eb839a4 req-28270c79-8186-443b-a7ed-c05772b74834 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062604 Jul 19 19:41:38.403043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 336/645] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 HTTP/1.1 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:41:38.404061 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:38.405623 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '17eda853-e022-4da6-bc1d-c038149a4321'} Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:38.406591 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:38.408079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.413970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:38.415795 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba44876d-47aa-4d34-be6e-b8e457eeefa0 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 404 len: 111 microversion: 2.1 time: 0.104631 Jul 19 19:41:38.421865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 310/646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:38 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:38.445381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.446281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.453388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.455069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.457163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.458049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.486948 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec HTTP/1.1 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:41:38.489375 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.490944 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'dfaffe29-9112-4b41-8e9a-3556b7c7b8ec'} Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:38.492056 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.493389 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.494701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:38.497815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8075b5b8-44a7-4a4d-b72e-4d86b07beb5d tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 404 len: 111 microversion: 2.1 time: 0.073775 Jul 19 19:41:38.511512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.512147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.516944 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 337/647] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:38 2022] DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:38.529027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.530553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.530674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.531206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.532514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.533321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.558498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.558947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.559921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.560507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.562747 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec HTTP/1.1 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:41:38.564653 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.566287 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'dfaffe29-9112-4b41-8e9a-3556b7c7b8ec'} Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:38.567530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:38.568783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:38.574441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:38.576612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a235515-ca2e-40a7-8cc3-7a00abcff759 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 404 len: 111 microversion: 2.1 time: 0.072296 Jul 19 19:41:38.583409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 311/648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:38 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:38.589651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b0b1e6a-8eb1-49ed-81cf-a0b949f79add tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '.version_select at 0x7f23efce09d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.629345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b0b1e6a-8eb1-49ed-81cf-a0b949f79add tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671997608" status: 202 len: 0 microversion: 2.1 time: 0.044268 Jul 19 19:41:38.634062 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 312/649] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671997608 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:38.869730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:38.871614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.877136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:38.884860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.885064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.887851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.887982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.893990 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d223bdb-d806-4c81-a339-53681e2175d4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 200 len: 1473 microversion: 2.1 time: 0.374353 Jul 19 19:41:38.895406 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 338/650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:38 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 1473 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:38.914549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1026100476"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:38.916930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:38.924903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.926562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:38.927652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:38.928346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.141542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:39.154804 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c779054-07d5-46e1-aa39-de4c2e34524b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.292961 Jul 19 19:41:39.156259 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 313/651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:38 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:39.171496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:39.172712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:39.190378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.191315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.192758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.193404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.313229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-774bf76f-4c94-4e4f-97ac-2764283e5192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763/action" status: 202 len: 0 microversion: 2.1 time: 0.404564 Jul 19 19:41:39.315526 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 339/652] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:38 2022] POST /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:41:39.334442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:39.354823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:39.373207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.374692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.377983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.378505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.565968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:39.585845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:39.596408 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09336d8a-436d-4444-b17f-f7bd45b9c006 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1463 microversion: 2.1 time: 0.438006 Jul 19 19:41:39.597362 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 314/653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:39 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:39.606002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ed14ba6-f34a-42bd-ac9f-42d4a4e5ddc3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efd18430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:39.616315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a42d475-0cef-433b-a177-7e386148c5d1 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1281 microversion: 2.1 time: 0.295011 Jul 19 19:41:39.616945 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 340/654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:39 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:39.622136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:39.622750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:39.630356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.630855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.631937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:39.632854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:39.678992 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ed14ba6-f34a-42bd-ac9f-42d4a4e5ddc3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.079948 Jul 19 19:41:39.680523 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 315/655] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:39 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:40.019242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Calling method '.version_select at 0x7f23efc6f550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.036771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.037321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.058705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.059239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.081848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29ee7739-1279-4788-b745-352a819e5d30 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/cdaf8ef9f1624f89b42a0d469639a42d?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598" status: 200 len: 694 microversion: 2.1 time: 0.400238 Jul 19 19:41:40.082929 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 316/656] 10.222.0.23 () {58 vars in 1411 bytes} [Tue Jul 19 19:41:39 2022] GET /compute/v2.1/os-simple-tenant-usage/cdaf8ef9f1624f89b42a0d469639a42d?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598 => generated 694 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:40.097234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '.version_select at 0x7f23efdb4af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.104970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.105496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.115337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.115870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.132381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5278ae3-191a-422c-9b13-979d70a59870 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/cdaf8ef9f1624f89b42a0d469639a42d?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598" status: 200 len: 694 microversion: 2.1 time: 0.038882 Jul 19 19:41:40.143013 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 317/657] 10.222.0.23 () {58 vars in 1411 bytes} [Tue Jul 19 19:41:40 2022] GET /compute/v2.1/os-simple-tenant-usage/cdaf8ef9f1624f89b42a0d469639a42d?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598 => generated 694 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:41:40.147929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Calling method '.version_select at 0x7f23efd18280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.159131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:40.171709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.172055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cac549a0-31dc-4c85-b90d-f6c39e8d43d1 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.550491 Jul 19 19:41:40.172512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.173484 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 341/658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:39 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:40.188985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.191368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.192108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.194124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:40.204869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.205483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.206338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.206822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.238474 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a80eae35-7c1b-471f-a021-677a515893b8 tempest-TenantUsagesTestJSON-2072302622 tempest-TenantUsagesTestJSON-2072302622-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598&detailed=1" status: 200 len: 7750 microversion: 2.1 time: 0.094145 Jul 19 19:41:40.239570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 318/659] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Jul 19 19:41:40 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A41%3A39.606598&end=2022-07-20T19%3A41%3A39.606598&detailed=1 => generated 7750 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:41:40.258622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-624173459", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "e1fb5a5d-f185-4eab-959a-40101db7e714"}], "security_groups": [{"name": "tempest-securitygroup--1995361570"}], "key_name": "tempest-keypair-448706897", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:40.718504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] validate_networks() for [('e1fb5a5d-f185-4eab-959a-40101db7e714', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:40.807417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:40.817207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-63b76d66-1f51-495b-a2c8-e052cf66ee34 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.642294 Jul 19 19:41:40.817990 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 342/660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:40 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:40.834868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.835404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:40.845959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.846707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.847697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:40.849122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:40.877594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:41:40.973288 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-88b2a7d0-b0ee-4bc3-ac13-b847a8d18fcc tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 204 len: 0 microversion: 2.1 time: 0.153575 Jul 19 19:41:40.974407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 343/661] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:40 2022] DELETE /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:41:40.981243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ded170b6-bfae-4a32-96af-1248af26ee16 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:40.982871 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:40.982871 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:41:41.002453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ded170b6-bfae-4a32-96af-1248af26ee16 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1624844462" status: 202 len: 0 microversion: 2.1 time: 0.026488 Jul 19 19:41:41.006504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 344/662] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:41:40 2022] DELETE /compute/v2.1/flavors/1624844462 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:41.010763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.011532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:41.017958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.018744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.019558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.020013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.307896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:41.314488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:41.317558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e48cd1c6-ba5e-4b7c-a339-9c3027680f36 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1323 microversion: 2.1 time: 0.313063 Jul 19 19:41:41.318723 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 345/663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:41.323977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-745f63ce-2fa4-4f2a-a189-cdf3f96d9db9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efb569d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.394477 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-745f63ce-2fa4-4f2a-a189-cdf3f96d9db9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.074373 Jul 19 19:41:41.400829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 346/664] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:41.410617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.415729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:41.424093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.424556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.425338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.425780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.694086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:41.694506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:41.694998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:41.695405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:41.695809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:41.716949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.718434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.719486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.721862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.760645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:41.768353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for user df971d67f21747f2afa56647d78a7fa5 and project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:41.788284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:41.792087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:41.819315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:41.827458 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2499b2af-7120-4654-a36f-77391cbc992d tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1469 microversion: 2.1 time: 0.425354 Jul 19 19:41:41.828236 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 347/665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1469 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:41.841873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76a61991-0196-4371-afdb-c01cb54732e5 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.860255 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cc318eae-3e36-44be-92eb-9f817ad99e15 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.619419 Jul 19 19:41:41.861673 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 319/666] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:41:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:41:41.862630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76a61991-0196-4371-afdb-c01cb54732e5 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.024252 Jul 19 19:41:41.863445 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 348/667] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:41.872159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.873323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:41.881277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-514dc12b-cbda-4aa0-8c17-7929197f984f req-cce6947e-b100-4a27-9fe2-51a61813c73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9fe9d9-5f46-4c61-9c4d-99360dfa8831", "name": "network-vif-plugged", "status": "completed", "tag": "7a5ad2cc-2ba8-43a2-a488-b8a420dea90d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:41.883021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.883728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.885422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.887670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.889907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-514dc12b-cbda-4aa0-8c17-7929197f984f req-cce6947e-b100-4a27-9fe2-51a61813c73c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.890352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-514dc12b-cbda-4aa0-8c17-7929197f984f req-cce6947e-b100-4a27-9fe2-51a61813c73c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.918678 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-514dc12b-cbda-4aa0-8c17-7929197f984f req-cce6947e-b100-4a27-9fe2-51a61813c73c service nova] Creating event network-vif-plugged:7a5ad2cc-2ba8-43a2-a488-b8a420dea90d for instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 on n-h2-843834-3 Jul 19 19:41:41.923894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-514dc12b-cbda-4aa0-8c17-7929197f984f req-cce6947e-b100-4a27-9fe2-51a61813c73c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059299 Jul 19 19:41:41.924876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 349/668] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:41.931581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:41.932269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:41.940112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.940557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:41.941499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:41.943156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.529395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:42.538946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8c74ec3-8270-4743-b7f9-914cba604f4e tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.675689 Jul 19 19:41:42.548132 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 320/669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:42.553226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.553835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:42.566081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.567081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.568192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.568645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.587786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:42.595285 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1951839-dd34-4ffc-a78b-472c105fbdfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.667760 Jul 19 19:41:42.607904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 350/670] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:41 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:42.613096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23ffd43d-3885-47e6-b2ea-31d19f5e9aec tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.613937 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:41:42.613937 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:41:42.654820 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23ffd43d-3885-47e6-b2ea-31d19f5e9aec tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1694819681" status: 202 len: 0 microversion: 2.1 time: 0.045629 Jul 19 19:41:42.656094 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 351/671] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:41:42 2022] DELETE /compute/v2.1/flavors/1694819681 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:42.662065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8f73b5ed-3f1f-4d04-b8f9-e08abccf4eed req-8fefdda9-9cd3-4882-9769-b337409725ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35603c8-3daf-46ef-8550-022380364af1", "tag": "00a8e9ed-660e-45eb-a1c1-b16f95f95857"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:42.674753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8f73b5ed-3f1f-4d04-b8f9-e08abccf4eed req-8fefdda9-9cd3-4882-9769-b337409725ed service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.675491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8f73b5ed-3f1f-4d04-b8f9-e08abccf4eed req-8fefdda9-9cd3-4882-9769-b337409725ed service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.699525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8f73b5ed-3f1f-4d04-b8f9-e08abccf4eed req-8fefdda9-9cd3-4882-9769-b337409725ed service nova] Creating event network-changed:00a8e9ed-660e-45eb-a1c1-b16f95f95857 for instance c35603c8-3daf-46ef-8550-022380364af1 on n-h2-843834-3 Jul 19 19:41:42.705059 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8f73b5ed-3f1f-4d04-b8f9-e08abccf4eed req-8fefdda9-9cd3-4882-9769-b337409725ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047286 Jul 19 19:41:42.706232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 352/672] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:42.713525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:42.714090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.716073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:42.740007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:42.742106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:42.743826 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05b366de-fc79-4879-bb75-8b2d27d08ed4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1288 microversion: 2.25 time: 0.194615 Jul 19 19:41:42.746304 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 321/673] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:42 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1288 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:42.752866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e96dcb9-8a24-4992-b655-11074cd58cf8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efb87c10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.762180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.763145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.767681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.768201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.822139 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e96dcb9-8a24-4992-b655-11074cd58cf8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.073664 Jul 19 19:41:42.823392 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 322/674] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:42 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:42.833478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-790293a3-a990-4ada-8eab-211839528dc9 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.859621 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-790293a3-a990-4ada-8eab-211839528dc9 tempest-ServersWithSpecificFlavorTestJSON-1738582457 tempest-ServersWithSpecificFlavorTestJSON-1738582457-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034863 Jul 19 19:41:42.860957 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 323/675] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:41:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:42.866515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:42.867272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:42.881908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.883470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:42.884496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:42.885135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.260470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:43.275395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8bec8d4-fc5c-4207-8f22-8d645d8568c8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1323 microversion: 2.1 time: 0.567481 Jul 19 19:41:43.276285 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 353/676] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:42 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1323 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:43.281826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:43.282481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:43.289071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.289714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.290650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.291333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.309691 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 HTTP/1.1 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:41:43.312726 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.314145 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '17eda853-e022-4da6-bc1d-c038149a4321'} Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:43.315019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.317062 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.322899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:43.324567 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-37f9a3d1-fa48-4d32-92fc-f7c76b3303fd tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 404 len: 111 microversion: 2.1 time: 0.047206 Jul 19 19:41:43.325376 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 354/677] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:43 2022] DELETE /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:43.586657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1100464488", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:43.658578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:41:43.679010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a21174a3ac24bd7879b0cca7753f0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf8ef9f1624f89b42a0d469639a42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:43.688113 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fca8436e-4a9c-482a-b3fa-73bc817c15b0 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 200 len: 1469 microversion: 2.1 time: 0.825700 Jul 19 19:41:43.698770 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 324/678] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:42 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 1469 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:43.704271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:43.705275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: 17eda853-e022-4da6-bc1d-c038149a4321] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:43.712433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.713249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.714241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.714876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.730307 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 HTTP/1.1 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:41:43.732304 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.733564 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '17eda853-e022-4da6-bc1d-c038149a4321'} Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:43.734277 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. Jul 19 19:41:43.735435 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:43.737746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance 17eda853-e022-4da6-bc1d-c038149a4321 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:43.738898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d4d8000-0be9-4465-add2-7239370daa05 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321" status: 404 len: 111 microversion: 2.1 time: 0.038723 Jul 19 19:41:43.743666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 325/679] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:43 2022] GET /compute/v2.1/servers/17eda853-e022-4da6-bc1d-c038149a4321 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:43.749775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:43.750718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:43.758569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.760970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:43.762010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:43.763322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.233155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:44.241816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f69e3b8a-c14e-40f1-aeb0-cbc58af73772 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1321 microversion: 2.1 time: 0.496224 Jul 19 19:41:44.245477 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 326/680] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:43 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:44.256401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.258358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:44.279403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.284338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.287799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.288351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.410107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:41:44.411216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:41:44.411887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:41:44.412453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:41:44.413003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:41:44.427573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.431351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.432391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.434373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.477654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:41:44.490003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:41:44.507621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:41:44.510020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:41:44.549354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:44.560847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-252dd3a7-47a2-47e3-825c-45922bec1f3a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 0.313028 Jul 19 19:41:44.562299 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 327/681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:44 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:44.568087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.568868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:44.582349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12ddf4bb-c5c4-479f-a360-56ec4a334948 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255157 Jul 19 19:41:44.583077 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 355/682] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:41:44.592051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.592699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:44.603752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.604370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.609789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.610459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.615214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.615899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.617026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.617635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.631740 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec HTTP/1.1 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:41:44.634083 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:44.635920 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'dfaffe29-9112-4b41-8e9a-3556b7c7b8ec'} Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:44.636763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:44.638170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:44.639663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:44.639663 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf197060-1bf9-41a5-9ee7-5e40b2552b16 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 404 len: 111 microversion: 2.1 time: 0.071915 Jul 19 19:41:44.639663 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 328/683] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:44 2022] DELETE /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:44.644178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b57be086-1f67-44ee-b78b-9ef155ef3e52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efc6f1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.738379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b57be086-1f67-44ee-b78b-9ef155ef3e52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.097856 Jul 19 19:41:44.741621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 329/684] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:44 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:44.747970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.748564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:44.769999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.779297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.780369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:44.782353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:44.796522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:44.811189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:44.817734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:44.821558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1bb6d5a6-4880-4a34-a9bf-da63e9de9361 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1342 microversion: 2.25 time: 0.236826 Jul 19 19:41:44.823300 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 356/685] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:44 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:44.829090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-defafefb-b375-4abf-9d17-41972bf1cde2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:44.829906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-defafefb-b375-4abf-9d17-41972bf1cde2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:44.991801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-defafefb-b375-4abf-9d17-41972bf1cde2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:45.002336 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-defafefb-b375-4abf-9d17-41972bf1cde2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1217 microversion: 2.1 time: 0.175907 Jul 19 19:41:45.007045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 357/686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:44 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:45.017490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:45.018696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] [instance: dfaffe29-9112-4b41-8e9a-3556b7c7b8ec] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:45.027851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.029037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.030038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.031094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.051114 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] HTTP exception thrown: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Request method failure captured: Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec HTTP/1.1 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whiks90JEl7-1y3_x72HGziNpVU_zNwUkENQL6rxVbath9gpM-2uqwPuv2Q5IYqB84ozy_9hlZLK5uKahq5bh6WTot6TTStFUyFD8UbqRn8jqO9H9yHj7jLDg_rDzFO3oNZqH526OO6K-g-HHe1sfm0PYpyPMFqjzpfckUU3iVjPCk Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:41:45.054781 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f88ce38c2e4f7e9fcb95f2c2cb5950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 44f88ce38c2e4f7e9fcb95f2c2cb5950 Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369 Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2813b3164f34435ab921bd3ffc8f910a Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1470298369-project Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:45.056369 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'dfaffe29-9112-4b41-8e9a-3556b7c7b8ec'} Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:45.057181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. Jul 19 19:41:45.058331 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.061048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] Returning 404 to user: Instance dfaffe29-9112-4b41-8e9a-3556b7c7b8ec could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:45.062692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-722d3868-ee33-43df-b73a-ade0b8702995 tempest-ServersWithSpecificFlavorTestJSON-1470298369 tempest-ServersWithSpecificFlavorTestJSON-1470298369-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec" status: 404 len: 111 microversion: 2.1 time: 0.057441 Jul 19 19:41:45.064007 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 358/687] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:45 2022] GET /compute/v2.1/servers/dfaffe29-9112-4b41-8e9a-3556b7c7b8ec => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:45.071268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:45.072638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] [instance: 25fdc5b8-9659-42e9-8113-4a6c8416adad] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:45.083721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.084582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.085922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.086561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.114843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] HTTP exception thrown: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Request method failure captured: Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad HTTP/1.1 Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjjOIEZxG-bZuNNrCgEjKS7Zo-4TMn4B-vGMND-EBwT5MKsrVw3sycQvp8CEir50tXmgKlXW471qnmJVh1AGSiiXjVp4VofUwQozAbSJGqk7Hai7zgUUvo_e1ZG7HqYW_btVvZIAA1ryTQdLJRg4UlUTwkFZQheEU-GthMz52y9NFg Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: cdaf8ef9f1624f89b42a0d469639a42d Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TenantUsagesTestJSON-46423351 Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:41:45.117315 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdaf8ef9f1624f89b42a0d469639a42d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdaf8ef9f1624f89b42a0d469639a42d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdaf8ef9f1624f89b42a0d469639a42d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdaf8ef9f1624f89b42a0d469639a42d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TenantUsagesTestJSON-46423351 Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: cdaf8ef9f1624f89b42a0d469639a42d Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TenantUsagesTestJSON-46423351 Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TenantUsagesTestJSON-46423351-project Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7a21174a3ac24bd7879b0cca7753f0af Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TenantUsagesTestJSON-46423351-project Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. Jul 19 19:41:45.118584 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '25fdc5b8-9659-42e9-8113-4a6c8416adad'} Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:45.119385 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. Jul 19 19:41:45.120517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:45.124297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] Returning 404 to user: Instance 25fdc5b8-9659-42e9-8113-4a6c8416adad could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:45.125711 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd031c2b-41d3-40c3-be6f-fc6f45946364 tempest-TenantUsagesTestJSON-46423351 tempest-TenantUsagesTestJSON-46423351-project] 10.222.0.23 "GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad" status: 404 len: 111 microversion: 2.1 time: 0.060149 Jul 19 19:41:45.126491 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 359/688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:45 2022] GET /compute/v2.1/servers/25fdc5b8-9659-42e9-8113-4a6c8416adad => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:41:45.131887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0564442f-0309-4112-9761-e25a1cd6f281 req-5d1be78b-21b8-48e3-acd0-584565607e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fdc5b8-9659-42e9-8113-4a6c8416adad", "name": "network-vif-deleted", "tag": "8fc3406f-6507-433f-b7c2-77d3584f8c1b"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:45.185434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0564442f-0309-4112-9761-e25a1cd6f281 req-5d1be78b-21b8-48e3-acd0-584565607e3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.189220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0564442f-0309-4112-9761-e25a1cd6f281 req-5d1be78b-21b8-48e3-acd0-584565607e3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.226633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0564442f-0309-4112-9761-e25a1cd6f281 req-5d1be78b-21b8-48e3-acd0-584565607e3f service nova] Creating event network-vif-deleted:8fc3406f-6507-433f-b7c2-77d3584f8c1b for instance 25fdc5b8-9659-42e9-8113-4a6c8416adad on n-h1-843834-3 Jul 19 19:41:45.245173 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0564442f-0309-4112-9761-e25a1cd6f281 req-5d1be78b-21b8-48e3-acd0-584565607e3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117144 Jul 19 19:41:45.250833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 360/689] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:45.270595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:45.273447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:45.294803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.296351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:45.297177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:45.297610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:46.514158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:46.531386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb2df4d8-c0f4-4b38-ae07-92bb7c05f3dd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1323 microversion: 2.1 time: 1.786529 Jul 19 19:41:46.539876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 330/690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:44 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1323 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:46.551549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:46.561758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:46.575794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:46.576332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:46.577188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:46.577707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:46.617967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:46.627299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b95d3829-0c43-4c2a-8102-b08306436903 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1471 microversion: 2.1 time: 1.368304 Jul 19 19:41:46.641179 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 361/691] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:45 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1471 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:41:46.648063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-db605e24-01a4-44cb-9094-389e458cb9f5 req-1a68a54d-cad2-4609-82ee-f6c71c2ed101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff7eeea-caec-4195-bc05-20d03a396763", "name": "network-vif-plugged", "status": "completed", "tag": "50297935-5077-4746-8d82-c394ebb3d29f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:46.675850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-db605e24-01a4-44cb-9094-389e458cb9f5 req-1a68a54d-cad2-4609-82ee-f6c71c2ed101 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:46.676478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-db605e24-01a4-44cb-9094-389e458cb9f5 req-1a68a54d-cad2-4609-82ee-f6c71c2ed101 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:46.697696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-db605e24-01a4-44cb-9094-389e458cb9f5 req-1a68a54d-cad2-4609-82ee-f6c71c2ed101 service nova] Creating event network-vif-plugged:50297935-5077-4746-8d82-c394ebb3d29f for instance 3ff7eeea-caec-4195-bc05-20d03a396763 on n-h2-843834-3 Jul 19 19:41:46.713038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-db605e24-01a4-44cb-9094-389e458cb9f5 req-1a68a54d-cad2-4609-82ee-f6c71c2ed101 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070033 Jul 19 19:41:46.713970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 362/692] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:46.726466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14dc0065-0d3d-41f9-b561-0fdd0307392b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efb17700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:46.793617 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14dc0065-0d3d-41f9-b561-0fdd0307392b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.078087 Jul 19 19:41:46.795165 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 363/693] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:46 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:46.801408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:46.803309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:46.812561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:46.813253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:46.814273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:46.814942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.106245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:47.119146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:47.121012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:47.124781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd8459e1-d38b-44a7-918d-31ef8978f70a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1342 microversion: 2.25 time: 0.327952 Jul 19 19:41:47.128649 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 364/694] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:46 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1342 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:47.144284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:47.147048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:47.161489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.163764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.164759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.166692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.421496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:47.436384 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa43d3d6-3df9-4ee9-894b-10251fe2b8d8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1275 microversion: 2.1 time: 0.306367 Jul 19 19:41:47.437357 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 365/695] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:47 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:47.444480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:47.445028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:47.474439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.475231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.477085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.477691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.520355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lazy-loading 'flavor' on Instance uuid 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:41:47.695046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98c0ce68-6844-4794-8b91-cdf4c7656614 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831/action" status: 202 len: 0 microversion: 2.1 time: 0.256263 Jul 19 19:41:47.701457 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 366/696] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:47 2022] POST /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:41:47.712330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:47.712999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:47.716708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:47.721744 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fea2ade7-b576-4254-ad33-41e387d7658a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1476 microversion: 2.1 time: 1.179532 Jul 19 19:41:47.722316 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 331/697] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:46 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1476 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:47.741457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:47.742048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:47.752992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.753751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.754766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.755458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.780453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.781310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:47.783629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:47.784355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:48.985530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:48.995443 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2b92820-ce54-44b0-acea-b62685c2b071 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1323 microversion: 2.1 time: 1.292371 Jul 19 19:41:48.996635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 367/698] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:47 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1323 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:49.003537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b926803d-483b-4177-a9c7-a3d35da9d7df tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbbaaf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:49.079469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b926803d-483b-4177-a9c7-a3d35da9d7df tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.080951 Jul 19 19:41:49.081127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 368/699] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:48 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:49.094292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:49.095239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:49.108033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.108868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.110951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.111665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.681170 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d892af0-8bef-49ef-91e1-28af45677a8c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1630 microversion: 2.1 time: 1.949158 Jul 19 19:41:49.686111 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 332/700] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:47 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1630 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:49.697967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:49.699947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:49.707740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:49.708973 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-524e250c-fb62-4422-b6e9-e5b5a517ad31 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 0.626194 Jul 19 19:41:49.709535 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 369/701] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:49 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:49.713457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:49.715130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:49.730813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "name": "network-vif-unplugged", "status": "completed", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:49.731222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.732360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.733323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.737429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.752195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.752521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.778659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] Creating event network-vif-unplugged:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h1-843834-3 Jul 19 19:41:49.795493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:41:49.822220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a5443de1-59ce-43b2-bbf1-0405cbc776f8 req-5eb397f0-0370-4918-b487-b819580bb528 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100246 Jul 19 19:41:49.823871 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 370/702] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:49.834236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:49.842788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:49.857709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.858391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.859442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:49.860104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:49.980223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:50.010217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8cda944f-b651-4481-8981-e9724a09bbfa tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1275 microversion: 2.1 time: 0.305730 Jul 19 19:41:50.011455 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 333/703] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:49 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:50.022257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ea1f6f64-3be2-4e85-a368-0f534892e2ea req-06ee1c4d-ec42-4333-aaf4-5fa2f2bc2d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35603c8-3daf-46ef-8550-022380364af1", "name": "network-vif-plugged", "status": "completed", "tag": "00a8e9ed-660e-45eb-a1c1-b16f95f95857"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:50.042013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ea1f6f64-3be2-4e85-a368-0f534892e2ea req-06ee1c4d-ec42-4333-aaf4-5fa2f2bc2d2f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:50.042476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ea1f6f64-3be2-4e85-a368-0f534892e2ea req-06ee1c4d-ec42-4333-aaf4-5fa2f2bc2d2f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:50.079613 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ea1f6f64-3be2-4e85-a368-0f534892e2ea req-06ee1c4d-ec42-4333-aaf4-5fa2f2bc2d2f service nova] Creating event network-vif-plugged:00a8e9ed-660e-45eb-a1c1-b16f95f95857 for instance c35603c8-3daf-46ef-8550-022380364af1 on n-h2-843834-3 Jul 19 19:41:50.086369 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ea1f6f64-3be2-4e85-a368-0f534892e2ea req-06ee1c4d-ec42-4333-aaf4-5fa2f2bc2d2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072484 Jul 19 19:41:50.087509 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 334/704] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:50.128721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:50.129928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:50.167156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:50.170557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:50.171757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:50.174426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:51.315327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:51.323797 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31cb9f72-4630-405b-9709-8ece13177794 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1475 microversion: 2.1 time: 1.498523 Jul 19 19:41:51.334027 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 371/705] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:49 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1475 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:51.339206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-79c46e7e-9ee5-49ec-93f5-078e27f327e6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbba430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:51.428141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-79c46e7e-9ee5-49ec-93f5-078e27f327e6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.092733 Jul 19 19:41:51.432023 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 372/706] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:51 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:51.440183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:51.443652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:51.453841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:51.461893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:51.462347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:51.463178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:51.463614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:51.474095 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72ed58de-3cf1-4fac-aa42-d86bc7161de8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1323 microversion: 2.1 time: 1.385174 Jul 19 19:41:51.475337 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 335/707] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:50 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1323 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:51.490311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:51.491266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:51.503169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:51.503817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:51.504975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:51.505566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:51.513270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:51.734172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:51.782062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=36 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:51.951459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:51.962316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:51.964865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:51.967120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-921bff4e-3bc9-436c-b94c-0e3ed31d0b18 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 0.490610 Jul 19 19:41:51.968165 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 336/708] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:51 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:51.976711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:51.977645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:51.999533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.000249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.001283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.001935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.021048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-37d94669-aaa7-4210-ade2-5013f27a5519 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1613 microversion: 2.1 time: 0.587345 Jul 19 19:41:52.031399 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 373/709] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:51 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1613 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:52.039907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:52.049540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:52.071446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.071900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.103401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] Creating event network-changed:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h1-843834-3 Jul 19 19:41:52.111274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:41:52.129190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ef91f694-8e92-4210-b1f0-1468da062d49 req-7e001284-f1ed-482c-9af7-0ac3f7b79d60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101940 Jul 19 19:41:52.130419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 374/710] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:52.143868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:52.145012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:52.156360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.157739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.159664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.160576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.263619 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] HTTP exception thrown: Cannot 'migrate' instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 while it is in vm_state suspended Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Request method failure captured: Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831/action HTTP/1.1 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjJ21_SwtsP7soHZcQdlmGT_mwj9G9NL8d0Tv-ItJSydMbMBaU9usyTV_8neqfcyHZX_HmvHoh1LFF6lyUq7O1_xYRnOZWcx-1SbiarjmueLH5p6plVTMVlCIhR4g3Cts9X566ofx6rsetFflCIYHaJk90mwfhmjpmJwNRulRcO3l4 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:41:52.266523 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faef2728380045ccaf6e58ec80538629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faef2728380045ccaf6e58ec80538629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2260a0b6814a4cd7a7802e3acc8209cb Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: {"migrate": {}} Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:52.268215 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'migrate' instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 while it is in vm_state suspended Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1c9fe9d9-5f46-4c61-9c4d-99360dfa8831', 'body': {'migrate': {}}} Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 in vm_state suspended. Cannot resize while the instance is in this state. Jul 19 19:41:52.269053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 while it is in vm_state suspended Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.270526 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 while it is in vm_state suspended Jul 19 19:41:52.271846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.274718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Returning 409 to user: Cannot 'migrate' instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 while it is in vm_state suspended {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:52.275960 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91449d99-7d6b-43fb-b2b7-6332e5bc9381 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831/action" status: 409 len: 148 microversion: 2.1 time: 0.138048 Jul 19 19:41:52.276781 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 375/711] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:52 2022] POST /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831/action => generated 148 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:41:52.292444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-060774ea-17b7-4360-89aa-9058554edd35 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-060774ea-17b7-4360-89aa-9058554edd35 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Request method failure captured: Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action HTTP/1.1 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 39 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjJ21_SwtsP7soHZcQdlmGT_mwj9G9NL8d0Tv-ItJSydMbMBaU9usyTV_8neqfcyHZX_HmvHoh1LFF6lyUq7O1_xYRnOZWcx-1SbiarjmueLH5p6plVTMVlCIhR4g3Cts9X566ofx6rsetFflCIYHaJk90mwfhmjpmJwNRulRcO3l4 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:41:52.301318 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faef2728380045ccaf6e58ec80538629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faef2728380045ccaf6e58ec80538629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2260a0b6814a4cd7a7802e3acc8209cb Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: {"os-resetState": {"state": "invalid"}} Jul 19 19:41:52.303233 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '07331d7e-a7dd-4e6b-97d8-7900fd948d0d', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.304733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:41:52.309716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 19:41:52.316916 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.316916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-060774ea-17b7-4360-89aa-9058554edd35 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:52.316916 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-060774ea-17b7-4360-89aa-9058554edd35 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action" status: 400 len: 144 microversion: 2.1 time: 0.030215 Jul 19 19:41:52.318145 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 376/712] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:52 2022] POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action => generated 144 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:41:52.334822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecd71aca-1d52-4c1b-a2db-91205f36774c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecd71aca-1d52-4c1b-a2db-91205f36774c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Request method failure captured: Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action HTTP/1.1 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 31 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjJ21_SwtsP7soHZcQdlmGT_mwj9G9NL8d0Tv-ItJSydMbMBaU9usyTV_8neqfcyHZX_HmvHoh1LFF6lyUq7O1_xYRnOZWcx-1SbiarjmueLH5p6plVTMVlCIhR4g3Cts9X566ofx6rsetFflCIYHaJk90mwfhmjpmJwNRulRcO3l4 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:41:52.338797 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faef2728380045ccaf6e58ec80538629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faef2728380045ccaf6e58ec80538629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2260a0b6814a4cd7a7802e3acc8209cb Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: {"os-resetState": {"state": 1}} Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:41:52.340168 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '07331d7e-a7dd-4e6b-97d8-7900fd948d0d', 'body': {'os-resetState': {'state': 1}}} Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 1 Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:52.340940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 19:41:52.342324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.344281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecd71aca-1d52-4c1b-a2db-91205f36774c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:52.345283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ecd71aca-1d52-4c1b-a2db-91205f36774c tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action" status: 400 len: 120 microversion: 2.1 time: 0.020900 Jul 19 19:41:52.346008 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 377/713] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:52 2022] POST /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d/action => generated 120 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:41:52.350858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:52.355726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:52.364592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.365177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.366070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:52.366705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:52.855731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:52.858460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:52.875437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5ada843-f33b-4b41-97de-bcbbdb3dad68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1317 microversion: 2.1 time: 0.895064 Jul 19 19:41:52.876692 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 337/714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:51 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:52.884293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:52.888179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Failed to fetch instance by id 999 {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:41:52.890026 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Request method failure captured: Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 37 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjJ21_SwtsP7soHZcQdlmGT_mwj9G9NL8d0Tv-ItJSydMbMBaU9usyTV_8neqfcyHZX_HmvHoh1LFF6lyUq7O1_xYRnOZWcx-1SbiarjmueLH5p6plVTMVlCIhR4g3Cts9X566ofx6rsetFflCIYHaJk90mwfhmjpmJwNRulRcO3l4 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 19:41:52.896653 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faef2728380045ccaf6e58ec80538629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faef2728380045ccaf6e58ec80538629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faef2728380045ccaf6e58ec80538629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: faef2728380045ccaf6e58ec80538629 Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1537929440 Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2260a0b6814a4cd7a7802e3acc8209cb Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1537929440-project-admin Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: {"os-resetState": {"state": "error"}} Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:41:52.898180 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 999 could not be found. Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:41:52.899144 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:41:52.900615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:41:52.913112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4af5ca8-025a-4520-9f4f-ef1c29661515 tempest-ServersAdminNegativeTestJSON-1537929440 tempest-ServersAdminNegativeTestJSON-1537929440-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020309 Jul 19 19:41:52.922694 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 338/715] 10.222.0.23 () {60 vars in 1178 bytes} [Tue Jul 19 19:41:52 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:41:52.937692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07022528-0627-4b99-bc84-73618ce1c04f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efd588b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:53.028728 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07022528-0627-4b99-bc84-73618ce1c04f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.102247 Jul 19 19:41:53.039439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 339/716] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:52 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:53.052209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:53.052837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:53.067118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.067768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.068560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.070204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.599729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:53.610033 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8bbe561-33a8-4d29-bedc-c9069e9ef198 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1473 microversion: 2.1 time: 1.262845 Jul 19 19:41:53.614138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 378/717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:52 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1473 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:53.628712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-26f6fc60-ce2e-4ba5-8a96-6d974cce64a7 req-4d18afb9-f70e-4411-b300-f0cadc626d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a4442c-6871-400e-9654-315913202748", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:53.651520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-26f6fc60-ce2e-4ba5-8a96-6d974cce64a7 req-4d18afb9-f70e-4411-b300-f0cadc626d18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.651986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-26f6fc60-ce2e-4ba5-8a96-6d974cce64a7 req-4d18afb9-f70e-4411-b300-f0cadc626d18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.689692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-26f6fc60-ce2e-4ba5-8a96-6d974cce64a7 req-4d18afb9-f70e-4411-b300-f0cadc626d18 service nova] Creating event network-changed:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:41:53.709080 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-26f6fc60-ce2e-4ba5-8a96-6d974cce64a7 req-4d18afb9-f70e-4411-b300-f0cadc626d18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091511 Jul 19 19:41:53.714097 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 379/718] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:53.716572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:53.725269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:53.726073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:53.727224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1eb5824b-5670-4690-a369-0e9f443058ff tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 200 len: 1518 microversion: 2.1 time: 0.685772 Jul 19 19:41:53.730235 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 340/719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:53 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 1518 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:53.744914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.745143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:53.745834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:53.746449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.748122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.751649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.765799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.770948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:53.778592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:53.779191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:54.162836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:41:54.390463 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0fb6f0c5-6c8b-4f7d-bb10-4ad97af5a58f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 204 len: 0 microversion: 2.1 time: 0.674706 Jul 19 19:41:54.391268 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 380/720] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:41:53 2022] DELETE /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:41:54.397097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: .version_select at 0x7f23fe46ed30>, body: {"addFloatingIp": {"address": "172.25.8.202"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:54.398290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:54.410647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:54.415170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:54.417847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:54.420372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:54.566027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:54.616296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Acquired lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:41:54.996786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=26 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:55.393233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:55.417957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:55.429825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:55.433328 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d6725e5-ab4e-485b-a161-1ba950f827f5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 1.701518 Jul 19 19:41:55.437534 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 341/721] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:53 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:41:55.457430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:55.458275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:55.470077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:55.470544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:55.472788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:55.473269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:57.262968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:57.284935 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-06f69f8e-5324-464f-bd07-846ef744464a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1317 microversion: 2.1 time: 1.845051 Jul 19 19:41:57.286742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 342/722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:55 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1317 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:57.300451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-334c4394-cff3-464b-8f4e-8694df5a1157 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbaaca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:57.410003 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-334c4394-cff3-464b-8f4e-8694df5a1157 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.115564 Jul 19 19:41:57.415948 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 343/723] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:41:57 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:57.428536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:57.430625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:57.449121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:57.449557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:57.451250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:57.451427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:58.486765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:58.503217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30751878-3e42-4dd0-b78c-93e2879d8a41 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1468 microversion: 2.1 time: 1.090238 Jul 19 19:41:58.520133 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 344/724] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:57 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1468 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:58.525578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:58.526508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:58.534630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:41:58.537078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:58.537821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:58.538854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:58.539458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:59.380207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:41:59.391372 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fbac542a-b63a-4904-ba98-46d6c7626ca6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1470 microversion: 2.1 time: 0.869802 Jul 19 19:41:59.392214 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 345/725] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:41:58 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1470 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:41:59.410253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "name": "network-vif-plugged", "status": "completed", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:41:59.423233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:59.423674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:59.461623 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] Creating event network-vif-plugged:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h1-843834-3 Jul 19 19:41:59.482689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:41:59.522663 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ad236ed3-27a9-4e5b-906f-eeec071be4c4 req-35877398-f9a3-4652-b55b-4e9953b0d844 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129145 Jul 19 19:41:59.523837 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 346/726] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:41:59.541112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:41:59.542549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:41:59.551050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:59.552441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:41:59.559016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:41:59.559874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:01.093501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:01.148718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:01.150502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:01.151937 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cdb3e237-ac9b-4b0b-b6f1-cde478054519 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 1.615978 Jul 19 19:42:01.153049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 347/727] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:41:59 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:42:01.158264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:01.159068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:01.166509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:01.167491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:01.168441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:01.169029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.112978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:02.123261 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3fe5faa-23c0-4444-a1b0-f01e9c1cb8fe tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1317 microversion: 2.1 time: 0.968839 Jul 19 19:42:02.123848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 348/728] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:01 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:02.135857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e29a4010-6bfe-41bc-b6f8-abbc3e26df64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efc6fc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:02.226843 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e29a4010-6bfe-41bc-b6f8-abbc3e26df64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1412 microversion: 2.1 time: 0.101886 Jul 19 19:42:02.228246 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 349/729] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:42:02 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:02.239125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:02.241261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:02.256611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:02.257465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.262849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:02.263612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.359049 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] HTTP exception thrown: Instance has not been resized. Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Request method failure captured: Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8/action HTTP/1.1 Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 21 Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whn-eF1vBE4jYYG48DzjVdRU_eVGp4x6DOQNX9ra8L0QJ7cSJb5CwTIHLLGrP-RcOxX9CqssHV_5UPwohrWQmN-47YTKUjW14bnHZmcqQ3KOrOmq-SNAzcIE0wi1aBAaW27AAA-mc2vwrJM-a556s9OTIiWKatW9VFWXLUb3ESn5bM Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:02.361490 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MigrationsAdminTest-2115400133 Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f2e7f9d9c6ab4b20aa20b98a514bf701 Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: {"confirmResize": {}} Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance has not been resized. Jul 19 19:42:02.362874 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '99ed56a7-e411-444c-b8bd-257d3c0635b8', 'body': {'confirmResize': {}}} Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 988, in _action_confirm_resize Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.confirm_resize(context, instance) Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3975, in confirm_resize Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi migration = objects.Migration.get_by_instance_and_status( Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/migration.py", line 164, in get_by_instance_and_status Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_migration = db.migration_get_by_instance_and_status( Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 224, in wrapper Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 3300, in migration_get_by_instance_and_status Jul 19 19:42:02.363898 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.MigrationNotFoundByStatus(instance_id=instance_uuid, Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.MigrationNotFoundByStatus: Migration not found for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 with status finished. Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 991, in _action_confirm_resize Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Instance has not been resized. Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:02.365032 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance has not been resized. Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Returning 400 to user: Instance has not been resized. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9f5b564-c445-47d0-b499-82782dadc9c8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8/action" status: 400 len: 74 microversion: 2.1 time: 0.131468 Jul 19 19:42:02.366336 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 350/730] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:02 2022] POST /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8/action => generated 74 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:42:02.378696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:02.379382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:02.396304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:02.396780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.397734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:02.398185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.493156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:02.494116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:02.494834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lazy-loading 'fault' on Instance uuid 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:42:03.011204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Building network info cache for instance {{(pid=131229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:03.052588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:03.066185 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f6a8a2b-9d88-4dde-b160-41f4cf344fd6 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 200 len: 1311 microversion: 2.1 time: 0.701417 Jul 19 19:42:03.075459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 351/731] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:02 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 1311 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:03.096265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-204bd05f-84ff-48f8-a5bf-ac326bf1cbdc req-e941c727-9c04-4f1b-8b21-b32cd2592f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65301ea-31b5-4e24-a345-ad9c73259006", "tag": "5d4562a7-1248-49bc-93a4-e4639838a290"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:03.156564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-204bd05f-84ff-48f8-a5bf-ac326bf1cbdc req-e941c727-9c04-4f1b-8b21-b32cd2592f04 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:03.157300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-204bd05f-84ff-48f8-a5bf-ac326bf1cbdc req-e941c727-9c04-4f1b-8b21-b32cd2592f04 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:03.188733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-204bd05f-84ff-48f8-a5bf-ac326bf1cbdc req-e941c727-9c04-4f1b-8b21-b32cd2592f04 service nova] Creating event network-changed:5d4562a7-1248-49bc-93a4-e4639838a290 for instance f65301ea-31b5-4e24-a345-ad9c73259006 on n-h1-843834-3 Jul 19 19:42:03.196445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-204bd05f-84ff-48f8-a5bf-ac326bf1cbdc req-e941c727-9c04-4f1b-8b21-b32cd2592f04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115531 Jul 19 19:42:03.199095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 352/732] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:03.212538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:03.217425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:03.240059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:03.240526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:03.241522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:03.242249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:04.422470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:04.626987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:04.638100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:04.642817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:04.645692 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a5f0339-d393-4445-bb02-5634de02096a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 1.444449 Jul 19 19:42:04.647579 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 353/733] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:42:03 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:42:04.654288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2ceff9b-520d-4f9a-aa10-e5b18faa552f tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:04.662688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2ceff9b-520d-4f9a-aa10-e5b18faa552f tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013853 Jul 19 19:42:04.663547 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 354/734] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:42:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:04.668854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:04.669479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:04.677881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:04.679365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:04.680796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:04.681588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.094324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:05.103630 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-96acd77b-97b7-4ce4-a139-066072aaa0b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1317 microversion: 2.1 time: 0.438707 Jul 19 19:42:05.114271 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 355/735] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:04 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:05.121058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c332f9e2-6d4c-47d2-b6fd-c8e1a379edba tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efe6c550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.178861 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c332f9e2-6d4c-47d2-b6fd-c8e1a379edba tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1421 microversion: 2.1 time: 0.062557 Jul 19 19:42:05.179492 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 356/736] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:42:05 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1421 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:05.189820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.190434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:05.206775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.207612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.208722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.209338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.240885 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] HTTP exception thrown: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Request method failure captured: Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 HTTP/1.1 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjHDLj7Uhaf-K_fiXsY_pbbRu17-oVQJhvnEP7DluQTxNcS2dgqOjonWtIF6Ja5GbdYkVS9Ft7A55OLi2N0i7WI_tcF8z0GrjG3IeSVtAgukHzvdqTh7O6vIABuyYNElz6lmEU4Qs4SHB3pcKetivEH4lEuegBz1KKDUfKYfoR6lm4 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 18380558db0c48d5b36915e4d6762a8f Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:05.243175 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 18380558db0c48d5b36915e4d6762a8f Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAdminNegativeTestJSON-948272244-project Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 26c9a76c91e24c16ad70bf0434eb0dd6 Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948272244-project Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. Jul 19 19:42:05.244920 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1c9fe9d9-5f46-4c61-9c4d-99360dfa8831'} Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:05.245869 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. Jul 19 19:42:05.247440 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:05.250603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Returning 404 to user: Instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:05.251728 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5eb43ab-2437-4a98-970c-bff2d0da8b2f tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831" status: 404 len: 111 microversion: 2.1 time: 0.071321 Jul 19 19:42:05.252861 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 357/737] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:05 2022] GET /compute/v2.1/servers/1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:05.262939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2e92efc2-55e5-4f47-912c-64a1f715d8ac req-172f9b5d-13f3-4f91-98a3-983c9e7651b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4442c-6871-400e-9654-315913202748", "name": "network-vif-plugged", "status": "completed", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:05.276953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e92efc2-55e5-4f47-912c-64a1f715d8ac req-172f9b5d-13f3-4f91-98a3-983c9e7651b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.277453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e92efc2-55e5-4f47-912c-64a1f715d8ac req-172f9b5d-13f3-4f91-98a3-983c9e7651b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.292315 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2e92efc2-55e5-4f47-912c-64a1f715d8ac req-172f9b5d-13f3-4f91-98a3-983c9e7651b5 service nova] Creating event network-vif-plugged:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:42:05.297790 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2e92efc2-55e5-4f47-912c-64a1f715d8ac req-172f9b5d-13f3-4f91-98a3-983c9e7651b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043423 Jul 19 19:42:05.298992 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 358/738] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:05.304366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ab2c77d-a73f-4273-a9fd-319b32d1933d tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-526942138", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:05.305895 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:42:05.305895 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:42:05.329528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ab2c77d-a73f-4273-a9fd-319b32d1933d tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.029163 Jul 19 19:42:05.336342 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 359/739] 10.222.0.23 () {60 vars in 1145 bytes} [Tue Jul 19 19:42:05 2022] POST /compute/v2.1/flavors => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:05.338766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01c3a751-d2d8-4b47-bca8-f896c6a90b6b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efccf1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.408933 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01c3a751-d2d8-4b47-bca8-f896c6a90b6b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 200 len: 1421 microversion: 2.1 time: 0.076332 Jul 19 19:42:05.419860 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 360/740] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:42:05 2022] GET /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:05.427629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.429266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:05.436689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.437537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.438453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.439648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.472818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:42:05.476476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Updating instance_info_cache with network_info: [{"id": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7", "address": "fa:16:3e:40:d9:44", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b74e9c7-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:05.493934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Releasing lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:42:05.495250 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba6195d3-fe3a-496b-acfa-7e5aa5b3a003 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action" status: 202 len: 0 microversion: 2.1 time: 11.102752 Jul 19 19:42:05.497118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 381/741] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:41:54 2022] POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action => generated 0 bytes in 11105 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:42:05.507608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2454590c-4bf7-4f5a-a46a-a74b2f0375f9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.533019 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2454590c-4bf7-4f5a-a46a-a74b2f0375f9 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034050 Jul 19 19:42:05.535703 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 382/742] 10.222.0.23 () {58 vars in 1181 bytes} [Tue Jul 19 19:42:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:05.550123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e69df107-4036-4e8a-adfe-3958c895c859 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbbaca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:05.619117 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0f608ab-1b96-4cfc-b9f5-1e4e5e704917 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 204 len: 0 microversion: 2.1 time: 0.195930 Jul 19 19:42:05.626036 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 361/743] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:05 2022] DELETE /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:05.641735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9fe9d9-5f46-4c61-9c4d-99360dfa8831", "name": "network-vif-deleted", "tag": "7a5ad2cc-2ba8-43a2-a488-b8a420dea90d"}, {"name": "network-changed", "server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:05.654841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.655553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.672721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] Creating event network-vif-deleted:7a5ad2cc-2ba8-43a2-a488-b8a420dea90d for instance 1c9fe9d9-5f46-4c61-9c4d-99360dfa8831 on n-h2-843834-3 Jul 19 19:42:05.673523 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] Creating event network-changed:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:42:05.683151 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e09287cc-9e41-4e9f-b633-bd4b1dfa9a4d req-8da0413d-b547-484f-930f-c84a695a68b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053350 Jul 19 19:42:05.683937 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 362/744] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:05.695224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: .version_select at 0x7f23fe453c10>, body: {"addFloatingIp": {"address": "172.25.8.202"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:05.696598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:05.704494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.705219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.708574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:05.709441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:05.807011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:05.842168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Acquired lock "refresh_cache-c35603c8-3daf-46ef-8550-022380364af1" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:42:06.521927 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e69df107-4036-4e8a-adfe-3958c895c859 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 204 len: 0 microversion: 2.1 time: 0.984910 Jul 19 19:42:06.527382 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 383/745] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:05 2022] DELETE /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:06.532131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:06.532894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:06.550862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:06.555101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:06.557538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:06.557997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:07.789124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9a76c91e24c16ad70bf0434eb0dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18380558db0c48d5b36915e4d6762a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:07.801993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57bb5e19-c6fd-4f06-a206-80c600a127bd tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 200 len: 1477 microversion: 2.1 time: 1.275009 Jul 19 19:42:07.806529 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 384/746] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:06 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 1477 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:07.822199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:07.823676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:07.839843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:07.840317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:07.841157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:07.841591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:08.384996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:08.399027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:08.404518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:08.405688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d7b41f2-bd7f-4cb4-9942-5b095a9a3710 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1410 microversion: 2.25 time: 0.597970 Jul 19 19:42:08.406248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 385/747] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:42:07 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1410 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:42:08.421662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1590287737", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "7a52ef57-f368-4e08-af4c-f60a7ee57ad4"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:08.537163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:10.396579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:10.397133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:10.397718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:10.398320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:10.398887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:10.424472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:10.424959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:10.425829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:10.426337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:10.471450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:10.477605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for user f2e7f9d9c6ab4b20aa20b98a514bf701 and project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:10.494081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:10.497521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:10.572588 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a8f518a-fa5b-4339-a0be-3b0eafba60d3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.160390 Jul 19 19:42:10.573149 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 386/748] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:42:10.602127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:10.605132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:10.618340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:10.620485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:10.624595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:10.625484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.507322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:11.523412 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b65d460-038a-4ef0-b765-74797f782a5f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1317 microversion: 2.1 time: 0.933645 Jul 19 19:42:11.524027 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 387/749] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:10 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:11.534102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:11.534819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:11.545982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:11.546437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.547269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:11.547712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.590548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:42:11.733524 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36de5d5e-5472-446c-a966-d4fe16735fcc tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 204 len: 0 microversion: 2.1 time: 0.204720 Jul 19 19:42:11.736367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 388/750] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:11 2022] DELETE /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:11.753984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:11.755857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] [instance: 07331d7e-a7dd-4e6b-97d8-7900fd948d0d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:11.765640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:11.766417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.768261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:11.768942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.859946 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] HTTP exception thrown: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Request method failure captured: Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d HTTP/1.1 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjHDLj7Uhaf-K_fiXsY_pbbRu17-oVQJhvnEP7DluQTxNcS2dgqOjonWtIF6Ja5GbdYkVS9Ft7A55OLi2N0i7WI_tcF8z0GrjG3IeSVtAgukHzvdqTh7O6vIABuyYNElz6lmEU4Qs4SHB3pcKetivEH4lEuegBz1KKDUfKYfoR6lm4 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 18380558db0c48d5b36915e4d6762a8f Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:11.867624 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18380558db0c48d5b36915e4d6762a8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 18380558db0c48d5b36915e4d6762a8f Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948272244 Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-948272244-project Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 26c9a76c91e24c16ad70bf0434eb0dd6 Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948272244-project Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. Jul 19 19:42:11.869267 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '07331d7e-a7dd-4e6b-97d8-7900fd948d0d'} Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:11.870143 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. Jul 19 19:42:11.871547 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:11.875364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] Returning 404 to user: Instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:11.877865 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c90c7999-c3ee-49ae-94b6-b09f5a9c3b56 tempest-ServersAdminNegativeTestJSON-948272244 tempest-ServersAdminNegativeTestJSON-948272244-project] 10.222.0.23 "GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d" status: 404 len: 111 microversion: 2.1 time: 0.134709 Jul 19 19:42:11.880370 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 389/751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:11 2022] GET /compute/v2.1/servers/07331d7e-a7dd-4e6b-97d8-7900fd948d0d => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:11.911255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-35e5a656-70b9-4b14-9ae5-aa8bf8d4a357 req-2b449e6b-cde0-404a-a32a-be654f42eb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07331d7e-a7dd-4e6b-97d8-7900fd948d0d", "name": "network-vif-deleted", "tag": "0294373d-4a74-4d08-82a4-7b894a11394c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:11.934977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-35e5a656-70b9-4b14-9ae5-aa8bf8d4a357 req-2b449e6b-cde0-404a-a32a-be654f42eb8c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:11.937388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-35e5a656-70b9-4b14-9ae5-aa8bf8d4a357 req-2b449e6b-cde0-404a-a32a-be654f42eb8c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:11.968284 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-35e5a656-70b9-4b14-9ae5-aa8bf8d4a357 req-2b449e6b-cde0-404a-a32a-be654f42eb8c service nova] Creating event network-vif-deleted:0294373d-4a74-4d08-82a4-7b894a11394c for instance 07331d7e-a7dd-4e6b-97d8-7900fd948d0d on n-h1-843834-3 Jul 19 19:42:11.985606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-35e5a656-70b9-4b14-9ae5-aa8bf8d4a357 req-2b449e6b-cde0-404a-a32a-be654f42eb8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094229 Jul 19 19:42:11.988153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 390/752] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:11.999247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:12.003362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:12.038396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:12.039421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:12.040847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:12.049472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:12.528392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:12.556428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:12.559633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:12.560910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49abed3d-b49b-446f-bd14-1c9c309191ac tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1606 microversion: 2.25 time: 0.569636 Jul 19 19:42:12.561552 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 391/753] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:42:11 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1606 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:42:12.589088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4ff06b6c-abf0-44b0-a8fe-7b105217a859 req-8133be1d-76c0-4b8c-9c30-1216bc021a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65301ea-31b5-4e24-a345-ad9c73259006", "name": "network-vif-plugged", "status": "completed", "tag": "5d4562a7-1248-49bc-93a4-e4639838a290"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:12.611369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ff06b6c-abf0-44b0-a8fe-7b105217a859 req-8133be1d-76c0-4b8c-9c30-1216bc021a18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:12.611830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ff06b6c-abf0-44b0-a8fe-7b105217a859 req-8133be1d-76c0-4b8c-9c30-1216bc021a18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:12.673391 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4ff06b6c-abf0-44b0-a8fe-7b105217a859 req-8133be1d-76c0-4b8c-9c30-1216bc021a18 service nova] Creating event network-vif-plugged:5d4562a7-1248-49bc-93a4-e4639838a290 for instance f65301ea-31b5-4e24-a345-ad9c73259006 on n-h1-843834-3 Jul 19 19:42:12.684069 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4ff06b6c-abf0-44b0-a8fe-7b105217a859 req-8133be1d-76c0-4b8c-9c30-1216bc021a18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105477 Jul 19 19:42:12.694560 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 392/754] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:12.753566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:12.754505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:12.823008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:12.823662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:12.835770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:12.836266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:13.040715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:13.069963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:13.090276 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b034052-5a71-4510-8641-14eddc58b4fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1331 microversion: 2.1 time: 0.389381 Jul 19 19:42:13.090931 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 393/755] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:12 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:13.131795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-178109477", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "45b415df-4896-4487-90b1-97e9e05cd7c2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:13.286101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] validate_networks() for [('45b415df-4896-4487-90b1-97e9e05cd7c2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:13.519242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.network.neutron [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] re-assign floating IP 172.25.8.202 from instance 7bd99a05-fe45-446e-aab3-27dbb7be771d Jul 19 19:42:13.577015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Building network info cache for instance {{(pid=131230) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:15.704476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:15.752281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:15.753004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:15.755435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:15.755957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:15.758898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:15.783514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:15.783984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:15.784803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:15.785333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:15.835219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:15.848646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for user cf462f1353f342b395e856a1f3cbafb2 and project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:15.883673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:15.891033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:16.016704 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d79b8ba1-8f16-4bbb-82d7-b53c2f8f8380 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.924603 Jul 19 19:42:16.040994 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 394/756] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:42:16.054984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:16.061901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:16.114058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:16.115738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:16.119187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:16.120320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:17.563407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Updating instance_info_cache with network_info: [{"id": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7", "address": "fa:16:3e:40:d9:44", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b74e9c7-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:17.594016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Building network info cache for instance {{(pid=131230) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:17.645463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:17.665892 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0aa7b2a-9038-456a-89f9-9ba5a97d2ea2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1467 microversion: 2.1 time: 1.622975 Jul 19 19:42:17.685466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 395/757] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:16 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1467 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:17.715983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:17.725553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:17.751951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:17.752421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:17.753321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:17.753999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.001466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14616e86-094c-423f-a7a0-02deb4c1a976 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-interface" status: 200 len: 285 microversion: 2.25 time: 1.313246 Jul 19 19:42:19.012726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 396/758] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:42:17 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-interface => generated 285 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:42:19.017871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d58af9d4-0fc1-45d9-964f-c30b3ee04995 req-74a2136e-1335-41c7-a2b3-df51c0c50ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:19.032268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d58af9d4-0fc1-45d9-964f-c30b3ee04995 req-74a2136e-1335-41c7-a2b3-df51c0c50ed2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.032926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d58af9d4-0fc1-45d9-964f-c30b3ee04995 req-74a2136e-1335-41c7-a2b3-df51c0c50ed2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.050347 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d58af9d4-0fc1-45d9-964f-c30b3ee04995 req-74a2136e-1335-41c7-a2b3-df51c0c50ed2 service nova] Creating event network-changed:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:42:19.057505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d58af9d4-0fc1-45d9-964f-c30b3ee04995 req-74a2136e-1335-41c7-a2b3-df51c0c50ed2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043180 Jul 19 19:42:19.058769 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 397/759] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:19.065101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:19.066646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:19.077082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.078629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.080649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.081610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.818945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:19.837390 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7b39f34-d9be-4586-9e28-025c2775960a tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 0.776617 Jul 19 19:42:19.838231 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 398/760] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:19 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:19.858631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-55a084cc-0a75-4717-b5e2-fa5d199633e9 req-95a993e5-5656-4bbb-92f3-a5fd526a351e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff7eeea-caec-4195-bc05-20d03a396763", "name": "network-vif-unplugged", "status": "completed", "tag": "50297935-5077-4746-8d82-c394ebb3d29f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:19.882765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55a084cc-0a75-4717-b5e2-fa5d199633e9 req-95a993e5-5656-4bbb-92f3-a5fd526a351e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.883249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55a084cc-0a75-4717-b5e2-fa5d199633e9 req-95a993e5-5656-4bbb-92f3-a5fd526a351e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.919743 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-55a084cc-0a75-4717-b5e2-fa5d199633e9 req-95a993e5-5656-4bbb-92f3-a5fd526a351e service nova] Creating event network-vif-unplugged:50297935-5077-4746-8d82-c394ebb3d29f for instance 3ff7eeea-caec-4195-bc05-20d03a396763 on n-h2-843834-3 Jul 19 19:42:19.933703 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-55a084cc-0a75-4717-b5e2-fa5d199633e9 req-95a993e5-5656-4bbb-92f3-a5fd526a351e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085122 Jul 19 19:42:19.934501 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 399/761] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:19.963186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:19.965060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:19.981638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.983463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:19.986355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:19.987301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:20.355388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:20.378080 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9b4a5ca-66fd-49ea-a928-740f386ce426 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1265 microversion: 2.1 time: 0.442498 Jul 19 19:42:20.380218 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 400/762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:19 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:20.938186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:20.938800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:20.946266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:20.946720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:20.947541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:20.948009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:21.882304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Updating instance_info_cache with network_info: [{"id": "00a8e9ed-660e-45eb-a1c1-b16f95f95857", "address": "fa:16:3e:bc:79:14", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00a8e9ed-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:21.898142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Releasing lock "refresh_cache-c35603c8-3daf-46ef-8550-022380364af1" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:42:21.899044 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-569d412b-2d9c-44f5-bb3a-27a514969ce6 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1/action" status: 202 len: 0 microversion: 2.1 time: 16.213854 Jul 19 19:42:21.900270 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 363/763] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:05 2022] POST /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1/action => generated 0 bytes in 16215 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:42:21.905391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b1e96f6-cd23-4262-86f9-e08adf96d23c tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23eff12430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:21.952434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b1e96f6-cd23-4262-86f9-e08adf96d23c tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1" status: 200 len: 636 microversion: 2.1 time: 0.050928 Jul 19 19:42:21.961481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 364/764] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:42:21 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1 => generated 636 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:21.966793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:21.967655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:21.976964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:21.977636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:21.978563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:21.979173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:22.235093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-042940eb-2d91-4f6b-8159-2c78be04fcae tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1618 microversion: 2.1 time: 1.851506 Jul 19 19:42:22.236390 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 401/765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:20 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1618 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:22.432782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:22.448006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca22eea1-48b5-4fc0-9490-93fd27275cfc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 0.484833 Jul 19 19:42:22.448875 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 365/766] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:21 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:22.455444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35603c8-3daf-46ef-8550-022380364af1", "tag": "00a8e9ed-660e-45eb-a1c1-b16f95f95857"}, {"server_uuid": "3ff7eeea-caec-4195-bc05-20d03a396763", "name": "network-vif-deleted", "tag": "50297935-5077-4746-8d82-c394ebb3d29f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:22.479248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:22.480109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:22.507827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-246336828", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:22.519449 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] Creating event network-changed:00a8e9ed-660e-45eb-a1c1-b16f95f95857 for instance c35603c8-3daf-46ef-8550-022380364af1 on n-h2-843834-3 Jul 19 19:42:22.520488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] Creating event network-vif-deleted:50297935-5077-4746-8d82-c394ebb3d29f for instance 3ff7eeea-caec-4195-bc05-20d03a396763 on n-h2-843834-3 Jul 19 19:42:22.545818 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2ac48aac-b2e6-4e27-b3f3-aaf268c3224d req-3f4f3f59-3271-4f71-9701-20d11c00654d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.095278 Jul 19 19:42:22.546705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 366/767] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:22.577714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8c8ca112-7164-4203-8444-686e15959dc1 req-4bedf3ec-ced8-4e1e-8834-476137a43a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a4442c-6871-400e-9654-315913202748", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:22.593640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:22.621569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c8ca112-7164-4203-8444-686e15959dc1 req-4bedf3ec-ced8-4e1e-8834-476137a43a8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:22.622504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c8ca112-7164-4203-8444-686e15959dc1 req-4bedf3ec-ced8-4e1e-8834-476137a43a8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:22.664133 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8c8ca112-7164-4203-8444-686e15959dc1 req-4bedf3ec-ced8-4e1e-8834-476137a43a8d service nova] Creating event network-changed:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:42:22.709141 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8c8ca112-7164-4203-8444-686e15959dc1 req-4bedf3ec-ced8-4e1e-8834-476137a43a8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159149 Jul 19 19:42:22.714039 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 367/768] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:22.727113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:22.728688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:22.743442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:22.744147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:22.745123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:22.745739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:23.461052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:23.541264 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc08a01b-0349-4fa5-8a8e-c0b4476fba06 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.805382 Jul 19 19:42:23.547002 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 368/769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:22 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:23.554786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: .version_select at 0x7f23fe5d71f0>, body: {"removeFloatingIp": {"address": "172.25.8.202"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:23.555244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:23.555963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:23.556739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:23.557628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:23.558256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:23.585497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:23.586403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:23.587891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:23.588818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:23.671516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Getting quotas for project 28c83ef532d04a6e93ee4c1075a23623. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:23.677977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Getting quotas for user d30d4842de5b47a0a13fcfe6d816a092 and project 28c83ef532d04a6e93ee4c1075a23623. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:23.692733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:23.695409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:23.762690 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85a85dd0-53f4-442d-acf1-832c048e45c8 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.524820 Jul 19 19:42:23.763726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 402/770] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:42:23.780014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3eda3978-1967-4739-b30f-183cfd0b33bb tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23efbc68b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:23.883020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3eda3978-1967-4739-b30f-183cfd0b33bb tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:23.888378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3eda3978-1967-4739-b30f-183cfd0b33bb tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:24.275352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:24.284131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:24.284664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:24.287057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:24.287567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:24.334108 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3eda3978-1967-4739-b30f-183cfd0b33bb tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.559424 Jul 19 19:42:24.335010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 403/771] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:23 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:24.345979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: .version_select at 0x7f23efcdd160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1753663249", "policies": ["affinity"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:24.370145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:24.391823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:24.400384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:24.464243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:24.471071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:24.490124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b09d067-a23a-4d42-868f-8383519c60c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.149751 Jul 19 19:42:24.511154 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 404/772] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Jul 19 19:42:24 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:24.516520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:24.517142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:24.542321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:24.545653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:24.551673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:24.552380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:25.499626 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] HTTP exception thrown: Floating IP 172.25.8.202 is not associated with instance 7bd99a05-fe45-446e-aab3-27dbb7be771d. Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Request method failure captured: Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action HTTP/1.1 Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 49 Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjCehFY_833p-QqRceR5hlbwROh3U-Cq12Z5npbNSiUpp6rdfLlYsbSgXBS3EU_hK7almc-069NEa1K0UcX4IzGPiESaMCRXDeEdCJhikjH0L_JjrujGQd3EaRWvk-9G8wzPnS6UF8erbUOj5ii4LnI-hR6_yXo6LXmzL1rLcDJgQA Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:25.501147 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ea9cf9a38a804fdc8c053db13a1395be Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: {"removeFloatingIp": {"address": "172.25.8.202"}} Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:42:25.502737 n-d-843834-3 devstack@n-api.service[131230]: exception: Floating IP 172.25.8.202 is not associated with instance 7bd99a05-fe45-446e-aab3-27dbb7be771d. Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '7bd99a05-fe45-446e-aab3-27dbb7be771d', 'body': {'removeFloatingIp': {'address': '172.25.8.202'}}} Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.202 is not associated with instance 7bd99a05-fe45-446e-aab3-27dbb7be771d. Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:25.503722 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.202 is not associated with instance 7bd99a05-fe45-446e-aab3-27dbb7be771d. Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Returning 409 to user: Floating IP 172.25.8.202 is not associated with instance 7bd99a05-fe45-446e-aab3-27dbb7be771d. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a533b7ad-f5b0-4e93-8089-7e936fe5af6e tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action" status: 409 len: 146 microversion: 2.1 time: 1.959604 Jul 19 19:42:25.505124 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 369/773] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:23 2022] POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action => generated 146 bytes in 1961 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:25.509763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:25.510381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:25.524443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:25.524910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:25.525729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:25.526171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:25.656257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:25.669813 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf837f4b-ff8c-40f1-abcb-10300633e9fe tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 1.157125 Jul 19 19:42:25.672212 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 405/774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:24 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:25.688340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70cc5530-cfc4-48f3-ac1f-81e6e876196f tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23efac4700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:25.720338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:25.746344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3e66faec-3f24-46db-9f48-2c23bcc94d38 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1277 microversion: 2.1 time: 0.241555 Jul 19 19:42:25.747071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 370/775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:25 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:25.767660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:25.768316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:25.785352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:25.785814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:25.787051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:25.787468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:26.136500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:26.150244 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad73d643-b4a0-4868-95cd-161706382bd0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.395216 Jul 19 19:42:26.151859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 371/776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:25 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:26.158013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e39063ce-d5bb-4edf-9950-f6775bc5bbb9 req-daae6373-f937-42b5-8244-51b96ff8c595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:26.172657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e39063ce-d5bb-4edf-9950-f6775bc5bbb9 req-daae6373-f937-42b5-8244-51b96ff8c595 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:26.173114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e39063ce-d5bb-4edf-9950-f6775bc5bbb9 req-daae6373-f937-42b5-8244-51b96ff8c595 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:26.185432 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e39063ce-d5bb-4edf-9950-f6775bc5bbb9 req-daae6373-f937-42b5-8244-51b96ff8c595 service nova] Creating event network-changed:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:42:26.191167 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e39063ce-d5bb-4edf-9950-f6775bc5bbb9 req-daae6373-f937-42b5-8244-51b96ff8c595 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036858 Jul 19 19:42:26.195223 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 372/777] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:26.201845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1179634453", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9741dc1c-5fcb-4b4a-a275-f4c64cd89589"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:26.267513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70cc5530-cfc4-48f3-ac1f-81e6e876196f tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "DELETE /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.593912 Jul 19 19:42:26.268095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 406/778] 10.222.0.23 () {58 vars in 1295 bytes} [Tue Jul 19 19:42:25 2022] DELETE /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_version => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:26.277036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: .version_select at 0x7f23fe46edc0>, body: {"removeFloatingIp": {"address": "172.25.8.202"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:26.314177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:26.569983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:26.578983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:26.579513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:26.580464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:26.580993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:26.969773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:26.970260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:26.970671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:26.972711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:26.973142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:27.063761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:27.072904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:27.074349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:27.075022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:27.121879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:27.129689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:27.147806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 2 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:27.152110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:27.176464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Acquired lock "refresh_cache-c35603c8-3daf-46ef-8550-022380364af1" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:42:27.206526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131230) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 19:42:27.240817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:27.250452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:27.348033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:27.354230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:27.373242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=bbf90241-8ceb-4472-97d5-0b605582780d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:27.465231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:27.473731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:27.549993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:27.560462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:27.605755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-408e7982-985c-4f1d-a5ea-3e45601c7873 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.408834 Jul 19 19:42:27.610756 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 373/779] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1414 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:27.617697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fb45495-647f-44aa-b33f-ee5e39879c8d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23efd9ce50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:27.676174 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fb45495-647f-44aa-b33f-ee5e39879c8d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.062439 Jul 19 19:42:27.677408 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 374/780] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:27 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:27.683725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:27.685411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:27.693968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:27.695001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:27.696631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:27.697289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:28.923069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:28.960280 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29a5fc49-31c7-48ba-8c6a-de28ed4228aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 1.281547 Jul 19 19:42:28.979091 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 375/781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:27 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:28.989752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:28.990382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:28.999394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.000288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.002415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.003308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.262154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:29.290571 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b3488ac-3de1-4503-9e3a-4da4852ca3e4 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1319 microversion: 2.1 time: 0.310209 Jul 19 19:42:29.300676 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 376/782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:28 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:29.307644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:29.308353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:29.324712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.324712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.325057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Building network info cache for instance {{(pid=131229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:29.325526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.325526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.602153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:29.611054 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-15113422-a8e5-4f51-ab59-3457609560af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.307686 Jul 19 19:42:29.614030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 377/783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:29 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:29.630120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:29.643740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:29.647233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Searching by: {'deleted': False, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:42:29.660895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.664359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.668032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:29.669109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:29.876975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:42:30.015059 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5af5d269-ca2c-445c-a5ea-786e8855430b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.388757 Jul 19 19:42:30.015976 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 378/784] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:42:29 2022] GET /compute/v2.1/servers => generated 1004 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:30.023296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-77d5eb5d-0c04-4fd6-8904-0432f95cce4d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23efd43d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:30.148247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-77d5eb5d-0c04-4fd6-8904-0432f95cce4d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:30.167408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:30.172358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-77d5eb5d-0c04-4fd6-8904-0432f95cce4d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:30.569707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-77d5eb5d-0c04-4fd6-8904-0432f95cce4d tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552629 Jul 19 19:42:30.571826 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 379/785] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:30 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:30.576985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-38644fd7-ea84-45cd-88e7-eabdfc6fecd3 req-65c3a1a4-4a83-4d70-977d-3f89d5dcdad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360bc800-b98b-4fd8-83f8-469cbea4ca96", "tag": "afcf58de-805b-498d-9c10-e716740eb182"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:30.588165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-38644fd7-ea84-45cd-88e7-eabdfc6fecd3 req-65c3a1a4-4a83-4d70-977d-3f89d5dcdad3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:30.588860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-38644fd7-ea84-45cd-88e7-eabdfc6fecd3 req-65c3a1a4-4a83-4d70-977d-3f89d5dcdad3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:30.602527 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-38644fd7-ea84-45cd-88e7-eabdfc6fecd3 req-65c3a1a4-4a83-4d70-977d-3f89d5dcdad3 service nova] Creating event network-changed:afcf58de-805b-498d-9c10-e716740eb182 for instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 on n-h2-843834-3 Jul 19 19:42:30.611263 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-38644fd7-ea84-45cd-88e7-eabdfc6fecd3 req-65c3a1a4-4a83-4d70-977d-3f89d5dcdad3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035914 Jul 19 19:42:30.612369 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 380/786] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:30.618421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f0d0102b-c523-4eac-a286-a0a50f850bf4 req-dc9023b0-35c0-4c95-a1bd-f757037f9aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd", "tag": "7f8ff442-d5ff-44bd-8530-4a6bd1170e3e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:30.628279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0d0102b-c523-4eac-a286-a0a50f850bf4 req-dc9023b0-35c0-4c95-a1bd-f757037f9aa1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:30.628853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0d0102b-c523-4eac-a286-a0a50f850bf4 req-dc9023b0-35c0-4c95-a1bd-f757037f9aa1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:30.646599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f0d0102b-c523-4eac-a286-a0a50f850bf4 req-dc9023b0-35c0-4c95-a1bd-f757037f9aa1 service nova] Creating event network-changed:7f8ff442-d5ff-44bd-8530-4a6bd1170e3e for instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd on n-h2-843834-3 Jul 19 19:42:30.651470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f0d0102b-c523-4eac-a286-a0a50f850bf4 req-dc9023b0-35c0-4c95-a1bd-f757037f9aa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037081 Jul 19 19:42:30.652400 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 381/787] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:30.663260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:30.665261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:30.673027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:30.675570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:30.676669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:30.677325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.202705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:31.210861 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-51fa0381-f24b-4778-8555-852633e2b6b1 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 0.557323 Jul 19 19:42:31.233387 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 382/788] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:30 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:31.241164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:31.241839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:31.259090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.259951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.262203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.263388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.364789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Updating instance_info_cache with network_info: [{"id": "00a8e9ed-660e-45eb-a1c1-b16f95f95857", "address": "fa:16:3e:bc:79:14", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00a8e9ed-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:31.391011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Releasing lock "refresh_cache-c35603c8-3daf-46ef-8550-022380364af1" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:42:31.392627 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4959f25a-51d0-4236-9fdd-2ed30ee29d2a tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1/action" status: 202 len: 0 microversion: 2.1 time: 5.119370 Jul 19 19:42:31.393689 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 407/789] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:26 2022] POST /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1/action => generated 0 bytes in 5125 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:42:31.410546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:31.411520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:31.424939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.427392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.428355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.429357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.454519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:31.464512 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-383f0960-ac61-47d4-a5fc-aec375bbb4ef tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1277 microversion: 2.1 time: 0.238710 Jul 19 19:42:31.465272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 383/790] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:31 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:31.483484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-574f4393-4d51-4bbd-a21c-4d8dd24bb81e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23fe11d040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:31.556137 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-574f4393-4d51-4bbd-a21c-4d8dd24bb81e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.078591 Jul 19 19:42:31.557261 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 384/791] 10.222.0.23 () {58 vars in 1289 bytes} [Tue Jul 19 19:42:31 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_distro => generated 33 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:31.566946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:31.568151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:31.588591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.589172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.590357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:31.591424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:31.979337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:31.981665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:31.990628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d365835-6c12-4ba5-a824-302fc42a0b94 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.432068 Jul 19 19:42:31.991408 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 385/792] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:31 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:31.996013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:31.996493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:32.027695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.028127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.028902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.029514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.068300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:42:32.079707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:32.093591 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f87c4413-ef37-4691-9084-519179a67a06 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1319 microversion: 2.1 time: 0.695649 Jul 19 19:42:32.097845 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 408/793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:31 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:32.109764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ffd971b-445c-4a94-9061-9ee64845fd95 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23efcf19d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:32.205292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0ffd971b-445c-4a94-9061-9ee64845fd95 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:32.212826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0ffd971b-445c-4a94-9061-9ee64845fd95 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:32.260385 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a70aba8-ac71-47f9-a082-0efa7d43afdd tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 204 len: 0 microversion: 2.1 time: 0.267894 Jul 19 19:42:32.261584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 386/794] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:31 2022] DELETE /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:32.271104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0aa81df7-8a49-4385-9f29-ea82704d46d4 req-d4db27e1-0317-4501-b45f-ffcab3129975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-plugged", "status": "completed", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:32.290192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0aa81df7-8a49-4385-9f29-ea82704d46d4 req-d4db27e1-0317-4501-b45f-ffcab3129975 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.290954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0aa81df7-8a49-4385-9f29-ea82704d46d4 req-d4db27e1-0317-4501-b45f-ffcab3129975 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.305056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0aa81df7-8a49-4385-9f29-ea82704d46d4 req-d4db27e1-0317-4501-b45f-ffcab3129975 service nova] Creating event network-vif-plugged:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:42:32.322191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0aa81df7-8a49-4385-9f29-ea82704d46d4 req-d4db27e1-0317-4501-b45f-ffcab3129975 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058921 Jul 19 19:42:32.328142 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 387/795] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:32.336739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:32.339811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:32.352384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.360269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.361231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.361775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.506037 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ffd971b-445c-4a94-9061-9ee64845fd95 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.406837 Jul 19 19:42:32.506764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 409/796] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:32 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:32.515712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.202"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:32.517071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:32.525015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.525467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.526463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.526905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.559836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Acquired lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:42:32.890567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:32.899076 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8210fa0b-df22-4b04-802a-13ba609230ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1379 microversion: 2.1 time: 0.569661 Jul 19 19:42:32.908628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 388/797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:32 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1379 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:32.913626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:32.914441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:32.920882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.921434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:32.922288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:32.922790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:33.021852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:33.032991 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7246047-75d3-4d76-baf1-c1637b4dc138 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1277 microversion: 2.1 time: 0.121175 Jul 19 19:42:33.033633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 389/798] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:32 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:33.047953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef26e2b2-8d80-4332-9eca-87d8cefabde9 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23fc2a7700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:33.104989 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef26e2b2-8d80-4332-9eca-87d8cefabde9 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.065729 Jul 19 19:42:33.107400 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 390/799] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:33 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:33.114495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-07fede97-0c0b-46aa-b647-002ea859f425 req-086f33e6-25bb-47e9-ba1b-850adb415c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35603c8-3daf-46ef-8550-022380364af1", "tag": "00a8e9ed-660e-45eb-a1c1-b16f95f95857"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:33.125740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07fede97-0c0b-46aa-b647-002ea859f425 req-086f33e6-25bb-47e9-ba1b-850adb415c65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:33.126997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07fede97-0c0b-46aa-b647-002ea859f425 req-086f33e6-25bb-47e9-ba1b-850adb415c65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:33.140419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07fede97-0c0b-46aa-b647-002ea859f425 req-086f33e6-25bb-47e9-ba1b-850adb415c65 service nova] Creating event network-changed:00a8e9ed-660e-45eb-a1c1-b16f95f95857 for instance c35603c8-3daf-46ef-8550-022380364af1 on n-h2-843834-3 Jul 19 19:42:33.152486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-07fede97-0c0b-46aa-b647-002ea859f425 req-086f33e6-25bb-47e9-ba1b-850adb415c65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038453 Jul 19 19:42:33.154226 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 391/800] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:33.164353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:33.166010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:33.175335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:33.176207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:33.177252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:33.178480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:33.629707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:33.851912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:33.873297 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35490565-b5c0-4f68-bd59-c85286552b29 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.716928 Jul 19 19:42:33.885678 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 392/801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:33 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:33.890067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:33.890488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:33.904505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:33.904969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:33.905772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:33.906206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:34.549542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:34.560946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-516fbf65-8a04-4b07-a721-948266fc2573 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1319 microversion: 2.1 time: 0.681627 Jul 19 19:42:34.561952 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 393/802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:33 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:34.572802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c9f6b51-5505-408b-bf43-15e28811a55e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23fc2a7ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:34.674925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3c9f6b51-5505-408b-bf43-15e28811a55e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:34.683854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3c9f6b51-5505-408b-bf43-15e28811a55e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:35.317094 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c9f6b51-5505-408b-bf43-15e28811a55e tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.752285 Jul 19 19:42:35.318720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 394/803] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:34 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:35.326744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:35.327720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:35.337519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:35.338159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:35.339221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:35.339883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.048337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:36.061734 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-642f24e4-62c4-4d9a-b528-2f6d0a9b3c12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1529 microversion: 2.1 time: 0.741589 Jul 19 19:42:36.062923 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 395/804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:35 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1529 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:36.068766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:36.069546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:36.076771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.077444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.085337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.086168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.817933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:36.826294 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0baabf3-d78a-47ba-a916-a77fd366835e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.761967 Jul 19 19:42:36.827590 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 396/805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:36 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:36.832238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9e297013-91ae-4493-b60c-82f557f8279e req-5e058beb-4f22-41dd-aa70-c8b6ee165306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd", "name": "network-vif-plugged", "status": "completed", "tag": "7f8ff442-d5ff-44bd-8530-4a6bd1170e3e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:36.865689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9e297013-91ae-4493-b60c-82f557f8279e req-5e058beb-4f22-41dd-aa70-c8b6ee165306 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.866540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9e297013-91ae-4493-b60c-82f557f8279e req-5e058beb-4f22-41dd-aa70-c8b6ee165306 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.879558 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9e297013-91ae-4493-b60c-82f557f8279e req-5e058beb-4f22-41dd-aa70-c8b6ee165306 service nova] Creating event network-vif-plugged:7f8ff442-d5ff-44bd-8530-4a6bd1170e3e for instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd on n-h2-843834-3 Jul 19 19:42:36.884764 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9e297013-91ae-4493-b60c-82f557f8279e req-5e058beb-4f22-41dd-aa70-c8b6ee165306 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055563 Jul 19 19:42:36.885687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 397/806] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:36.890865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2680b810-e5f7-4f82-a2e9-ad8c25bdd2fd req-9a97fa37-325b-4eb5-986d-4aa25c48c284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35603c8-3daf-46ef-8550-022380364af1", "name": "network-vif-deleted", "tag": "00a8e9ed-660e-45eb-a1c1-b16f95f95857"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:36.906264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2680b810-e5f7-4f82-a2e9-ad8c25bdd2fd req-9a97fa37-325b-4eb5-986d-4aa25c48c284 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.906707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2680b810-e5f7-4f82-a2e9-ad8c25bdd2fd req-9a97fa37-325b-4eb5-986d-4aa25c48c284 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.926151 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2680b810-e5f7-4f82-a2e9-ad8c25bdd2fd req-9a97fa37-325b-4eb5-986d-4aa25c48c284 service nova] Creating event network-vif-deleted:00a8e9ed-660e-45eb-a1c1-b16f95f95857 for instance c35603c8-3daf-46ef-8550-022380364af1 on n-h2-843834-3 Jul 19 19:42:36.938585 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2680b810-e5f7-4f82-a2e9-ad8c25bdd2fd req-9a97fa37-325b-4eb5-986d-4aa25c48c284 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051494 Jul 19 19:42:36.950374 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 398/807] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:36.956768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:36.957815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:36.964685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.965448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:36.966453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:36.967154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:37.400185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:37.414864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5194b156-19c3-41d3-92c2-012c1745ac5f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1307 microversion: 2.1 time: 0.462806 Jul 19 19:42:37.416026 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 399/808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:36 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1307 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:37.423575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Building network info cache for instance {{(pid=131229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:37.426156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-764d9ece-5509-45aa-9577-931b9708feab tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23fc129e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:37.505788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-764d9ece-5509-45aa-9577-931b9708feab tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:37.523041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-764d9ece-5509-45aa-9577-931b9708feab tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:38.196533 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-764d9ece-5509-45aa-9577-931b9708feab tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.778915 Jul 19 19:42:38.197465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 400/809] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:37 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 64 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:38.207197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:38.207852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:38.220328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.220789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.221735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.222264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.517109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:38.533062 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-811c8931-8f33-48bf-9ed4-adfeb3a71803 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1319 microversion: 2.1 time: 0.333120 Jul 19 19:42:38.544215 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 401/810] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:38 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:38.544215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:38.544215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:38.553380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.553872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.554732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.555192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.601521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Updating instance_info_cache with network_info: [{"id": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7", "address": "fa:16:3e:40:d9:44", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b74e9c7-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:38.628711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Releasing lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:42:38.630279 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a7ac6b3-65e0-4c4f-a6b2-4d96abea47fe tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action" status: 202 len: 0 microversion: 2.1 time: 6.118311 Jul 19 19:42:38.631683 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 410/811] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:32 2022] POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action => generated 0 bytes in 6124 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:42:38.641620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e802db57-3687-41e7-ae41-98273c8e4695 req-2f0d5505-6a14-474f-812b-8bccb59b987c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf90241-8ceb-4472-97d5-0b605582780d", "tag": "80663c6c-369f-48b4-ae24-634a32cc3364"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:38.658232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e802db57-3687-41e7-ae41-98273c8e4695 req-2f0d5505-6a14-474f-812b-8bccb59b987c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.659138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e802db57-3687-41e7-ae41-98273c8e4695 req-2f0d5505-6a14-474f-812b-8bccb59b987c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.676304 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e802db57-3687-41e7-ae41-98273c8e4695 req-2f0d5505-6a14-474f-812b-8bccb59b987c service nova] Creating event network-changed:80663c6c-369f-48b4-ae24-634a32cc3364 for instance bbf90241-8ceb-4472-97d5-0b605582780d on n-h1-843834-3 Jul 19 19:42:38.683128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e802db57-3687-41e7-ae41-98273c8e4695 req-2f0d5505-6a14-474f-812b-8bccb59b987c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049874 Jul 19 19:42:38.686642 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 411/812] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:38.696741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:38.697860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:38.724876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.725705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.726672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.727529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.757496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:38.768301 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3937c4ce-f8c9-416c-9f4e-f2facce49e8d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1529 microversion: 2.1 time: 0.231704 Jul 19 19:42:38.769405 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 402/813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:38 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1529 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:38.779166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cbdc7e9-7fbd-4af6-ad72-a5b17c24cfc0 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23efb92940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:38.854575 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1cbdc7e9-7fbd-4af6-ad72-a5b17c24cfc0 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.084086 Jul 19 19:42:38.855203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 403/814] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:38 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:38.859897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:38.860501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:38.871032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.871498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.872340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:38.872782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:38.974149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:38.994942 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-959063d4-8e37-491e-b8ac-e9a0ce2222d1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.306722 Jul 19 19:42:38.995812 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 412/815] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:38 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:39.009782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-593e9a19-ae21-4806-9518-1fbac2b33a4f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '.version_select at 0x7f23efcf1280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:39.102321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:39.122584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b49afa5-fced-43ed-a05f-2c8f33eeef15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1487 microversion: 2.1 time: 0.266322 Jul 19 19:42:39.131528 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 404/816] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:38 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1487 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:39.138898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33e3a7e6-593f-4b21-9713-bf14fc7b5f38 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:39.139765 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:42:39.139765 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:42:39.191952 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-33e3a7e6-593f-4b21-9713-bf14fc7b5f38 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/7a52ef57-f368-4e08-af4c-f60a7ee57ad4" status: 202 len: 0 microversion: 2.1 time: 0.058807 Jul 19 19:42:39.192842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 405/817] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:39 2022] DELETE /compute/v2.1/flavors/7a52ef57-f368-4e08-af4c-f60a7ee57ad4 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:42:39.199338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5da777e4-ecf0-4852-9d6a-dfa6a57293f3 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23efb45a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:39.299430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5da777e4-ecf0-4852-9d6a-dfa6a57293f3 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:39.320612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5da777e4-ecf0-4852-9d6a-dfa6a57293f3 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:39.426829 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-593e9a19-ae21-4806-9518-1fbac2b33a4f tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/bb81e34f-e85e-422e-897e-2491339d111a" status: 200 len: 185 microversion: 2.1 time: 0.420776 Jul 19 19:42:39.428660 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 413/818] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:39 2022] GET /compute/v2.1/os-floating-ips/bb81e34f-e85e-422e-897e-2491339d111a => generated 185 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:39.433530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f5236c87-9e16-4c69-b303-4fd287be0d13 req-d0f94801-de87-43a4-ac2b-5983fc055520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360bc800-b98b-4fd8-83f8-469cbea4ca96", "name": "network-vif-plugged", "status": "completed", "tag": "afcf58de-805b-498d-9c10-e716740eb182"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:39.453234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f5236c87-9e16-4c69-b303-4fd287be0d13 req-d0f94801-de87-43a4-ac2b-5983fc055520 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:39.453597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f5236c87-9e16-4c69-b303-4fd287be0d13 req-d0f94801-de87-43a4-ac2b-5983fc055520 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:39.468251 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f5236c87-9e16-4c69-b303-4fd287be0d13 req-d0f94801-de87-43a4-ac2b-5983fc055520 service nova] Creating event network-vif-plugged:afcf58de-805b-498d-9c10-e716740eb182 for instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 on n-h2-843834-3 Jul 19 19:42:39.488350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f5236c87-9e16-4c69-b303-4fd287be0d13 req-d0f94801-de87-43a4-ac2b-5983fc055520 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058280 Jul 19 19:42:39.490781 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 414/819] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:39.507120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-13608a5d-070d-435f-b462-2631a595b987 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:39.523577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13608a5d-070d-435f-b462-2631a595b987 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:39.524376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13608a5d-070d-435f-b462-2631a595b987 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:39.605957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-13608a5d-070d-435f-b462-2631a595b987 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Going to try to stop instance {{(pid=131229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:42:39.674043 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-13608a5d-070d-435f-b462-2631a595b987 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd/action" status: 202 len: 0 microversion: 2.1 time: 0.179114 Jul 19 19:42:39.678839 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 415/820] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:39 2022] POST /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:42:39.688389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f8178a4-cd20-48cf-b98b-e5c08b985093 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:39.716794 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f8178a4-cd20-48cf-b98b-e5c08b985093 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035712 Jul 19 19:42:39.718115 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 416/821] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:42:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:39.723397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.202"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:39.744636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:39.775177 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5da777e4-ecf0-4852-9d6a-dfa6a57293f3 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.581149 Jul 19 19:42:39.776005 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 406/822] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:39 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:39.781400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:39.782325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:39.790822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:39.791565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:39.792679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:39.793319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.359542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:40.366007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:40.366453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.367264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:40.367695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.512302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:40.520284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5b2a744-5836-48f0-9fe5-a4b407866e47 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1319 microversion: 2.1 time: 0.743019 Jul 19 19:42:40.520863 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 407/823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:39 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:40.645299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-150ecab1-b98c-4bc4-9d10-42d995821e73 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Action: 'create', calling method: .version_select at 0x7f23fc2aa8b0>, body: {"keypair": {"name": "tempest-keypair-1697136917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISUzoNAn1LSQJJYKyaTWT2KYYafmCRx1lC+uIrzmp7HKJg4Cs+bHGkqgtVqQChVxrycEsT524o8V/cCz3vkuA/vTSwG5Ltxi0NLLL8N74+qIX5z+E7RwF7/hJ+NgVrKcg=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:40.660000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-150ecab1-b98c-4bc4-9d10-42d995821e73 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Getting quotas for project 48554aefbc564866bc55a7ef61395374. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:40.664931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-150ecab1-b98c-4bc4-9d10-42d995821e73 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Getting quotas for user fc74f3b686f74bce88d1ab84828220f3 and project 48554aefbc564866bc55a7ef61395374. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:40.688736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-150ecab1-b98c-4bc4-9d10-42d995821e73 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166584 Jul 19 19:42:40.689364 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 408/824] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:42:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:40.694842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:40.695825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:40.703715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:40.704405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.705286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:40.705759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.764041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Acquired lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:42:40.974804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:40.983424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4600fa9f-dbf0-4939-bdc9-be54663fde10 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.292950 Jul 19 19:42:40.984011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 409/825] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:40 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:40.990674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:40.991837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:40.998082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:40.998611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:40.999559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:41.000651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:41.063017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:41.094201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:41.096442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:41.101455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Old instance type tempest-test_resize_flavor_-526942138, new instance type m1.heat {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:42:41.109796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:41.110470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:41.111410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:41.111982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:41.112652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:41.229918 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49b8903f-9901-4d20-9f21-1f5e24000365 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd/action" status: 202 len: 0 microversion: 2.1 time: 0.244438 Jul 19 19:42:41.231755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 410/826] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:40 2022] POST /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:42:41.236631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f22e7db-1473-4e28-be27-436eb24503b1 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update', calling method: .version_select at 0x7f23fc3ff310>, body: {"meta": {"os_version": "alt"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:41.298021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0f22e7db-1473-4e28-be27-436eb24503b1 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:41.303435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0f22e7db-1473-4e28-be27-436eb24503b1 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:41.723519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f22e7db-1473-4e28-be27-436eb24503b1 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.490597 Jul 19 19:42:41.724346 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 411/827] 10.222.0.23 () {60 vars in 1312 bytes} [Tue Jul 19 19:42:41 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata/os_version => generated 31 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:41.736931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:41.737581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:41.741617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Building network info cache for instance {{(pid=131229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:42:41.750233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:41.752932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:41.755892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:41.756510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.061365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:42.073641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68acb335-e35c-48fd-b988-c92e017f2203 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.341701 Jul 19 19:42:42.074569 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 412/828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:41 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:42.083885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}, {"name": "network-changed", "server_uuid": "146b6dab-a464-4744-9d7e-4eed338ba2e2", "tag": "8e3e0c9c-6db6-441f-8e3c-56129a756b4a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:42.099250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.099924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.132863 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] Creating event network-changed:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:42:42.133378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] Creating event network-changed:8e3e0c9c-6db6-441f-8e3c-56129a756b4a for instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 on n-h1-843834-3 Jul 19 19:42:42.157435 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3ca575e5-ae9b-489f-a95e-68314045d29e req-87b75041-439f-49e0-be64-afaebc40e3ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077831 Jul 19 19:42:42.158820 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 413/829] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:42.168025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:42.175526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:42.193779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.194258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.195100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.199435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.227134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:42.667024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:42.680413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19a8dc37-51af-48b6-8c11-869ea37198a4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1538 microversion: 2.1 time: 0.517602 Jul 19 19:42:42.691849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 414/830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:42 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1538 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:42.697758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-93e0ad48-e3d7-4c48-8850-4d31a1a8eccc req-9fd8a0ee-9d25-4645-b150-bfcb1c2fa7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf90241-8ceb-4472-97d5-0b605582780d", "name": "network-vif-plugged", "status": "completed", "tag": "80663c6c-369f-48b4-ae24-634a32cc3364"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:42.707413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-93e0ad48-e3d7-4c48-8850-4d31a1a8eccc req-9fd8a0ee-9d25-4645-b150-bfcb1c2fa7c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.707946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-93e0ad48-e3d7-4c48-8850-4d31a1a8eccc req-9fd8a0ee-9d25-4645-b150-bfcb1c2fa7c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.720212 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-93e0ad48-e3d7-4c48-8850-4d31a1a8eccc req-9fd8a0ee-9d25-4645-b150-bfcb1c2fa7c3 service nova] Creating event network-vif-plugged:80663c6c-369f-48b4-ae24-634a32cc3364 for instance bbf90241-8ceb-4472-97d5-0b605582780d on n-h1-843834-3 Jul 19 19:42:42.727382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-93e0ad48-e3d7-4c48-8850-4d31a1a8eccc req-9fd8a0ee-9d25-4645-b150-bfcb1c2fa7c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033492 Jul 19 19:42:42.732185 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 415/831] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:42.739889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:42.740903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:42.748740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.749621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.750654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:42.751258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:42.955607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Updating instance_info_cache with network_info: [{"id": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7", "address": "fa:16:3e:40:d9:44", "network": {"id": "9beb335f-2416-419f-a2e8-afe5a9e87165", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189290022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d2b974b1f66344cc9a539ccbe7f391ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b74e9c7-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:42:42.959762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:42.972232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Releasing lock "refresh_cache-7bd99a05-fe45-446e-aab3-27dbb7be771d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:42:42.973098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7cc79e7b-98e3-4312-8d72-5661ed194897 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action" status: 202 len: 0 microversion: 2.1 time: 3.253613 Jul 19 19:42:42.974258 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 417/832] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:42:39 2022] POST /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d/action => generated 0 bytes in 3255 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:42:42.979667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-660db59f-c183-4911-9f80-909b5e3daea6 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23efbbaca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:43.033647 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-660db59f-c183-4911-9f80-909b5e3daea6 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.057853 Jul 19 19:42:43.034247 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 418/833] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:42 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 58 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:43.039282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:43.043529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:43.051398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.052754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:43.053937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.054572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:43.493619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:43.501492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b51f1254-4f91-4fac-b1f8-b52a097eee3d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1468 microversion: 2.1 time: 0.767672 Jul 19 19:42:43.502284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 416/834] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:42 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1468 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:43.518641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1047159386", "imageRef": "45a17e66-eb7c-4c94-9987-e1f7444dc7c3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ad723f35-ee0d-405d-8f73-ef4602f00d04"}], "security_groups": [{"name": "tempest-securitygroup--1677996395"}], "key_name": "tempest-keypair-1697136917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:43.526413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:43.535435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4c845f7d-20fa-496b-9a22-55e46975c27d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.499866 Jul 19 19:42:43.544089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 419/835] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:43 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:43.549648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:43.550138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:43.556126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.559254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:43.560218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.560741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:43.578206 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] HTTP exception thrown: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Request method failure captured: Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 HTTP/1.1 Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjCehFY_833p-QqRceR5hlbwROh3U-Cq12Z5npbNSiUpp6rdfLlYsbSgXBS3EU_hK7almc-069NEa1K0UcX4IzGPiESaMCRXDeEdCJhikjH0L_JjrujGQd3EaRWvk-9G8wzPnS6UF8erbUOj5ii4LnI-hR6_yXo6LXmzL1rLcDJgQA Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:43.579949 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ea9cf9a38a804fdc8c053db13a1395be Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:43.583050 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c35603c8-3daf-46ef-8550-022380364af1'} Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:43.583962 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:43.585606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:43.587292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Returning 404 to user: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:43.587292 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6109df17-a742-4a99-acba-90ae954717be tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 404 len: 111 microversion: 2.1 time: 0.036018 Jul 19 19:42:43.587292 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 420/836] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:43 2022] DELETE /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:43.593411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-705049c0-a781-4ada-a191-6dc6b6b557ba tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'update_all', calling method: .version_select at 0x7f23fc0c5820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:43.641097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] validate_networks() for [('ad723f35-ee0d-405d-8f73-ef4602f00d04', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:43.644457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-705049c0-a781-4ada-a191-6dc6b6b557ba tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:43.649438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-705049c0-a781-4ada-a191-6dc6b6b557ba tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:43.973374 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-705049c0-a781-4ada-a191-6dc6b6b557ba tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.389614 Jul 19 19:42:43.973958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 421/837] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:43 2022] PUT /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 61 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:43.978627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:43.979251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:43.985625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.987061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:43.988025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:43.988530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.190830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:44.191698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:44.192254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:44.192756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:44.193234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:44.194752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:44.202866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6f4c221-e80b-4251-a5fa-24b4b1438730 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.227896 Jul 19 19:42:44.203397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.208965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 422/838] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:43 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:44.209087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.209087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.209087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.236258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Getting quotas for project 48554aefbc564866bc55a7ef61395374. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:44.241941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Getting quotas for user fc74f3b686f74bce88d1ab84828220f3 and project 48554aefbc564866bc55a7ef61395374. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:44.255581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:44.258303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45a17e66-eb7c-4c94-9987-e1f7444dc7c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:44.270883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:44.272248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:44.278891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.279464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.280427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.280926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.311224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27ce8144-867a-4644-8fc6-e577d54c03d2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796372 Jul 19 19:42:44.311887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 417/839] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:42:44.317593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:44.318422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: c35603c8-3daf-46ef-8550-022380364af1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:44.324819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:42:44.326416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.326865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.327913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.328913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.346147 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] HTTP exception thrown: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Request method failure captured: Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 HTTP/1.1 Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjCehFY_833p-QqRceR5hlbwROh3U-Cq12Z5npbNSiUpp6rdfLlYsbSgXBS3EU_hK7almc-069NEa1K0UcX4IzGPiESaMCRXDeEdCJhikjH0L_JjrujGQd3EaRWvk-9G8wzPnS6UF8erbUOj5ii4LnI-hR6_yXo6LXmzL1rLcDJgQA Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:44.348021 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ea9cf9a38a804fdc8c053db13a1395be Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:44.349614 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c35603c8-3daf-46ef-8550-022380364af1'} Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:44.350474 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. Jul 19 19:42:44.352078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:44.353501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Returning 404 to user: Instance c35603c8-3daf-46ef-8550-022380364af1 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:44.353501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-faa4a871-0e20-40f7-a099-2cb5831f4430 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1" status: 404 len: 111 microversion: 2.1 time: 0.036310 Jul 19 19:42:44.353501 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 418/840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:44 2022] GET /compute/v2.1/servers/c35603c8-3daf-46ef-8550-022380364af1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:44.358457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:44.359104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:44.365803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.366292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.367122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.367649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.435587 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8406466-f358-41e8-b06e-55f5210ab0f5 tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 204 len: 0 microversion: 2.1 time: 0.229239 Jul 19 19:42:44.436705 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 423/841] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:44 2022] DELETE /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:44.445838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c486c994-5f5d-403e-be3d-4ca2c1c167fe tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Action: 'create', calling method: .version_select at 0x7f23efd06dc0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:44.511981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-c486c994-5f5d-403e-be3d-4ca2c1c167fe tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:44.518808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-c486c994-5f5d-403e-be3d-4ca2c1c167fe tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Getting quotas for user 146254b9ad3f4cf2bcc686b0a457b016 and project b72bbaae331c4700b92d72e2fd562936. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:44.593317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:44.607185 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ad63acc-423d-4ce9-b24c-0786869da6c0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.252757 Jul 19 19:42:44.608358 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 419/842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:44 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:44.627238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5b47c296-9ca7-4ebd-8809-ae161e051cd6 req-5db65a54-4332-4c2e-bf2c-7a263c36e1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:44.637503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5b47c296-9ca7-4ebd-8809-ae161e051cd6 req-5db65a54-4332-4c2e-bf2c-7a263c36e1e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:44.638649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5b47c296-9ca7-4ebd-8809-ae161e051cd6 req-5db65a54-4332-4c2e-bf2c-7a263c36e1e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:44.652369 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5b47c296-9ca7-4ebd-8809-ae161e051cd6 req-5db65a54-4332-4c2e-bf2c-7a263c36e1e4 service nova] Creating event network-changed:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:42:44.659243 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5b47c296-9ca7-4ebd-8809-ae161e051cd6 req-5db65a54-4332-4c2e-bf2c-7a263c36e1e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049248 Jul 19 19:42:44.660249 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 420/843] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:44.666816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cdd34104-7159-4c58-91bf-a057cc4a34f3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:44.668557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cdd34104-7159-4c58-91bf-a057cc4a34f3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:44.736722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cdd34104-7159-4c58-91bf-a057cc4a34f3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:44.748991 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cdd34104-7159-4c58-91bf-a057cc4a34f3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1246 microversion: 2.1 time: 0.085778 Jul 19 19:42:44.759653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 421/844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:44 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:44.765976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1492d6d5-469e-4c22-bf7b-589ad36c72f5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '.version_select at 0x7f23ef8e0550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:44.999985 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c486c994-5f5d-403e-be3d-4ca2c1c167fe tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "POST /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.561804 Jul 19 19:42:45.004815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 424/845] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Jul 19 19:42:44 2022] POST /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 85 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:45.006178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:45.007556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:45.014052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.014576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:45.015453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.015956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:45.464343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:45.473520 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8912108-5b4c-4312-bc23-661c52ca5836 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1474 microversion: 2.1 time: 0.471745 Jul 19 19:42:45.475030 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 425/846] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:45 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1474 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:45.481832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:45.482719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:45.489280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.489841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:45.490724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.491307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:45.902755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:45.911724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64299df5-a9b5-462b-a25e-ee177e5c2ae4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.435428 Jul 19 19:42:45.912411 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 426/847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:45 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:45.917014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91ab5fa6-0200-4388-9692-b442971ba6c7 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] Calling method '.version_select at 0x7f23efac4670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:45.974783 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91ab5fa6-0200-4388-9692-b442971ba6c7 tempest-ImagesMetadataTestJSON-1803489068 tempest-ImagesMetadataTestJSON-1803489068-project] 10.222.0.23 "GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.061187 Jul 19 19:42:45.975471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 427/848] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:45 2022] GET /compute/v2.1/images/5f282c37-3558-4f59-8284-7e486075f6b1/metadata => generated 85 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:42:45.986671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:45.988172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:45.995123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.995579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:45.996360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:45.996803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.234143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:46.244631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86da199e-45ca-44d6-98ed-8e36aea9a952 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.267787 Jul 19 19:42:46.245905 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 428/849] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:45 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:46.251526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-27a1550f-199f-44a9-8283-0a0a781b04d5 req-2bf0bf8a-812a-4c05-8421-2528a9da42e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146b6dab-a464-4744-9d7e-4eed338ba2e2", "name": "network-vif-plugged", "status": "completed", "tag": "8e3e0c9c-6db6-441f-8e3c-56129a756b4a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:46.266417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-27a1550f-199f-44a9-8283-0a0a781b04d5 req-2bf0bf8a-812a-4c05-8421-2528a9da42e2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.267139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-27a1550f-199f-44a9-8283-0a0a781b04d5 req-2bf0bf8a-812a-4c05-8421-2528a9da42e2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.280655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-27a1550f-199f-44a9-8283-0a0a781b04d5 req-2bf0bf8a-812a-4c05-8421-2528a9da42e2 service nova] Creating event network-vif-plugged:8e3e0c9c-6db6-441f-8e3c-56129a756b4a for instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 on n-h1-843834-3 Jul 19 19:42:46.287843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-27a1550f-199f-44a9-8283-0a0a781b04d5 req-2bf0bf8a-812a-4c05-8421-2528a9da42e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040237 Jul 19 19:42:46.289031 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 429/850] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:46.312090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:46.313130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:46.322386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.323612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.324725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.335630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.888810 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1492d6d5-469e-4c22-bf7b-589ad36c72f5 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/bb81e34f-e85e-422e-897e-2491339d111a" status: 202 len: 0 microversion: 2.1 time: 2.126521 Jul 19 19:42:46.895324 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 422/851] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:42:44 2022] DELETE /compute/v2.1/os-floating-ips/bb81e34f-e85e-422e-897e-2491339d111a => generated 0 bytes in 2135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:42:46.912049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:46.912713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:46.934726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.935409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.936210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.936650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.944093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:46.952137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5cff4757-b4d3-4ee7-9381-2e99646fb2b5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.661770 Jul 19 19:42:46.952770 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 430/852] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:46 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:46.966549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:46.967415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:46.977167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.977631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:46.982568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:46.982686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.042603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:47.071319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91f710c8-ccf9-4378-9e34-3f935dec94a8 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1304 microversion: 2.1 time: 0.173559 Jul 19 19:42:47.072573 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 423/853] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:46 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:47.078197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.079082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:47.087961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.088766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.089905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.090818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.253323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:47.279270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3c6838c-6239-4992-a558-9687fd4ece0d tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1432 microversion: 2.1 time: 0.205368 Jul 19 19:42:47.291612 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 424/854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:47 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1432 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:47.310046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.310704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:47.329326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:42:47.330976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.333847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.336180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.336954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.345200 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b76fbdf-e22d-41da-ba71-031129021b4b tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 2343 microversion: 2.25 time: 0.391430 Jul 19 19:42:47.346446 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 431/855] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:42:46 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 2343 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:42:47.353996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.360438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:47.377970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.379033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.380079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.380612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.429864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:42:47.623876 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0dfb817-4a9f-4629-bbfb-c1b781e52588 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 204 len: 0 microversion: 2.1 time: 0.326529 Jul 19 19:42:47.625869 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 425/856] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:42:47 2022] DELETE /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:47.641781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.642502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:47.651283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:47.658313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.658846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.659700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.664200 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48c129d5-c3fa-4a11-ba08-684e78e8c8c2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.316348 Jul 19 19:42:47.664859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.671431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 432/857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:47 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:47.682202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.694078 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:42:47.694078 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:42:47.698809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.699405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.700322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.705223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.772260 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae769f4a-7f43-4536-95be-f89bb2a614b5 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.099603 Jul 19 19:42:47.776169 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 433/858] 10.222.0.23 () {60 vars in 1216 bytes} [Tue Jul 19 19:42:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:42:47.781024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8f425959-a662-4025-a03e-8d24fa200887 req-5bdb228f-3fdb-406a-bd51-21cc99d9ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360bc800-b98b-4fd8-83f8-469cbea4ca96", "name": "network-vif-deleted", "tag": "afcf58de-805b-498d-9c10-e716740eb182"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:47.796694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:47.814572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8f425959-a662-4025-a03e-8d24fa200887 req-5bdb228f-3fdb-406a-bd51-21cc99d9ed36 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.818388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8f425959-a662-4025-a03e-8d24fa200887 req-5bdb228f-3fdb-406a-bd51-21cc99d9ed36 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.842116 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8f425959-a662-4025-a03e-8d24fa200887 req-5bdb228f-3fdb-406a-bd51-21cc99d9ed36 service nova] Creating event network-vif-deleted:afcf58de-805b-498d-9c10-e716740eb182 for instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 on n-h2-843834-3 Jul 19 19:42:47.851531 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8f425959-a662-4025-a03e-8d24fa200887 req-5bdb228f-3fdb-406a-bd51-21cc99d9ed36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073948 Jul 19 19:42:47.852805 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 434/859] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:47.858368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:47.859342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:47.866193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.866657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.879118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:47.879438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:47.987348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:47.999188 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30861d46-ba75-4c8e-8cfe-bd6040be9d52 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.371182 Jul 19 19:42:48.020710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 426/860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:47 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:48.025963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:48.026703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:48.042800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.043384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.044248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.044814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.378439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:48.390747 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29f2c626-9426-43fa-8780-015fbf2dbc15 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1525 microversion: 2.1 time: 0.536546 Jul 19 19:42:48.397559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:48.405831 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7e7b3bc-d78e-4828-a3d6-9d4741927938 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.383894 Jul 19 19:42:48.409333 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 435/861] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:47 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1525 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:48.410160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 427/862] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:48 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:48.427822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:48.432408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:48.436437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:48.436936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:48.447335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.451613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.455647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.457494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.457771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.458724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.459344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.459950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.577636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.578086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.578541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 360bc800-b98b-4fd8-83f8-469cbea4ca96 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:42:48.645641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:48.655270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35453158-ff14-4ecf-ba81-48c91a7e213c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 200 len: 1309 microversion: 2.1 time: 0.242490 Jul 19 19:42:48.660847 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 428/863] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:48 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:48.688267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:48.689192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:48.701382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.702163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.703724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:48.706498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:48.833849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:48.842875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-11141c63-7b40-400d-ae1a-b510be353a01 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.431436 Jul 19 19:42:48.845779 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 436/864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:48 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:48.968953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:48.977843 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d1234715-9dfe-4131-970a-eb04d4adb96b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.293894 Jul 19 19:42:48.978665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 429/865] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:48 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:42:49.028634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:49.029694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:49.056704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.059312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.060840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.061631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.424167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:49.425545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:49.439265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.440693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.442796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.443963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.485671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:49.502349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65ea0a01-b0c9-4a7a-a783-776cc3325493 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1319 microversion: 2.1 time: 0.470888 Jul 19 19:42:49.503616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 437/866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:49 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:49.521835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:49.529260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:49.530054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:49.543260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.558689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.562745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:49.563442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:49.947626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:49.951180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:49.973274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-110f649a-be33-4a89-8719-91e962441258 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.460904 Jul 19 19:42:49.975636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 438/867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:49 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:49.989355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:49.990777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:50.017761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.020341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.024191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.024922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.106317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 HTTP/1.1 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:50.107966 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:42:50.109484 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '360bc800-b98b-4fd8-83f8-469cbea4ca96'} Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:50.110376 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:42:50.111851 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.113215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:50.113215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d1671d8-df77-494c-adb2-cc48e9812d15 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 404 len: 111 microversion: 2.1 time: 0.130403 Jul 19 19:42:50.134874 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 439/868] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:49 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:50.468058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:50.489699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7de1ba42-19a7-4441-8823-c05ab2a8c843 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1525 microversion: 2.1 time: 1.067014 Jul 19 19:42:50.490697 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 430/869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:49 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1525 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:50.503216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:50.504044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:50.529280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.533746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.534876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.537687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90d4532-5525-436a-a81c-dd3c572637ff tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Calling method '.version_select at 0x7f23efbba3a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:50.538418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.575968 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c90d4532-5525-436a-a81c-dd3c572637ff tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90d4532-5525-436a-a81c-dd3c572637ff tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/images/d6ba0e59-1269-4e7b-b548-25a164c60c87/metadata/os_distro HTTP/1.1 Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:50.617488 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'image_id': 'd6ba0e59-1269-4e7b-b548-25a164c60c87', 'id': 'os_distro'} Jul 19 19:42:50.619213 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:50.620178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d6ba0e59-1269-4e7b-b548-25a164c60c87 Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:50.621517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6ba0e59-1269-4e7b-b548-25a164c60c87 could not be found. Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:50.622956 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:50.624313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:50.627320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c90d4532-5525-436a-a81c-dd3c572637ff tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:50.628395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c90d4532-5525-436a-a81c-dd3c572637ff tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "DELETE /compute/v2.1/images/d6ba0e59-1269-4e7b-b548-25a164c60c87/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.492447 Jul 19 19:42:50.634322 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 440/870] 10.222.0.23 () {58 vars in 1292 bytes} [Tue Jul 19 19:42:50 2022] DELETE /compute/v2.1/images/d6ba0e59-1269-4e7b-b548-25a164c60c87/metadata/os_distro => generated 62 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:50.639696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:50.642986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:50.650800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.651416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.652375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.653085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.842151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:50.854006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-875b2b38-b92f-42b3-a615-6b1b2940d6fc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.358762 Jul 19 19:42:50.855127 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 431/871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:50 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:50.867571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2ce212ad-24c7-490e-ae89-e397906dac0b req-f4d2632e-534c-45b0-b95b-4030ee57e8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e769d2a-f48e-4372-aaa3-8603394d3e55", "tag": "ca376b2c-714d-406a-be0d-9a73b864562a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:50.882292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2ce212ad-24c7-490e-ae89-e397906dac0b req-f4d2632e-534c-45b0-b95b-4030ee57e8d5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:50.884209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2ce212ad-24c7-490e-ae89-e397906dac0b req-f4d2632e-534c-45b0-b95b-4030ee57e8d5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:50.913647 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2ce212ad-24c7-490e-ae89-e397906dac0b req-f4d2632e-534c-45b0-b95b-4030ee57e8d5 service nova] Creating event network-changed:ca376b2c-714d-406a-be0d-9a73b864562a for instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 on n-h2-843834-3 Jul 19 19:42:50.932543 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2ce212ad-24c7-490e-ae89-e397906dac0b req-f4d2632e-534c-45b0-b95b-4030ee57e8d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075888 Jul 19 19:42:50.933415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 432/872] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:50.939780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1233393898", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:51.034969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:51.044553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:51.054217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ed57554-2cbd-4992-8166-bc1c6afa73e2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.418691 Jul 19 19:42:51.060571 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 441/873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:50 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:51.073135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:51.074050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:51.083051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.083516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.084299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.084761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.393153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:51.468163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ec85af19-6a31-42aa-949c-f501a4412d73 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1468 microversion: 2.1 time: 0.400035 Jul 19 19:42:51.468786 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 442/874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:51 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1468 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:51.499663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78c96398-ae5a-4dde-9870-78ea8897cc96 tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Calling method '.version_select at 0x7f23efb92790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:51.608813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:51.609930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:51.610797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:51.611343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-78c96398-ae5a-4dde-9870-78ea8897cc96 tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:51.612254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:51.612897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78c96398-ae5a-4dde-9870-78ea8897cc96 tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/images/efa2afd1-e5e8-44cb-bd99-e4d7e0218264/metadata/os_version HTTP/1.1 Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:51.613555 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'image_id': 'efa2afd1-e5e8-44cb-bd99-e4d7e0218264', 'id': 'os_version'} Jul 19 19:42:51.615571 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:51.616357 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID efa2afd1-e5e8-44cb-bd99-e4d7e0218264 Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:51.619301 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image efa2afd1-e5e8-44cb-bd99-e4d7e0218264 could not be found. Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:51.620882 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:51.621978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78c96398-ae5a-4dde-9870-78ea8897cc96 tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:51.626199 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78c96398-ae5a-4dde-9870-78ea8897cc96 tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "GET /compute/v2.1/images/efa2afd1-e5e8-44cb-bd99-e4d7e0218264/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.127561 Jul 19 19:42:51.626199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 443/875] 10.222.0.23 () {58 vars in 1292 bytes} [Tue Jul 19 19:42:51 2022] GET /compute/v2.1/images/efa2afd1-e5e8-44cb-bd99-e4d7e0218264/metadata/os_version => generated 62 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:51.638820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:51.639590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:51.653509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.655184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.656339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.657997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.680574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.683126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.687259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:51.688948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:51.708849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Getting quotas for project 28c83ef532d04a6e93ee4c1075a23623. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:51.724290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Getting quotas for user d30d4842de5b47a0a13fcfe6d816a092 and project 28c83ef532d04a6e93ee4c1075a23623. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:51.812900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:51.828946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:51.993726 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fef95293-95ea-4c57-b138-4a8af3d7219b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057590 Jul 19 19:42:52.001019 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 433/876] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:42:52.015079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-06de433c-82fb-4c35-b4a1-a16a1d248834 req-005e0b2a-ab13-4707-9430-c04fd748bcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd99a05-fe45-446e-aab3-27dbb7be771d", "name": "network-vif-deleted", "tag": "5b74e9c7-5bfb-464a-8329-ede9dccd52b7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:52.037220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-06de433c-82fb-4c35-b4a1-a16a1d248834 req-005e0b2a-ab13-4707-9430-c04fd748bcca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.038092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-06de433c-82fb-4c35-b4a1-a16a1d248834 req-005e0b2a-ab13-4707-9430-c04fd748bcca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.066587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-06de433c-82fb-4c35-b4a1-a16a1d248834 req-005e0b2a-ab13-4707-9430-c04fd748bcca service nova] Creating event network-vif-deleted:5b74e9c7-5bfb-464a-8329-ede9dccd52b7 for instance 7bd99a05-fe45-446e-aab3-27dbb7be771d on n-h1-843834-3 Jul 19 19:42:52.089559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.097213 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd8135fb-2393-4c58-854b-cb21963a2aeb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.473315 Jul 19 19:42:52.097801 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 444/877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:51 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:52.114418 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-06de433c-82fb-4c35-b4a1-a16a1d248834 req-005e0b2a-ab13-4707-9430-c04fd748bcca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109907 Jul 19 19:42:52.120953 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 434/878] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:52.128893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.129830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:52.138940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.142657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.143508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.144779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.145182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:52.145870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.176722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.179744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.185849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.187036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.283607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.293673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.298761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lazy-loading 'fault' on Instance uuid 7bd99a05-fe45-446e-aab3-27dbb7be771d {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:42:52.398254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cf9a38a804fdc8c053db13a1395be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b974b1f66344cc9a539ccbe7f391ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.411598 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa94cf95-1260-42ff-99b5-03241d71b4ab tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 200 len: 1313 microversion: 2.1 time: 0.293895 Jul 19 19:42:52.412423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 435/879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:52.427006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73f8d13a-3fbd-4a25-a877-a272197215ba tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Calling method '.version_select at 0x7f23ef8dd940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.474828 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-73f8d13a-3fbd-4a25-a877-a272197215ba tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73f8d13a-3fbd-4a25-a877-a272197215ba tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/images/2ae03898-536c-4eec-8944-8c1971890186/metadata HTTP/1.1 Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:52.502356 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'image_id': '2ae03898-536c-4eec-8944-8c1971890186'} Jul 19 19:42:52.504073 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:52.505125 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2ae03898-536c-4eec-8944-8c1971890186 Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:52.506423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ae03898-536c-4eec-8944-8c1971890186 could not be found. Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:52.508459 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:52.511073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.515353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73f8d13a-3fbd-4a25-a877-a272197215ba tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:52.516506 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73f8d13a-3fbd-4a25-a877-a272197215ba tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "GET /compute/v2.1/images/2ae03898-536c-4eec-8944-8c1971890186/metadata" status: 404 len: 62 microversion: 2.1 time: 0.101170 Jul 19 19:42:52.522579 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 436/880] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/images/2ae03898-536c-4eec-8944-8c1971890186/metadata => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:52.529194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.530161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:52.537026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:52.539891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.540880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.541784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.542292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.543048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.553421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b163988-e56f-47bd-a9d3-a1811f0af083 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d" status: 200 len: 1469 microversion: 2.1 time: 0.453985 Jul 19 19:42:52.554419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 445/881] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:52.560456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-193fbc20-bde9-4456-9960-0ec33dd03be5 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.561140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-193fbc20-bde9-4456-9960-0ec33dd03be5 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:52.694457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-193fbc20-bde9-4456-9960-0ec33dd03be5 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.703407 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-193fbc20-bde9-4456-9960-0ec33dd03be5 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1220 microversion: 2.1 time: 0.147827 Jul 19 19:42:52.717646 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 446/882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:52.726159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.730653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:52.749185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.752081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.753126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.755736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.798962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.808516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92a6a037-5619-4f4a-9e48-594eb209cb9a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.284491 Jul 19 19:42:52.839050 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 437/883] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:52.861155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f226d4c-1f1b-43cc-8dc4-52856418622c tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Action: 'update_all', calling method: .version_select at 0x7f23ef8dd310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:52.896452 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6f226d4c-1f1b-43cc-8dc4-52856418622c tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f226d4c-1f1b-43cc-8dc4-52856418622c tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/images/cea6df1a-77f6-4d65-a9bd-2198e03d89b0/metadata HTTP/1.1 Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 57 Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:52.900366 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:42:52.901885 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'image_id': 'cea6df1a-77f6-4d65-a9bd-2198e03d89b0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:52.902897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cea6df1a-77f6-4d65-a9bd-2198e03d89b0 Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:52.904191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cea6df1a-77f6-4d65-a9bd-2198e03d89b0 could not be found. Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:52.907501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:52.910897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:52.919041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f226d4c-1f1b-43cc-8dc4-52856418622c tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:52.919041 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f226d4c-1f1b-43cc-8dc4-52856418622c tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "PUT /compute/v2.1/images/cea6df1a-77f6-4d65-a9bd-2198e03d89b0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070081 Jul 19 19:42:52.923434 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 438/884] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:42:52 2022] PUT /compute/v2.1/images/cea6df1a-77f6-4d65-a9bd-2198e03d89b0/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:52.935144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:52.943445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:52.944492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Searching by: {'reservation_id': 'r-u3uk50k3', 'deleted': False, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:42:52.954187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.955124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:52.956965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:52.957738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.037259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:53.046167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e848eb49-7a30-4f43-b6f2-75dc2614801e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.327390 Jul 19 19:42:53.057925 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 447/885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:53.057925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f80f52eb-8213-4a9e-aa07-295798421cb7", "device": "/dev/xvdb"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:53.057925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:53.077086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.077539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.078556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.079111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.178696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:42:53.301616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=61 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:53.314557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:53.328948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.329464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.493022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ef01e1f-a91a-4c07-a1ed-34cbe0eab9f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-u3uk50k3" status: 200 len: 2930 microversion: 2.1 time: 0.566242 Jul 19 19:42:53.493733 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 439/886] 10.222.0.23 () {58 vars in 1196 bytes} [Tue Jul 19 19:42:52 2022] GET /compute/v2.1/servers/detail?reservation_id=r-u3uk50k3 => generated 2930 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:53.498601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd3b21e2-cd8b-4046-8b92-ffec38f16edc tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Action: 'update', calling method: .version_select at 0x7f23ef8e0e50>, body: {"meta": {"os_distro": "alt"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:53.523711 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-fd3b21e2-cd8b-4046-8b92-ffec38f16edc tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd3b21e2-cd8b-4046-8b92-ffec38f16edc tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/images/ab31c116-8039-477c-a890-49f72aec9ef0/metadata/os_distro HTTP/1.1 Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 30 Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:42:53.526152 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: {"meta": {"os_distro": "alt"}} Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:42:53.527618 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'image_id': 'ab31c116-8039-477c-a890-49f72aec9ef0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:53.528482 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ab31c116-8039-477c-a890-49f72aec9ef0 Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:53.529547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab31c116-8039-477c-a890-49f72aec9ef0 could not be found. Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:53.532420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:53.534426 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.536901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd3b21e2-cd8b-4046-8b92-ffec38f16edc tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:53.536901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd3b21e2-cd8b-4046-8b92-ffec38f16edc tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "PUT /compute/v2.1/images/ab31c116-8039-477c-a890-49f72aec9ef0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.034551 Jul 19 19:42:53.536901 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 440/887] 10.222.0.23 () {60 vars in 1309 bytes} [Tue Jul 19 19:42:53 2022] PUT /compute/v2.1/images/ab31c116-8039-477c-a890-49f72aec9ef0/metadata/os_distro => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:53.537270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:53.539238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:53.557683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.558138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.558976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.559408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.595795 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e118786f-3e83-4c9a-8267-a330b503a405 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.545758 Jul 19 19:42:53.597248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 448/888] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jul 19 19:42:53 2022] POST /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:42:53.603899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:53.604991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] [instance: 7bd99a05-fe45-446e-aab3-27dbb7be771d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:53.614481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.615697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.616991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.617827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.636524 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] HTTP exception thrown: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Request method failure captured: Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d HTTP/1.1 Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjCehFY_833p-QqRceR5hlbwROh3U-Cq12Z5npbNSiUpp6rdfLlYsbSgXBS3EU_hK7almc-069NEa1K0UcX4IzGPiESaMCRXDeEdCJhikjH0L_JjrujGQd3EaRWvk-9G8wzPnS6UF8erbUOj5ii4LnI-hR6_yXo6LXmzL1rLcDJgQA Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:53.639240 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d2b974b1f66344cc9a539ccbe7f391ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d2b974b1f66344cc9a539ccbe7f391ab Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-428559618 Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ea9cf9a38a804fdc8c053db13a1395be Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-428559618-project Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. Jul 19 19:42:53.641270 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7bd99a05-fe45-446e-aab3-27dbb7be771d'} Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:53.642324 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. Jul 19 19:42:53.644178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.654461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] Returning 404 to user: Instance 7bd99a05-fe45-446e-aab3-27dbb7be771d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:53.655640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7f1dd754-bd21-4b4c-9ffc-c751af0f18d8 tempest-FloatingIPsAssociationTestJSON-428559618 tempest-FloatingIPsAssociationTestJSON-428559618-project] 10.222.0.23 "GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d" status: 404 len: 111 microversion: 2.1 time: 0.056793 Jul 19 19:42:53.657044 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 449/889] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:53 2022] GET /compute/v2.1/servers/7bd99a05-fe45-446e-aab3-27dbb7be771d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:42:53.664178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a500ef96-1e31-4228-a60e-72040d54ee1a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:53.709467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_groups [None req-a500ef96-1e31-4228-a60e-72040d54ee1a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Querying cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) for 2 instances {{(pid=131229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 19:42:53.716374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a500ef96-1e31-4228-a60e-72040d54ee1a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.717973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a500ef96-1e31-4228-a60e-72040d54ee1a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.805932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a500ef96-1e31-4228-a60e-72040d54ee1a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/9741dc1c-5fcb-4b4a-a275-f4c64cd89589" status: 200 len: 266 microversion: 2.1 time: 0.146243 Jul 19 19:42:53.808906 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 450/890] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:42:53 2022] GET /compute/v2.1/os-server-groups/9741dc1c-5fcb-4b4a-a275-f4c64cd89589 => generated 266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:53.822590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66e754f3-6157-4409-a58a-1e651a27e5fb tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Action: 'create', calling method: .version_select at 0x7f23efd26670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:53.826834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:53.842768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c86b2ccd-0880-4d2f-abd7-0f7c0decef20 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.311785 Jul 19 19:42:53.843705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 441/891] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:53 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:53.852575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:53.853867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:53.861046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.861678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.862631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.863353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.870831 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-66e754f3-6157-4409-a58a-1e651a27e5fb tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] HTTP exception thrown: Image not found. Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66e754f3-6157-4409-a58a-1e651a27e5fb tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Request method failure captured: Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/images/c8fcb260-6c2b-47a1-9e53-fafc64f0a315/metadata HTTP/1.1 Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 57 Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wk58sDTeZXiECHAO6Rn9A-y1G9uFbp2G1Nze9DdmS0I63MhZd9a5Ul8gRmxonoEW8jJxjef3K3sIlCuxHqEuNX5DzV-nYJpUb4N198GZeVzjoVadRLz4R7J6VU6ifylYpch6TTdX3H8dlAZGRjB5fVo-AOcs1QJDJ4LZ5UrHrQmebg Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:42:53.873367 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c6a73450e8401d96d310b3110c172b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c6a73450e8401d96d310b3110c172b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 14c6a73450e8401d96d310b3110c172b Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005 Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8ee905ed813545f49f749fb01b7888f1 Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1784937005-project Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:42:53.874659 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'image_id': 'c8fcb260-6c2b-47a1-9e53-fafc64f0a315', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:53.875542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8fcb260-6c2b-47a1-9e53-fafc64f0a315 Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:42:53.876702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8fcb260-6c2b-47a1-9e53-fafc64f0a315 could not be found. Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:42:53.877881 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:42:53.879001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:42:53.880225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66e754f3-6157-4409-a58a-1e651a27e5fb tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:42:53.880225 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-66e754f3-6157-4409-a58a-1e651a27e5fb tempest-ImagesMetadataNegativeTestJSON-1784937005 tempest-ImagesMetadataNegativeTestJSON-1784937005-project] 10.222.0.23 "POST /compute/v2.1/images/c8fcb260-6c2b-47a1-9e53-fafc64f0a315/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064903 Jul 19 19:42:53.880225 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 451/892] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Jul 19 19:42:53 2022] POST /compute/v2.1/images/c8fcb260-6c2b-47a1-9e53-fafc64f0a315/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:42:53.902996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:53.906403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:53.940022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.945882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:53.948942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:53.955308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.005875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:54.018571 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e201fc03-7f37-43c0-b8e8-63fc374633aa tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1224 microversion: 2.1 time: 0.173373 Jul 19 19:42:54.035149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 442/893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:53 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:54.040392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:54.041256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:54.062145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.076280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.077195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.077709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.301471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4252ace4-c7ea-4a00-8fc2-a5070e9128f3 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 200 len: 1619 microversion: 2.1 time: 0.424514 Jul 19 19:42:54.307487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 452/894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:53 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 1619 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:54.317684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:54.321317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:54.351036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.352198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.354085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.355580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.390891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:54.404191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3122a01-cce1-45f7-93d1-f110f088d551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.364344 Jul 19 19:42:54.406292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 443/895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:54 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:54.417113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:54.419008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:54.436533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.437354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.438897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.439950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.840713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:54.851547 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9758fbf-f9f5-4188-89ed-b0f0197beed2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.542518 Jul 19 19:42:54.855015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 453/896] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:54 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:54.865220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:54.875677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:54.894480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.898295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.899540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:54.901149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:54.960893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cca66a06-074b-47aa-bc9a-b72975ac8e1a tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d" status: 200 len: 1620 microversion: 2.1 time: 0.552717 Jul 19 19:42:54.965531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 444/897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:54 2022] GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d => generated 1620 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:54.984389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: .version_select at 0x7f23ef8e0b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1402635069", "policies": ["anti-affinity"]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:55.014401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:55.020271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:55.080081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:55.085893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:55.100374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af84dace-7f09-4944-b063-343f455984b4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.121570 Jul 19 19:42:55.101764 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 445/898] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Jul 19 19:42:54 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:55.107017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:55.107946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:55.119521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:55.120555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:55.121589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:55.122252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:55.252772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:55.267461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:55.277200 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcf380be-1874-4dc2-b4a5-c5f04538db74 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1272 microversion: 2.1 time: 0.174031 Jul 19 19:42:55.277810 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 446/899] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:55 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:55.280138 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b6b63bd-fe85-41ec-ab9b-6f5d39b591d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.420993 Jul 19 19:42:55.281015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 454/900] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:54 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:55.317563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1389117400", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b3b39ec4-35db-4382-98c7-b7ea0b76c543"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:55.405395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:42:55.423312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:55.424191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:55.450217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:55.451206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:55.453252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:55.455166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.111717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:42:56.112960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:42:56.113644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:42:56.114252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:42:56.114866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:42:56.147577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.148569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.149689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.150389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.173743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:56.180283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:56.184876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:56.193959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b5ef0a4-23bb-4840-a7fd-15827298b505 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.775759 Jul 19 19:42:56.204466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 455/901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:55 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:56.206470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 2 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:42:56.209170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 45858a67-214b-4577-961a-c19ddf20e202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:56.236162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:56.236851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:56.269405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.271131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.272881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.279360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.345495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:56.361236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:56.518052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:56.535497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:56.602040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=45858a67-214b-4577-961a-c19ddf20e202,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:42:56.732560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:56.747093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18b0ad06-95fc-4681-ba16-5879d7a40395 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.525142 Jul 19 19:42:56.759452 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 456/902] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:56 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:56.767395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:56.768451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:56.780654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.781632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.782503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:56.782946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.783611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.796183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:56.835205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:56.897438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:56.912315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'server_group_members'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:56.915072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:56.932105 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72a2231b-30dc-4253-a51d-fb5301d8b53b tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1278 microversion: 2.1 time: 0.169646 Jul 19 19:42:56.934098 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 457/903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:56 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:56.960681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:56.961311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:56.979346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.983440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:56.984296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:56.984747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.068203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eba6b417-afa4-46a7-a0f3-4045c8123454 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.750749 Jul 19 19:42:57.068958 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 447/904] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:42:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1756 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:57.078100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:57.085666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:57.086569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Searching by: {'deleted': False, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:42:57.104410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.105047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.105987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.106524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.204375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:42:57.305980 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e119f66-d310-42e5-b981-2963bddc31a5 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.232703 Jul 19 19:42:57.320115 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 448/905] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:42:57 2022] GET /compute/v2.1/servers => generated 1666 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:57.348631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:57.353418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:57.403948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.404543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.409345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.409676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.575590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:57.591659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c53ddc1-a6cf-4ec4-add5-34a01245071f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.656823 Jul 19 19:42:57.602417 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 458/906] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:56 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:57.608296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-982c7f00-3a03-4bac-a409-bd0ad03a122c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:57.609082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-982c7f00-3a03-4bac-a409-bd0ad03a122c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:57.725849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:57.729427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-982c7f00-3a03-4bac-a409-bd0ad03a122c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:57.745162 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-982c7f00-3a03-4bac-a409-bd0ad03a122c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1219 microversion: 2.1 time: 0.140716 Jul 19 19:42:57.761324 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 459/907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:57 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:57.767414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:57.771699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:57.796387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.797010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:57.797981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:57.798564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.042454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:58.052630 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-613c5e0e-823c-4b62-9f6f-2259302e6551 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.731298 Jul 19 19:42:58.054965 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 449/908] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:57 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:58.310177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfacbe58-ae08-43c1-8c51-f550d15beb62 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef7be4c0>, body: {"keypair": {"name": "tempest-keypair-1433442338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCaIu8lQyBPuOlYRUFoWC5L6Ipe5aSFQJ2UAD9rIhDbJ3SOgqgczpl/Dg2C1jT0raI/Tx38Sz8CTO4oRusB8itn1bQeIo7Ry0VqUCmzKk7F1yxYCQIaHLc+ZdrNgLyiFg=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:58.341041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-dfacbe58-ae08-43c1-8c51-f550d15beb62 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:58.352865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-dfacbe58-ae08-43c1-8c51-f550d15beb62 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:58.357581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:58.360510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:42:58.368824 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-299b7dc2-78fe-43fa-abc1-74f46513c151 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.605841 Jul 19 19:42:58.374303 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 460/909] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:57 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:58.388155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.393973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:58.406448 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfacbe58-ae08-43c1-8c51-f550d15beb62 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.348643 Jul 19 19:42:58.407531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 450/910] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 351 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:58.409028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.409920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.411717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.415147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.417947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0655c901-f26e-4f6f-865a-253d74605857 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef77aaf0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.426235 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0655c901-f26e-4f6f-865a-253d74605857 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1433442338" status: 200 len: 512 microversion: 2.2 time: 0.012487 Jul 19 19:42:58.443079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 451/911] 10.222.0.23 () {60 vars in 1257 bytes} [Tue Jul 19 19:42:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1433442338 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:42:58.449143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b44886f3-d8b2-46ed-a44e-947cf768a33b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef7679d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.483167 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b44886f3-d8b2-46ed-a44e-947cf768a33b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433442338" status: 204 len: 0 microversion: 2.2 time: 0.038594 Jul 19 19:42:58.484078 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 452/912] 10.222.0.23 () {60 vars in 1260 bytes} [Tue Jul 19 19:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433442338 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:58.501367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-124e0734-1568-4d86-813e-f087885d3cb0 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef767700>, body: {"keypair": {"name": "tempest-keypair-1528336595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi2y3HzH1mYrkthhYGBTWAfw0Kivad1QVnlV/yxyY9k8AhxZtxDenIHPy7Lp5t5xwN84ok9lTjseIXnn53cMYiZSP7EosQlZzR3VTng5OL68yvmrUgVAzmZTnGOB2uL/Q=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:58.535203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-124e0734-1568-4d86-813e-f087885d3cb0 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:58.545821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-124e0734-1568-4d86-813e-f087885d3cb0 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:58.595065 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-124e0734-1568-4d86-813e-f087885d3cb0 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.101560 Jul 19 19:42:58.596015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 453/913] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:58.613313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20e2d4d0-a7b8-4b81-928e-c43b3e9faec8 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef7be3a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.674780 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20e2d4d0-a7b8-4b81-928e-c43b3e9faec8 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528336595" status: 204 len: 0 microversion: 2.2 time: 0.071336 Jul 19 19:42:58.676923 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 454/914] 10.222.0.23 () {60 vars in 1260 bytes} [Tue Jul 19 19:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528336595 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:58.683665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.685299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:58.695213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.695988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.697901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.698592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.733537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:58.741695 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a92796c-ac36-4369-bd35-c90229b6d4ac tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.360542 Jul 19 19:42:58.753973 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 461/915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:58 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:58.774521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7ef1520b-1cf9-4056-a8a1-de38a2836418 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef9663a0>, body: {"keypair": {"name": "tempest-keypair-288862728", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:58.813408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7ef1520b-1cf9-4056-a8a1-de38a2836418 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:58.822676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7ef1520b-1cf9-4056-a8a1-de38a2836418 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:58.856559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7ef1520b-1cf9-4056-a8a1-de38a2836418 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.095113 Jul 19 19:42:58.858178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 462/916] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:58 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:58.864326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:58.865715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:58.876571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.877397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:58.879217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:58.879913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:59.034061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:59.064185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3eaccc67-90a4-4bb4-9de6-9bebb503a735 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1271 microversion: 2.1 time: 0.203673 Jul 19 19:42:59.072768 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 463/917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:58 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:59.088088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:59.103356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f7e973b-b685-4233-933c-cd300965f6e3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef91fca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:59.106434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67a78fec-8c3f-4132-b80b-c215eacf079f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.424857 Jul 19 19:42:59.107928 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 455/918] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:58 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:59.134521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:59.135249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:59.167426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:59.167895 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f7e973b-b685-4233-933c-cd300965f6e3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288862728" status: 204 len: 0 microversion: 2.2 time: 0.092541 Jul 19 19:42:59.168932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:59.169828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:59.170286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:59.171190 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 464/919] 10.222.0.23 () {60 vars in 1257 bytes} [Tue Jul 19 19:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288862728 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:42:59.203160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d04c60d-fb03-4c43-9bb9-10c58d71a40b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef907940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-407067083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBenHQ29WfxwE1GYQ4pwKgnQmOv8RlVg3NnaFm3G5+PdJdMESXo4Qe2QOqi1WNF8Fc4Z+rKc+bY4DjSy823JCEtnbytdPtF9c208zyZPJQXOP0BnsWYPaQ7iYAifCC8MLg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:59.249461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0d04c60d-fb03-4c43-9bb9-10c58d71a40b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:59.265717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-0d04c60d-fb03-4c43-9bb9-10c58d71a40b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:59.365425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d04c60d-fb03-4c43-9bb9-10c58d71a40b tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.175246 Jul 19 19:42:59.376859 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 465/920] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:59 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:59.387355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50d8e303-67f1-475d-9df2-3df35434b249 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef9975e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1336824963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHplE9KXnc2HbXY4T1maCu83xHJYScXLDbDxfwJ1ed6HO0mbxe9lnWXU3Gx5g52s3DWCEnnPl6IyFE4g/4NI3fyJs4XfC8YH2gPUuVZMBL3geJbBtlyba1/c1D1rT/S3DQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:59.435134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-50d8e303-67f1-475d-9df2-3df35434b249 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:59.449941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-50d8e303-67f1-475d-9df2-3df35434b249 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:59.516655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50d8e303-67f1-475d-9df2-3df35434b249 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.135396 Jul 19 19:42:59.517338 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 466/921] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:59 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:59.535579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:42:59.538941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:42:59.553005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:59.553504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:59.557733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:42:59.558195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:42:59.842692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:59.854666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57a3c70f-32db-480e-9cbe-de011da71c68 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.742457 Jul 19 19:42:59.855292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 456/922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:59 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:42:59.864373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d75d099e-5949-4235-a662-098ddc380ab3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef937430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-533765225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO+FS7Sxi+fh0n1Y7gpPlNVpeE1s/KRBgDngVz+vrjtHZz1lKKl7AyFSqzp9Ap7OX5q1DrkpOD0kvfkKtCfwwtbQvAfBHyFBaqGrxjR26VvFDuDjWxXc6528fXM2f7l4w=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:42:59.912646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d75d099e-5949-4235-a662-098ddc380ab3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:42:59.927800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d75d099e-5949-4235-a662-098ddc380ab3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:42:59.976205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:42:59.982634 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d75d099e-5949-4235-a662-098ddc380ab3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.121975 Jul 19 19:42:59.987275 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 457/923] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:42:59 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:42:59.988306 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83676b71-10b7-45c3-9496-2d8338f95b0e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.466778 Jul 19 19:42:59.990647 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 467/924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:59 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:00.004500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.005534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:00.006791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-775b75c4-48f9-4936-b548-8f3fb882c938 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef91fc10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.014962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.015216 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-775b75c4-48f9-4936-b548-8f3fb882c938 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:43:00.016916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.017694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:00.018048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.021905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.025266 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-775b75c4-48f9-4936-b548-8f3fb882c938 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.032278 Jul 19 19:43:00.026264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 468/925] 10.222.0.23 () {60 vars in 1176 bytes} [Tue Jul 19 19:42:59 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:00.050207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:00.059757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26b4fb28-02f7-4f8d-93e1-27cc7d8999b6 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef966a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.085891 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26b4fb28-02f7-4f8d-93e1-27cc7d8999b6 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-533765225" status: 204 len: 0 microversion: 2.2 time: 0.032983 Jul 19 19:43:00.086771 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 469/926] 10.222.0.23 () {60 vars in 1317 bytes} [Tue Jul 19 19:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-533765225 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:00.093697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.094621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:00.104722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.105452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.106761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.107417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.333490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:00.343631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5c20cbf-4400-4152-bed6-4d20a926f5a8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1277 microversion: 2.1 time: 0.255012 Jul 19 19:43:00.357388 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 470/927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:00 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:00.364187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b04a6a6-457e-436f-88ac-7c25771bdfe3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef91f280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.391957 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b04a6a6-457e-436f-88ac-7c25771bdfe3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1336824963" status: 204 len: 0 microversion: 2.2 time: 0.032772 Jul 19 19:43:00.398854 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 471/928] 10.222.0.23 () {60 vars in 1320 bytes} [Tue Jul 19 19:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1336824963 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:00.408587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.409439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:00.416043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.416753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.426778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.427456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.621201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:00.634875 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-068790c4-8bf7-441e-8b94-6c1d1ae8eb40 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.644351 Jul 19 19:43:00.635661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 458/929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:42:59 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:00.649567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c764010-34a8-4548-9570-6edd7b12edba tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef880670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.683977 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c764010-34a8-4548-9570-6edd7b12edba tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-407067083" status: 204 len: 0 microversion: 2.2 time: 0.043651 Jul 19 19:43:00.688046 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 459/930] 10.222.0.23 () {60 vars in 1317 bytes} [Tue Jul 19 19:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-407067083 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:00.708719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-224046e4-6baf-4d68-845e-3166d0582a58 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef79d160>, body: {"keypair": {"name": "tempest-keypair-140599870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGs9dI6eb8V7W8nYQqk2xi7mAWO+xGVlZoktpaVNtQMep3j4zdg1sbsaV8maEbN6yfMgHyajtpvOSWtgo77cbJfJwDSKpWJAvmsRh3Rmp604PZA9zgDshAis70fxB/sw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:00.770459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-224046e4-6baf-4d68-845e-3166d0582a58 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:00.779871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-224046e4-6baf-4d68-845e-3166d0582a58 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:00.859793 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-224046e4-6baf-4d68-845e-3166d0582a58 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.161512 Jul 19 19:43:00.863220 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 460/931] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Jul 19 19:43:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:43:00.874342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb41deb7-a6c4-4a92-a625-ac72bd64f8c6 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef788790>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.884089 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb41deb7-a6c4-4a92-a625-ac72bd64f8c6 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-140599870" status: 200 len: 512 microversion: 2.2 time: 0.014793 Jul 19 19:43:00.886328 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 461/932] 10.222.0.23 () {60 vars in 1254 bytes} [Tue Jul 19 19:43:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-140599870 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:43:00.891431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.892376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:00.900760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.901849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.902904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:00.903577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:00.955227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:00.968816 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76b5d6b4-e83f-4247-abbf-446677c8cd0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.565939 Jul 19 19:43:00.981666 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 472/933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:00 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:00.993581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f66d4771-dc46-4d6f-9632-8693efdd1ec8 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef994550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:00.997244 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-f66d4771-dc46-4d6f-9632-8693efdd1ec8 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:43:01.005694 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f66d4771-dc46-4d6f-9632-8693efdd1ec8 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.021734 Jul 19 19:43:01.008073 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 473/934] 10.222.0.23 () {60 vars in 1176 bytes} [Tue Jul 19 19:43:00 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:01.014563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:01.015518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:01.028757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:01.029505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:01.030310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:01.030745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:01.959967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:01.970175 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7dd98cf8-638b-4a51-b071-49ae0e49f09a tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 1.081004 Jul 19 19:43:01.970789 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 462/935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:00 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:01.986058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ddd1434-8fea-455c-b4cd-190044bf24d3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef79d0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:02.014749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ddd1434-8fea-455c-b4cd-190044bf24d3 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140599870" status: 204 len: 0 microversion: 2.2 time: 0.032933 Jul 19 19:43:02.021624 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 463/936] 10.222.0.23 () {60 vars in 1257 bytes} [Tue Jul 19 19:43:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140599870 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:02.029054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:02.031123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:02.034214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:02.037550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b09e8c0-fbdf-4b61-81e9-8e72f233a984 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 1.027819 Jul 19 19:43:02.056660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.056660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.057016 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 474/937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:01 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:02.057104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.057104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.057269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b1155530-e582-4d1f-8828-38088d163192 req-3afa6930-4afd-4dd3-9d94-c615cb074d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24490d17-6611-4b01-b09e-7affdac43884", "tag": "e9877c03-f8d7-434e-b782-dc27ed6d9a65"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:02.069404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b1155530-e582-4d1f-8828-38088d163192 req-3afa6930-4afd-4dd3-9d94-c615cb074d45 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.069967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b1155530-e582-4d1f-8828-38088d163192 req-3afa6930-4afd-4dd3-9d94-c615cb074d45 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.094708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b1155530-e582-4d1f-8828-38088d163192 req-3afa6930-4afd-4dd3-9d94-c615cb074d45 service nova] Creating event network-changed:e9877c03-f8d7-434e-b782-dc27ed6d9a65 for instance 24490d17-6611-4b01-b09e-7affdac43884 on n-h2-843834-3 Jul 19 19:43:02.112284 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b1155530-e582-4d1f-8828-38088d163192 req-3afa6930-4afd-4dd3-9d94-c615cb074d45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063240 Jul 19 19:43:02.113329 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 475/938] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:02.118738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:02.119914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:02.129463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.136620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.137844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.143071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.240306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:02.250746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9d7420b-785a-4b4c-bc5b-a51024ce17e3 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1277 microversion: 2.1 time: 0.227963 Jul 19 19:43:02.262695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 464/939] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:02 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:02.277101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:02.277713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:02.300993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.301599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.304234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:02.304687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:02.556135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:02.568590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-38d44227-c885-4e95-aa42-9241b8241387 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.453966 Jul 19 19:43:02.569188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 476/940] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:02 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:02.582399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Action: 'create', calling method: .version_select at 0x7f23ef966430>, body: {"keypair": {"name": "tempest-keypair-1977787696", "type": "x509"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:02.627110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:02.634387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:02.664611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.processutils [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmp2xeco_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmp2xeco_/temp.key -subj /CN=ffe2e0f665554d71b02826c879768b15 -extensions v3_req_client {{(pid=131229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 19:43:02.695830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:02.710251 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2537abf9-8004-4c60-bae5-bc155116d7f3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.447650 Jul 19 19:43:02.711127 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 465/941] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:02 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:02.987174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:02.987906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:03.005221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.005862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.007015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.007692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.125038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.processutils [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmp2xeco_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmp2xeco_/temp.key -subj /CN=ffe2e0f665554d71b02826c879768b15 -extensions v3_req_client" returned: 0 in 0.458s {{(pid=131229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 19:43:03.128229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.processutils [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmp2xeco_/temp.key -password pass: {{(pid=131229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 19:43:03.173020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.processutils [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmp2xeco_/temp.key -password pass:" returned: 0 in 0.046s {{(pid=131229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 19:43:03.238118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:03.245659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Getting quotas for user ffe2e0f665554d71b02826c879768b15 and project 844bf3140fab4649bf1b6eb5d726e688. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:03.268352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1565644-e688-4ed7-86cd-2a427e67c831 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.692652 Jul 19 19:43:03.269776 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 477/942] 10.222.0.23 () {62 vars in 1197 bytes} [Tue Jul 19 19:43:02 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 700 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:03.277775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:03.278605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:03.287883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.288364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.289309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.289829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.504113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:03.512416 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92b47782-99eb-45ad-a599-e8e978b943e3 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.529402 Jul 19 19:43:03.513491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 466/943] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:02 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:03.519176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:03.520540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:03.524821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:03.529472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.529900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.530770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.531300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.722402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:03.732017 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76927c43-93ea-4da6-af0d-b6a13e39e94f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.460773 Jul 19 19:43:03.737447 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 478/944] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:03 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:03.749817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23954c46-dcd4-4ad7-b731-d40b30e4f1c5 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef9074c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:03.770803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23954c46-dcd4-4ad7-b731-d40b30e4f1c5 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1977787696" status: 200 len: 1534 microversion: 2.2 time: 0.031989 Jul 19 19:43:03.771598 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 479/945] 10.222.0.23 () {60 vars in 1257 bytes} [Tue Jul 19 19:43:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1977787696 => generated 1534 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:03.775995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:03.776602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:03.792001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.792463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:03.793417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:03.794171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.036425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:04.044016 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b135f69-6663-468e-8607-abb1ad298462 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.529224 Jul 19 19:43:04.053821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 467/946] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:03 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:04.058794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:04.059446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:04.066787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.067273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.068097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.068520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.426786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:04.436442 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49ff1a83-d1f7-40d5-b4e5-758736a2d6af tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.663932 Jul 19 19:43:04.448897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 480/947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:03 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:04.454000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3092fd10-db57-4ce0-a7de-d27e81b9e66e tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef99ad30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:04.456726 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-3092fd10-db57-4ce0-a7de-d27e81b9e66e tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:43:04.462172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3092fd10-db57-4ce0-a7de-d27e81b9e66e tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.011962 Jul 19 19:43:04.467401 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 481/948] 10.222.0.23 () {60 vars in 1176 bytes} [Tue Jul 19 19:43:04 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:04.472780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8fcd1724-06be-43f6-86b3-e5c098ecaaff req-68fb97d0-54c8-4592-909a-2eeb8bbd3910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e769d2a-f48e-4372-aaa3-8603394d3e55", "name": "network-vif-plugged", "status": "completed", "tag": "ca376b2c-714d-406a-be0d-9a73b864562a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:04.482449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8fcd1724-06be-43f6-86b3-e5c098ecaaff req-68fb97d0-54c8-4592-909a-2eeb8bbd3910 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.483061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8fcd1724-06be-43f6-86b3-e5c098ecaaff req-68fb97d0-54c8-4592-909a-2eeb8bbd3910 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.494267 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8fcd1724-06be-43f6-86b3-e5c098ecaaff req-68fb97d0-54c8-4592-909a-2eeb8bbd3910 service nova] Creating event network-vif-plugged:ca376b2c-714d-406a-be0d-9a73b864562a for instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 on n-h2-843834-3 Jul 19 19:43:04.499640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8fcd1724-06be-43f6-86b3-e5c098ecaaff req-68fb97d0-54c8-4592-909a-2eeb8bbd3910 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 Jul 19 19:43:04.500682 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 482/949] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:04.507089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8188300-c373-4662-8958-2359f696d7c5 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] Calling method '.version_select at 0x7f23ef9243a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:04.531180 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8188300-c373-4662-8958-2359f696d7c5 tempest-KeyPairsV22TestJSON-894926759 tempest-KeyPairsV22TestJSON-894926759-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977787696" status: 204 len: 0 microversion: 2.2 time: 0.026228 Jul 19 19:43:04.531849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 483/950] 10.222.0.23 () {60 vars in 1260 bytes} [Tue Jul 19 19:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977787696 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:04.535819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:04.549148 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-87b52b45-9b2d-4e49-bcb5-f14363e56f54 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.494076 Jul 19 19:43:04.551045 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 468/951] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:04 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:04.554166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:04.555407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:04.566182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.567899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.569693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.572131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.758216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:04.758828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:04.766041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.766484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:04.781156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:04.781630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.043980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:05.052650 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c397121b-41bc-4935-ad3e-8d44d6003377 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.519542 Jul 19 19:43:05.055077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:05.062473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 484/952] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:04 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:05.070080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b4bfe97-84a7-4c8c-87be-db576e2b477a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.315310 Jul 19 19:43:05.074138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:05.075159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:05.078734 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 469/953] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:04 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:05.086044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.086500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.087330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.087768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.203349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8bbded29-8576-40ac-b90d-50da44c004e6 req-a1a8731a-f6a4-4ae9-a2be-8d1bac1f8986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf820e6-82c6-49a6-aa97-29add51e1081", "tag": "3f9bc735-6bbd-4f57-8d70-d813c34ca46e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:05.219143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8bbded29-8576-40ac-b90d-50da44c004e6 req-a1a8731a-f6a4-4ae9-a2be-8d1bac1f8986 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.227119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8bbded29-8576-40ac-b90d-50da44c004e6 req-a1a8731a-f6a4-4ae9-a2be-8d1bac1f8986 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.249350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8bbded29-8576-40ac-b90d-50da44c004e6 req-a1a8731a-f6a4-4ae9-a2be-8d1bac1f8986 service nova] Creating event network-changed:3f9bc735-6bbd-4f57-8d70-d813c34ca46e for instance 9bf820e6-82c6-49a6-aa97-29add51e1081 on n-h1-843834-3 Jul 19 19:43:05.257252 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8bbded29-8576-40ac-b90d-50da44c004e6 req-a1a8731a-f6a4-4ae9-a2be-8d1bac1f8986 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058099 Jul 19 19:43:05.258433 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 470/954] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:05.428762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:05.439081 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81e0a985-fc31-4634-9001-9550aa2d7f63 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.375123 Jul 19 19:43:05.449851 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 485/955] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:05 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:05.456295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:05.457177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:05.466494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.467130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.467811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.468234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.569086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:05.569991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:05.598579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.611948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:05.613848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:05.614463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.271537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:06.280411 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71ea7873-57e0-4aa9-9137-aad63ee7db63 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.828293 Jul 19 19:43:06.281331 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 471/956] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:05 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:06.362750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:06.376563 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d168b076-2a1b-4ca5-8575-cf0b8bef8788 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1543 microversion: 2.1 time: 0.812214 Jul 19 19:43:06.386674 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 486/957] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:05 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1543 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:06.392658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:06.393446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:06.399861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.400495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.402094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.402746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.511969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7031c167-155e-4461-8c46-f04ffe1c8214 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.229469 Jul 19 19:43:06.515618 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 472/958] 10.222.0.23 () {58 vars in 1127 bytes} [Tue Jul 19 19:43:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:43:06.519385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:06.520055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:06.526408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.526999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.527938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.528678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.737178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:06.746668 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-34af5dfc-e973-4564-a60c-9a69ce7ad2aa tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1372 microversion: 2.1 time: 0.358735 Jul 19 19:43:06.752219 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 487/959] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:06 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:06.752779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:06.753640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:06.761305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.761755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.762579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:06.763075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:06.797529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:06.805439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67c1ae2c-ad68-4412-8ead-60d0db08cfb2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.291408 Jul 19 19:43:06.815556 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 473/960] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:06 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:06.820833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ca50e33-07f4-42b4-b306-3d1c1ba64ac9 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Calling method '.version_select at 0x7f23ef7058b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:06.884987 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7ca50e33-07f4-42b4-b306-3d1c1ba64ac9 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] HTTP exception thrown: Image not found. Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ca50e33-07f4-42b4-b306-3d1c1ba64ac9 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Request method failure captured: Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlJ3O-X-92Dih7oxpVjJxtBgXFup7eJKY7J_zSaHHCUpZjMMabIAZGecoFCcYK8SISTLbTFh26mZ5v2AgFUhcFy6VkAjXhk5re5Jhi9AOLfE3BVC68B-pjxJj_JpY5PskDVt56kK0vu3bL8hsdHzBhoa5xezEDbJ0WTZmkPQveJDI0 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:06.894171 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/580ad6f078304dd0a3445417291713c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_580ad6f078304dd0a3445417291713c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce42a4248f0c42a99dc587b0b3b34fb0 Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '-1'} Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:06.896635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.897811 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:06.900763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ca50e33-07f4-42b4-b306-3d1c1ba64ac9 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ca50e33-07f4-42b4-b306-3d1c1ba64ac9 tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.079242 Jul 19 19:43:06.902343 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 474/961] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 19 19:43:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:43:06.906959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b6a1d5e-0ae0-409f-b394-9f7d605b0a5e tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Calling method '.version_select at 0x7f23efcb24c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:06.990679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0b6a1d5e-0ae0-409f-b394-9f7d605b0a5e tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] HTTP exception thrown: Image not found. Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b6a1d5e-0ae0-409f-b394-9f7d605b0a5e tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Request method failure captured: Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/c056e300-9532-4886-b97f-7153c600b89j HTTP/1.1 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlJ3O-X-92Dih7oxpVjJxtBgXFup7eJKY7J_zSaHHCUpZjMMabIAZGecoFCcYK8SISTLbTFh26mZ5v2AgFUhcFy6VkAjXhk5re5Jhi9AOLfE3BVC68B-pjxJj_JpY5PskDVt56kK0vu3bL8hsdHzBhoa5xezEDbJ0WTZmkPQveJDI0 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:06.992722 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/580ad6f078304dd0a3445417291713c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_580ad6f078304dd0a3445417291713c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce42a4248f0c42a99dc587b0b3b34fb0 Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c056e300-9532-4886-b97f-7153c600b89j'} Jul 19 19:43:06.994209 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c056e300-9532-4886-b97f-7153c600b89j to delete Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.995635 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c056e300-9532-4886-b97f-7153c600b89j could not be found. Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:06.997100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b6a1d5e-0ae0-409f-b394-9f7d605b0a5e tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:06.999684 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b6a1d5e-0ae0-409f-b394-9f7d605b0a5e tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/c056e300-9532-4886-b97f-7153c600b89j" status: 404 len: 62 microversion: 2.1 time: 0.091960 Jul 19 19:43:07.000887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 475/962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:06 2022] DELETE /compute/v2.1/images/c056e300-9532-4886-b97f-7153c600b89j => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:43:07.006841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10b46136-729e-4854-9f20-39320e9a395f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Calling method '.version_select at 0x7f23ef937040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.036837 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-10b46136-729e-4854-9f20-39320e9a395f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] HTTP exception thrown: Image not found. Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10b46136-729e-4854-9f20-39320e9a395f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Request method failure captured: Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/67620e28-2a8d-4fbc-92a4-844d2c44e9981 HTTP/1.1 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlJ3O-X-92Dih7oxpVjJxtBgXFup7eJKY7J_zSaHHCUpZjMMabIAZGecoFCcYK8SISTLbTFh26mZ5v2AgFUhcFy6VkAjXhk5re5Jhi9AOLfE3BVC68B-pjxJj_JpY5PskDVt56kK0vu3bL8hsdHzBhoa5xezEDbJ0WTZmkPQveJDI0 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:07.038841 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/580ad6f078304dd0a3445417291713c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_580ad6f078304dd0a3445417291713c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce42a4248f0c42a99dc587b0b3b34fb0 Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '67620e28-2a8d-4fbc-92a4-844d2c44e9981'} Jul 19 19:43:07.040379 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 67620e28-2a8d-4fbc-92a4-844d2c44e9981 to delete Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.041278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67620e28-2a8d-4fbc-92a4-844d2c44e9981 could not be found. Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:07.042427 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10b46136-729e-4854-9f20-39320e9a395f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:07.043752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10b46136-729e-4854-9f20-39320e9a395f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/67620e28-2a8d-4fbc-92a4-844d2c44e9981" status: 404 len: 62 microversion: 2.1 time: 0.039047 Jul 19 19:43:07.046646 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 476/963] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:07 2022] DELETE /compute/v2.1/images/67620e28-2a8d-4fbc-92a4-844d2c44e9981 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:43:07.048851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:07.058661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95bcbdb5-de0b-45cd-9c0c-c1f2816dc39a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.309920 Jul 19 19:43:07.059243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b2e279fe-54f7-4d56-a33a-c237e78ede2f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Calling method '.version_select at 0x7f23ef705d30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.073483 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 488/964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:06 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:07.095957 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b2e279fe-54f7-4d56-a33a-c237e78ede2f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] HTTP exception thrown: Image not found. Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b2e279fe-54f7-4d56-a33a-c237e78ede2f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Request method failure captured: Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/tempest-invalid-1703876721 HTTP/1.1 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlJ3O-X-92Dih7oxpVjJxtBgXFup7eJKY7J_zSaHHCUpZjMMabIAZGecoFCcYK8SISTLbTFh26mZ5v2AgFUhcFy6VkAjXhk5re5Jhi9AOLfE3BVC68B-pjxJj_JpY5PskDVt56kK0vu3bL8hsdHzBhoa5xezEDbJ0WTZmkPQveJDI0 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:07.099144 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/580ad6f078304dd0a3445417291713c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_580ad6f078304dd0a3445417291713c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce42a4248f0c42a99dc587b0b3b34fb0 Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'tempest-invalid-1703876721'} Jul 19 19:43:07.100690 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1703876721 to delete Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.101696 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1703876721 could not be found. Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:07.103216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b2e279fe-54f7-4d56-a33a-c237e78ede2f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:07.105291 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b2e279fe-54f7-4d56-a33a-c237e78ede2f tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1703876721" status: 404 len: 62 microversion: 2.1 time: 0.054212 Jul 19 19:43:07.106387 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 477/965] 10.222.0.23 () {58 vars in 1205 bytes} [Tue Jul 19 19:43:07 2022] DELETE /compute/v2.1/images/tempest-invalid-1703876721 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:43:07.114586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfd9f402-3cbd-4619-8125-8d2cc1f34cdc tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Calling method '.version_select at 0x7f23ef9665e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.149380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bfd9f402-3cbd-4619-8125-8d2cc1f34cdc tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] HTTP exception thrown: Image not found. Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfd9f402-3cbd-4619-8125-8d2cc1f34cdc tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Request method failure captured: Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/images/61c07794-0943-47c4-8f43-7dbc020da30a HTTP/1.1 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlJ3O-X-92Dih7oxpVjJxtBgXFup7eJKY7J_zSaHHCUpZjMMabIAZGecoFCcYK8SISTLbTFh26mZ5v2AgFUhcFy6VkAjXhk5re5Jhi9AOLfE3BVC68B-pjxJj_JpY5PskDVt56kK0vu3bL8hsdHzBhoa5xezEDbJ0WTZmkPQveJDI0 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:07.152240 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/580ad6f078304dd0a3445417291713c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_580ad6f078304dd0a3445417291713c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/580ad6f078304dd0a3445417291713c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 580ad6f078304dd0a3445417291713c9 Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-640727261 Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ce42a4248f0c42a99dc587b0b3b34fb0 Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-640727261-project Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '61c07794-0943-47c4-8f43-7dbc020da30a'} Jul 19 19:43:07.153897 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 61c07794-0943-47c4-8f43-7dbc020da30a to delete Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.154988 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61c07794-0943-47c4-8f43-7dbc020da30a could not be found. Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:07.156135 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfd9f402-3cbd-4619-8125-8d2cc1f34cdc tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:07.157379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bfd9f402-3cbd-4619-8125-8d2cc1f34cdc tempest-ImagesDeleteNegativeTestJSON-640727261 tempest-ImagesDeleteNegativeTestJSON-640727261-project] 10.222.0.23 "DELETE /compute/v2.1/images/61c07794-0943-47c4-8f43-7dbc020da30a" status: 404 len: 62 microversion: 2.1 time: 0.043903 Jul 19 19:43:07.158328 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 489/966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:07 2022] DELETE /compute/v2.1/images/61c07794-0943-47c4-8f43-7dbc020da30a => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:43:07.294285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:07.299435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.300047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:07.312729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.315586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.317047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.319167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.401074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.401934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:07.430257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.431602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.433077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.433752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.756679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:07.771375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-887ce17a-43b2-4696-8e6d-8ff85cf53a89 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.477824 Jul 19 19:43:07.773925 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 478/967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:07 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:07.792464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4e6ed1f8-fcf3-467b-ba41-2ff7443a99e1 req-40de7a88-706e-4f69-93ee-eec300e29aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45858a67-214b-4577-961a-c19ddf20e202", "tag": "20b8b6d1-3bae-4d5e-bc13-55a9d4779f14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:07.803771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e6ed1f8-fcf3-467b-ba41-2ff7443a99e1 req-40de7a88-706e-4f69-93ee-eec300e29aef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.804584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e6ed1f8-fcf3-467b-ba41-2ff7443a99e1 req-40de7a88-706e-4f69-93ee-eec300e29aef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.822736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4e6ed1f8-fcf3-467b-ba41-2ff7443a99e1 req-40de7a88-706e-4f69-93ee-eec300e29aef service nova] Creating event network-changed:20b8b6d1-3bae-4d5e-bc13-55a9d4779f14 for instance 45858a67-214b-4577-961a-c19ddf20e202 on n-h2-843834-3 Jul 19 19:43:07.828816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4e6ed1f8-fcf3-467b-ba41-2ff7443a99e1 req-40de7a88-706e-4f69-93ee-eec300e29aef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049816 Jul 19 19:43:07.829748 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 479/968] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:07.835605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.836634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:07.845237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.845996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.847286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.848012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.877193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:07.892896 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7c0e69d-657b-47c7-8dd9-f24b52b0875e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1542 microversion: 2.1 time: 0.501623 Jul 19 19:43:07.899970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 490/969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:07 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1542 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:07.907839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:07.908536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:07.922420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.923138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:07.924606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:07.925416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.213131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:08.224739 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47610ae2-3a3d-48fe-a8e1-795e7caf638d tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1558 microversion: 2.1 time: 0.392775 Jul 19 19:43:08.224739 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 480/970] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:07 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1558 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:08.224739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-897d8654-fb0b-487b-8cb9-479fb81435ad req-c592818f-efce-44b0-ad88-b9ad00f93c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24490d17-6611-4b01-b09e-7affdac43884", "name": "network-vif-plugged", "status": "completed", "tag": "e9877c03-f8d7-434e-b782-dc27ed6d9a65"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:08.240897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-897d8654-fb0b-487b-8cb9-479fb81435ad req-c592818f-efce-44b0-ad88-b9ad00f93c77 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.241411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-897d8654-fb0b-487b-8cb9-479fb81435ad req-c592818f-efce-44b0-ad88-b9ad00f93c77 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.257131 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-897d8654-fb0b-487b-8cb9-479fb81435ad req-c592818f-efce-44b0-ad88-b9ad00f93c77 service nova] Creating event network-vif-plugged:e9877c03-f8d7-434e-b782-dc27ed6d9a65 for instance 24490d17-6611-4b01-b09e-7affdac43884 on n-h2-843834-3 Jul 19 19:43:08.264883 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-897d8654-fb0b-487b-8cb9-479fb81435ad req-c592818f-efce-44b0-ad88-b9ad00f93c77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038552 Jul 19 19:43:08.265823 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 481/971] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:08.271525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:08.273988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:08.276360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:08.279989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:08.281641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.283407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.284444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.285078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.293277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-08e82271-2450-4b36-b5a4-cca3a7798039 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 0.392149 Jul 19 19:43:08.293964 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 491/972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:07 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:08.300705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:08.301797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:08.312202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.312906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.313937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.314585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.582229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d2b6cd5-4348-4188-aacc-5bdaa2e61357 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287176 Jul 19 19:43:08.582948 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 492/973] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:43:08 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:08.718853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:08.730155 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0628172a-30d3-4daa-8a89-1dd315a16e21 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.462739 Jul 19 19:43:08.739810 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 482/974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:08 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:08.791916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:08.792804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:08.802985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.804151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.805229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.806129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.918825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:08.919606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:08.933384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.934043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:08.936505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:08.937681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:09.170485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:09.187999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0522dff0-77c7-4e1f-988d-fab67d725574 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.396375 Jul 19 19:43:09.189381 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 493/975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:08 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:09.311393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:09.312391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:09.329393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:09.329941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:09.330854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:09.334344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:09.584395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:09.600610 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1caf911-b4f3-4b03-86eb-57629f57cc08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1474 microversion: 2.1 time: 0.685108 Jul 19 19:43:09.603406 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 483/976] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:08 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1474 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:09.747319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:09.747953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:09.761224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:09.761923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:09.762761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:09.763308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.430771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:10.447693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e42c2c8-25f5-4725-9826-5cf2be976d55 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1497 microversion: 2.1 time: 1.136737 Jul 19 19:43:10.449868 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 494/977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:09 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1497 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:10.458402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:10.459337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:10.478383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.480854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.482139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.483199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.680053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:10.691546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3c4b36d-cd51-4b38-b7e5-366f1a5ceab1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.947830 Jul 19 19:43:10.693091 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 484/978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:09 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:43:10.700160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-unplugged", "status": "completed", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:10.714878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.715713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.732885 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] Creating event network-vif-unplugged:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:43:10.742534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] Instance e432da26-c067-498f-b73f-b1f6592283dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:43:10.750288 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f12661ec-df12-43d2-9ecf-7294ca68c31f req-07f432cd-5321-497e-95c5-a593b631aa9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055551 Jul 19 19:43:10.751341 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 485/979] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:10.757190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4dc0f4f9-9eb8-4689-a027-3b66ea29d93d req-10139787-c8ca-4d65-abe9-97aff80ab1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e769d2a-f48e-4372-aaa3-8603394d3e55", "tag": "ca376b2c-714d-406a-be0d-9a73b864562a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:10.766287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4dc0f4f9-9eb8-4689-a027-3b66ea29d93d req-10139787-c8ca-4d65-abe9-97aff80ab1e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.767062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4dc0f4f9-9eb8-4689-a027-3b66ea29d93d req-10139787-c8ca-4d65-abe9-97aff80ab1e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.778400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:10.780965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4dc0f4f9-9eb8-4689-a027-3b66ea29d93d req-10139787-c8ca-4d65-abe9-97aff80ab1e6 service nova] Creating event network-changed:ca376b2c-714d-406a-be0d-9a73b864562a for instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 on n-h2-843834-3 Jul 19 19:43:10.786241 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4dc0f4f9-9eb8-4689-a027-3b66ea29d93d req-10139787-c8ca-4d65-abe9-97aff80ab1e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 Jul 19 19:43:10.786852 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 486/980] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:10.794045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:10.794742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:10.803123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.804006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.804871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:10.805332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:10.821698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=47 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:10.983762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:10.998809 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bc23840-44ca-42f2-ab21-82e65504e1e9 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1320 microversion: 2.1 time: 0.544770 Jul 19 19:43:11.011829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 495/981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:10 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:11.018478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:11.019580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:11.029981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.030798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:11.032424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.033052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:11.253122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:11.267171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c59bfd2-791a-4060-939e-e518415c624a tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 2421 microversion: 2.25 time: 0.478598 Jul 19 19:43:11.268058 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 487/982] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:10 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 2421 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:11.285616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843834-3", "block_migration": "auto"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:11.286769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:11.292745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.293629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:11.293952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.294375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:11.319968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'flavor' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:11.333413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Going to try to live migrate instance to n-h2-843834-3 {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:43:11.452269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:11.463650 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67454712-d4b7-4fe1-876d-fe7735cde4ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1471 microversion: 2.1 time: 0.450200 Jul 19 19:43:11.477785 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 496/983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:11 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:11.483653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:11.484596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:11.495670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.496117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:11.496906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:11.497337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.003049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:12.018289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1492d89e-4b4e-48a1-922e-6ec68d831bd9 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 200 len: 1474 microversion: 2.1 time: 0.539039 Jul 19 19:43:12.019019 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 497/984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:11 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 1474 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:12.032654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:12.033533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:12.043771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.047225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.048272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.051954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.136636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.137572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.139006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.139497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.175302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:12.181306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for user f2e7f9d9c6ab4b20aa20b98a514bf701 and project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:12.281996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:12.390721 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01d27ef7-2fcd-4b26-bc94-b363c89a9d27 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd/action" status: 202 len: 0 microversion: 2.1 time: 0.369832 Jul 19 19:43:12.391984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 498/985] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:12 2022] POST /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:12.414736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:12.416071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:12.431961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.435405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.436549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:12.436962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:12.996467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:13.015764 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-612a046a-6155-430d-bf11-e42082dec62a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.622227 Jul 19 19:43:13.027842 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 499/986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:12 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:13.033833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:13.034644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:13.042631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.043811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.045984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.047305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.258736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=32 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:13.440360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:13.453942 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32a9c853-0866-484d-b362-1837cc3af874 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1470 microversion: 2.1 time: 0.423705 Jul 19 19:43:13.456256 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 500/987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:13 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:13.471431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-271123437"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:13.474140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:13.484631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.490407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.493637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.495578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.626130 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8aac7e44-526d-499f-9b7e-5e5d8b86722c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/action" status: 202 len: 0 microversion: 2.25 time: 2.343971 Jul 19 19:43:13.627307 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 488/988] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:43:11 2022] POST /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/action => generated 0 bytes in 2346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:43:13.634798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:13.638568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:13.662209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.662744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.665092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:13.665183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:13.968700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30310d56-8d59-4bf9-862a-f13fcda728a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd/action" status: 202 len: 0 microversion: 2.1 time: 0.507907 Jul 19 19:43:13.971881 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 501/989] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:13 2022] POST /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:43:14.010631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:14.015409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:14.041713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.042165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.043249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.043473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.146556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:14.152222 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-761a095d-577a-410e-836a-a6161eb8b22f tempest-DeleteServersAdminTestJSON-1141453725 tempest-DeleteServersAdminTestJSON-1141453725-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884/action" status: 202 len: 0 microversion: 2.1 time: 0.177806 Jul 19 19:43:14.153237 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 502/990] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:13 2022] POST /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:14.162486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:14.163544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:14.173675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.176165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.177335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.177986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.510001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:14.538852 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3dbeecf-fbab-49f4-a5f2-153761f7d2a2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1470 microversion: 2.1 time: 0.910254 Jul 19 19:43:14.542098 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:13 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1470 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:14.550606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48b9c72c-ba7c-42c9-ba76-8e4451484e65 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef72a790>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:14.677524 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48b9c72c-ba7c-42c9-ba76-8e4451484e65 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.129449 Jul 19 19:43:14.678095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 490/992] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:14 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:14.692107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:14.692796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:14.693417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:14.719502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:14.720571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.721284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.722255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.722876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.725519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:14.726852 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7033a474-be42-47a6-8667-112f4d95a4e4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.572397 Jul 19 19:43:14.731729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 503/993] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:14 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:14.747866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:14.748586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:14.760434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.769402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.770378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.776020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.846827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:14.847444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:14.848007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 24490d17-6611-4b01-b09e-7affdac43884 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:15.024147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:15.033688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-689ae368-51f1-44e2-b9a5-1b5e03ee47f9 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.352238 Jul 19 19:43:15.044616 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 491/994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:14 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:15.054466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:15.066516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8be7863-40cf-42ba-a333-867ff61c3569 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1453 microversion: 2.1 time: 0.332800 Jul 19 19:43:15.067204 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 504/995] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:14 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1453 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:15.083259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:15.083736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:15.091002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.091426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.092404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.093000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.127689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:43:15.246030 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-51d1ca2d-5f94-4432-903f-e4ff8a70e955 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 204 len: 0 microversion: 2.1 time: 0.166439 Jul 19 19:43:15.248276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 492/996] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:15 2022] DELETE /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:15.257542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:15.258498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:15.265453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.266229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.267221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.267977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.311461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.312126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.312905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 24490d17-6611-4b01-b09e-7affdac43884 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:15.455109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:15.465409 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c05d264c-fce6-4b9f-b154-5862e8d9a019 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1459 microversion: 2.1 time: 0.212639 Jul 19 19:43:15.466672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 505/997] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:15 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1459 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:15.559836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:15.560940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:15.572224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.573173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.575692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.576304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.695362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5376417-4048-4139-8896-2bba5fccd0ac tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef8a64c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:15.764778 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5376417-4048-4139-8896-2bba5fccd0ac tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.076454 Jul 19 19:43:15.765407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 506/998] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:15 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:15.779644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:15.780949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:15.790720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:15.792476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.793804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.795368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.796098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.801808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42e9f3a0-8d80-4ffe-a256-d70197ff9d08 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1470 microversion: 2.1 time: 0.247440 Jul 19 19:43:15.812468 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 493/999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:15 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:15.862220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-feade682-8781-413b-bde9-414d6092b4f6 req-77af4250-aad8-4fbf-9572-24d771d7c831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf820e6-82c6-49a6-aa97-29add51e1081", "name": "network-vif-plugged", "status": "completed", "tag": "3f9bc735-6bbd-4f57-8d70-d813c34ca46e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:15.874647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-feade682-8781-413b-bde9-414d6092b4f6 req-77af4250-aad8-4fbf-9572-24d771d7c831 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:15.875614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-feade682-8781-413b-bde9-414d6092b4f6 req-77af4250-aad8-4fbf-9572-24d771d7c831 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:15.892145 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-feade682-8781-413b-bde9-414d6092b4f6 req-77af4250-aad8-4fbf-9572-24d771d7c831 service nova] Creating event network-vif-plugged:3f9bc735-6bbd-4f57-8d70-d813c34ca46e for instance 9bf820e6-82c6-49a6-aa97-29add51e1081 on n-h1-843834-3 Jul 19 19:43:15.900884 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-feade682-8781-413b-bde9-414d6092b4f6 req-77af4250-aad8-4fbf-9572-24d771d7c831 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042690 Jul 19 19:43:15.902167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 494/1000] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:16.052641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:16.053804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:16.072614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.074059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.076406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.079396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.236687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:16.248694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:16.250213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:16.251488 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-566b43a9-866e-4a6a-8855-02f219fbb203 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.484814 Jul 19 19:43:16.252116 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 507/1001] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:15 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:16.380575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:16.397324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba81c277-62ce-4ded-b2cb-3d63053e6566 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.349358 Jul 19 19:43:16.401758 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 495/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:16 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:43:16.483570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:16.484379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:16.504332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.506865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.516310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.517099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.586449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.587351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.588027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 24490d17-6611-4b01-b09e-7affdac43884 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:16.777459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70006d0f-9990-4a4f-b6a6-66f509345c9c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef71aca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:16.864857 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70006d0f-9990-4a4f-b6a6-66f509345c9c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.090613 Jul 19 19:43:16.871608 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 496/1003] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:16 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:16.884414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:16.885290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:16.896000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.899784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:16.901563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:16.903484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:17.203916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.214467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42023351-a22a-42f9-9d7a-6f30854f8762 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1459 microversion: 2.1 time: 0.732363 Jul 19 19:43:17.225861 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 508/1004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:16 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1459 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:17.266388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.275946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:17.277189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:17.278602 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aeb80ae8-2543-43ce-a855-eac2cf63c147 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1470 microversion: 2.1 time: 0.404866 Jul 19 19:43:17.279261 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 497/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:16 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:17.285834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:17.286516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:17.287526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:17.288174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:17.425624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:17.427762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:17.445376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:17.445858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:17.446818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:17.448458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:17.722094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.736478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.737991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.739195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b16bc8e-4ed4-48a8-a91f-f7aa7949a728 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.473522 Jul 19 19:43:17.739767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 509/1006] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:17 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:43:17.780238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:17.796992 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c6c6bef3-0dd9-4a87-b906-1b60dba471c4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1319 microversion: 2.1 time: 0.381062 Jul 19 19:43:17.800072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 498/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:17 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:43:17.891139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3870612e-48df-4133-aa53-e1ad7bc834ac tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef930670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:17.959838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d7006a8-1dc9-4647-bfb0-27c0e279a6eb tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef89e040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1051162451", "description": "tempest-description-329405700"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:17.988421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3870612e-48df-4133-aa53-e1ad7bc834ac tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.113501 Jul 19 19:43:17.995178 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 499/1008] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:17 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:18.007287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-plugged", "status": "completed", "tag": "6db41234-67c5-489e-b355-7327b6995257"}, {"server_uuid": "45858a67-214b-4577-961a-c19ddf20e202", "name": "network-vif-plugged", "status": "completed", "tag": "20b8b6d1-3bae-4d5e-bc13-55a9d4779f14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:18.023481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:18.024265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:18.063396 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Creating event network-vif-plugged:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:43:18.064428 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Creating event network-vif-plugged:20b8b6d1-3bae-4d5e-bc13-55a9d4779f14 for instance 45858a67-214b-4577-961a-c19ddf20e202 on n-h2-843834-3 Jul 19 19:43:18.073950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] Instance e432da26-c067-498f-b73f-b1f6592283dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:43:18.087608 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ccacaf1a-59e8-4709-8e21-f80c0b488d13 req-9148f8fc-b4ff-49d2-83c9-d95321575aee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090384 Jul 19 19:43:18.090513 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 500/1009] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:18.236467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:18.237435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:18.258666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:18.262164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:18.264576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:18.265142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:18.371785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:18.372280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:18.373602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 24490d17-6611-4b01-b09e-7affdac43884 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:19.478109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d7006a8-1dc9-4647-bfb0-27c0e279a6eb tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.737253 Jul 19 19:43:19.478725 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 510/1010] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:19.484060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:19.484822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:19.517215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:19.517716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:19.518526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:19.533959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:19.629040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:19.643987 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6448bf14-6a7b-4d3c-ad13-0b0e3be58a77 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1459 microversion: 2.1 time: 1.412929 Jul 19 19:43:19.646206 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 501/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:18 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1459 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:19.657186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:19.658215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:19.679959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:19.682848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:19.683937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:19.687676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.319472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:20.333168 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bdba1ef-3e2c-434a-8836-acf792e7967f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1536 microversion: 2.1 time: 0.853236 Jul 19 19:43:20.341194 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 511/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:19 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1536 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:20.348004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:20.349016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:20.363566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.364420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.365464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.367536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.546093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:20.556031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:20.562403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:20.568434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd9a2869-27b2-4d55-b337-a2e116905e08 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.920745 Jul 19 19:43:20.569278 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 502/1013] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:19 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:20.577975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c5f8b78-2419-41d9-a0f1-fccf3c385894 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef788b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:20.666323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:20.679391 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7c5bec7-7bdf-4759-add3-7550484bbe1f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1468 microversion: 2.1 time: 0.336497 Jul 19 19:43:20.685165 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 512/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:20 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:20.696785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c903d8e8-62ed-42e8-ad6e-a98afffc2e3d tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef89e700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-491596349", "description": "tempest-description-1096415216"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:20.701026 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c5f8b78-2419-41d9-a0f1-fccf3c385894 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.130407 Jul 19 19:43:20.701653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 503/1015] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:20 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:20.715634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5f3e14de-55b8-4e11-bf51-f90e69879c33 req-fa913b76-949d-47b4-a0f4-d46fe73137f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24490d17-6611-4b01-b09e-7affdac43884", "name": "network-vif-deleted", "tag": "e9877c03-f8d7-434e-b782-dc27ed6d9a65"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:20.726327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5f3e14de-55b8-4e11-bf51-f90e69879c33 req-fa913b76-949d-47b4-a0f4-d46fe73137f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.726769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5f3e14de-55b8-4e11-bf51-f90e69879c33 req-fa913b76-949d-47b4-a0f4-d46fe73137f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.733944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:20.745779 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5f3e14de-55b8-4e11-bf51-f90e69879c33 req-fa913b76-949d-47b4-a0f4-d46fe73137f7 service nova] Creating event network-vif-deleted:e9877c03-f8d7-434e-b782-dc27ed6d9a65 for instance 24490d17-6611-4b01-b09e-7affdac43884 on n-h2-843834-3 Jul 19 19:43:20.754881 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5f3e14de-55b8-4e11-bf51-f90e69879c33 req-fa913b76-949d-47b4-a0f4-d46fe73137f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 Jul 19 19:43:20.755685 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 504/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:20.766755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:20.767521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:20.774817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.775435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.776212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.776643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.867808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:20.868542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:20.869154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lazy-loading 'fault' on Instance uuid 24490d17-6611-4b01-b09e-7affdac43884 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:43:21.070127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30d4842de5b47a0a13fcfe6d816a092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c83ef532d04a6e93ee4c1075a23623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:21.082345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65b76917-4349-442e-91e5-ea3fbd1cd54c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 200 len: 1310 microversion: 2.1 time: 0.321376 Jul 19 19:43:21.085184 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 505/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:20 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:21.108420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:21.109072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 45858a67-214b-4577-961a-c19ddf20e202] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:21.130829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:21.131336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:21.135777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:21.138751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:21.700341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c903d8e8-62ed-42e8-ad6e-a98afffc2e3d tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.012068 Jul 19 19:43:21.701663 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 513/1018] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:21.707084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:21.707898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:21.722327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:21.722792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:21.725039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:21.728570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:22.155857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:22.544714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:22.560956 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df958f2c-df42-490f-93bf-76c65ca9d737 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202" status: 200 len: 1469 microversion: 2.1 time: 1.474605 Jul 19 19:43:22.561897 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 506/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:21 2022] GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202 => generated 1469 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:22.569750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-unplugged", "status": "completed", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:22.598457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:22.599513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:22.655447 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] Creating event network-vif-unplugged:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:43:22.670947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] Instance e432da26-c067-498f-b73f-b1f6592283dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:43:22.692293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6b0fe846-320e-4240-b741-0925c2cbe665 req-168aa6e6-cae6-4f73-b90d-f0ec74e76544 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128159 Jul 19 19:43:22.695117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 507/1020] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:22.719159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:22.721561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:22.737347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:22.744434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:22.745105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:22.747418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:22.748188 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9294f06b-3673-414b-a039-2294f84a67f9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1536 microversion: 2.1 time: 1.045418 Jul 19 19:43:22.748624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:22.758708 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 514/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:21 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1536 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:22.763220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b33fe303-56b4-44cd-99ed-1d72d1d00973 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef85dee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:22.838680 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b33fe303-56b4-44cd-99ed-1d72d1d00973 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.087908 Jul 19 19:43:22.839615 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 515/1022] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:22 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:22.849097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-497352809", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "75a0e96b-eb29-4e07-a4f9-7d2011c03d19"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:22.946406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] validate_networks() for [('75a0e96b-eb29-4e07-a4f9-7d2011c03d19', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:43:23.393625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:23.406514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:23.410694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:23.412176 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42c5c748-3db6-491e-87ea-ae23d404b345 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.715554 Jul 19 19:43:23.415267 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 508/1023] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:22 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:23.420169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:23.425109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:23.437985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:23.444278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:23.445570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:23.446256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:23.464019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 HTTP/1.1 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:23.477058 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:23.478637 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '24490d17-6611-4b01-b09e-7affdac43884'} Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:23.479463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:23.480739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:23.487416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:23.488609 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b356f53-54fd-466f-92ca-d2268ce1f6ab tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 404 len: 111 microversion: 2.1 time: 0.072129 Jul 19 19:43:23.496617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 509/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:23 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:23.502037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:23.510669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:23.512157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Searching by: {'reservation_id': 'r-0gk5wc0t', 'deleted': False, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:43:23.522472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:23.526903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:23.530754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:23.531393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:23.744589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:43:23.850858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:23.859785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:23.860502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.263902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:43:24.264417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:43:24.264886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:43:24.265469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:43:24.266126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:43:24.303658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.304957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.310844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.311371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.397600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Getting quotas for project db24051a3a4840f3a4e77d476d6caff2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:24.430129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Getting quotas for user 31cc87c2c9ed45c883b44a3c14c3a1a2 and project db24051a3a4840f3a4e77d476d6caff2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:24.486500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:43:24.492592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e55f182-7603-47ca-9c51-173ef7932f48 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-0gk5wc0t" status: 200 len: 2930 microversion: 2.1 time: 0.994537 Jul 19 19:43:24.493772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 510/1025] 10.222.0.23 () {58 vars in 1196 bytes} [Tue Jul 19 19:43:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0gk5wc0t => generated 2930 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:24.498633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:24.499552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:24.522770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:43:24.533667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.535934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.537165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.540011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.584641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 HTTP/1.1 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:24.590184 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:24.591683 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '24490d17-6611-4b01-b09e-7affdac43884'} Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:24.592422 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:24.593584 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:24.598569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:24.600835 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eebeb03d-a2f2-4ef6-a479-0e44b2f08d1c tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 404 len: 111 microversion: 2.1 time: 0.105943 Jul 19 19:43:24.604341 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 511/1026] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:24 2022] DELETE /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:24.618136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:24.620404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:24.637370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.638247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.639333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.639987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.671986 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f522e6b3-841b-4c9d-b37b-52d2277259e9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823768 Jul 19 19:43:24.682336 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 516/1027] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:43:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:43:24.708023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14d7ec9d-26a1-4d47-bcd9-3642038b351f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef85daf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:24.823499 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14d7ec9d-26a1-4d47-bcd9-3642038b351f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.139066 Jul 19 19:43:24.827159 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 517/1028] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:24 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:24.845361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:24.860123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:24.891089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.894083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:24.897133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:24.900377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.399053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:25.411678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b2c592b0-065c-48c5-a89f-9e44ff0898b6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1536 microversion: 2.1 time: 0.805301 Jul 19 19:43:25.416939 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 512/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:24 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1536 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:25.425754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:25.446956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8982370b-6fa8-4873-9851-a302b4753eb8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:25.449587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:25.454077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:25.456255 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b962a727-4e03-484b-bc21-8df31c2eb43f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.628088 Jul 19 19:43:25.461257 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 518/1030] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:24 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:25.466427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:25.473749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 24490d17-6611-4b01-b09e-7affdac43884] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:25.486267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.server_groups [None req-8982370b-6fa8-4873-9851-a302b4753eb8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Querying cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) for 2 instances {{(pid=131230) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 19:43:25.492461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8982370b-6fa8-4873-9851-a302b4753eb8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.493173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8982370b-6fa8-4873-9851-a302b4753eb8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.495124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.495936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.501486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.502271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.540298 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 HTTP/1.1 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:25.545824 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:25.547716 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '24490d17-6611-4b01-b09e-7affdac43884'} Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:25.548755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. Jul 19 19:43:25.550273 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.551733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 24490d17-6611-4b01-b09e-7affdac43884 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:25.552500 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc4d3643-ed9b-4385-93ef-2bbb374689f3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884" status: 404 len: 111 microversion: 2.1 time: 0.086149 Jul 19 19:43:25.557268 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 519/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:25 2022] GET /compute/v2.1/servers/24490d17-6611-4b01-b09e-7affdac43884 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:25.570026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:25.570752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:25.586063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8982370b-6fa8-4873-9851-a302b4753eb8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/b3b39ec4-35db-4382-98c7-b7ea0b76c543" status: 200 len: 271 microversion: 2.1 time: 0.165772 Jul 19 19:43:25.586542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.587822 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 513/1032] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:43:25 2022] GET /compute/v2.1/os-server-groups/b3b39ec4-35db-4382-98c7-b7ea0b76c543 => generated 271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:25.589293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.596228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.597896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.605664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-277be5d6-6ec0-4d02-a5da-8f53459fc767 req-44dd3905-a72e-4e49-b3c4-14578fbb49bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd", "name": "network-vif-plugged", "status": "completed", "tag": "7f8ff442-d5ff-44bd-8530-4a6bd1170e3e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:25.627779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-277be5d6-6ec0-4d02-a5da-8f53459fc767 req-44dd3905-a72e-4e49-b3c4-14578fbb49bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.628608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-277be5d6-6ec0-4d02-a5da-8f53459fc767 req-44dd3905-a72e-4e49-b3c4-14578fbb49bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.661382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-277be5d6-6ec0-4d02-a5da-8f53459fc767 req-44dd3905-a72e-4e49-b3c4-14578fbb49bd service nova] Creating event network-vif-plugged:7f8ff442-d5ff-44bd-8530-4a6bd1170e3e for instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd on n-h2-843834-3 Jul 19 19:43:25.684283 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-277be5d6-6ec0-4d02-a5da-8f53459fc767 req-44dd3905-a72e-4e49-b3c4-14578fbb49bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091224 Jul 19 19:43:25.688549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 514/1033] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:25.745885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:25.757010 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebcbc5e5-3154-423b-a7a2-330ca89e5a44 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1219 microversion: 2.1 time: 0.197155 Jul 19 19:43:25.757865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 520/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:25 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:25.775821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:25.776967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:25.795343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.795967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.797122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.797815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.821409 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 HTTP/1.1 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:25.823860 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:25.825481 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '360bc800-b98b-4fd8-83f8-469cbea4ca96'} Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:25.826351 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:25.827906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:25.831354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:25.832961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0624a00-07c8-4b07-b181-402d03b2ecf3 tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "DELETE /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 404 len: 111 microversion: 2.1 time: 0.061781 Jul 19 19:43:25.833694 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 521/1035] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:25 2022] DELETE /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:25.839380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:25.841887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 45858a67-214b-4577-961a-c19ddf20e202] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:25.851573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.852216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.853261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:25.853874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:25.910534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-979291f9-9852-418f-9e43-1346060ebf1e tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef722820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1015755543", "description": "tempest-description-648388922"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:26.300804 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a0d39ef-2bbf-4df4-9dc2-adb2e9a65258 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202" status: 200 len: 1620 microversion: 2.1 time: 0.462029 Jul 19 19:43:26.301982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 522/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:25 2022] GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202 => generated 1620 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:26.320591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6b9c1e8-d0c9-40c5-a988-25f7ccd2b885 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef849160>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:26.396757 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-979291f9-9852-418f-9e43-1346060ebf1e tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.694929 Jul 19 19:43:26.397887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 515/1037] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:26.403041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:26.403607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6b9c1e8-d0c9-40c5-a988-25f7ccd2b885 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.097606 Jul 19 19:43:26.404589 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 523/1038] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:26 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:26.404889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] [instance: 360bc800-b98b-4fd8-83f8-469cbea4ca96] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:26.417260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:26.421207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:26.422759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:26.423920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:26.427531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:26.430210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:26.449741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:26.452278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:26.455262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:26.455719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:26.460364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] HTTP exception thrown: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Request method failure captured: Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 HTTP/1.1 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wkby6H5qGzSh-jwxvWoa-dNpfHcQ-e97GMCaEP1azA3tsSbyEFOi20co1_Ik3DuDje1DNqucrnbCnkY5aN3PJFx3UKLWI9NXciBUTplhcKXC_UwpqoMDg186GgpaFSxLGoCdDKJNbifAc552peK1nv0pSzrk-rYLLTWpiu-OcHbLDc Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:26.462286 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/28c83ef532d04a6e93ee4c1075a23623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 28c83ef532d04a6e93ee4c1075a23623 Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1329556220 Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d30d4842de5b47a0a13fcfe6d816a092 Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersAdminTestJSON-1329556220-project Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:26.463888 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '360bc800-b98b-4fd8-83f8-469cbea4ca96'} Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:26.464797 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. Jul 19 19:43:26.467853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:26.469719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] Returning 404 to user: Instance 360bc800-b98b-4fd8-83f8-469cbea4ca96 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:26.470896 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dbcac711-c1f9-497f-895e-95c332798dbf tempest-DeleteServersAdminTestJSON-1329556220 tempest-DeleteServersAdminTestJSON-1329556220-project] 10.222.0.23 "GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96" status: 404 len: 111 microversion: 2.1 time: 0.071839 Jul 19 19:43:26.480319 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 516/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:26 2022] GET /compute/v2.1/servers/360bc800-b98b-4fd8-83f8-469cbea4ca96 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:26.486207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4b64f92-54c5-476e-9c18-5518d15b322b tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef722ca0>, body: {"security_group_rule": {"parent_group_id": "6211302c-8f4f-4dfc-9147-6473c1961e9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:27.275881 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85d677a0-d07c-472f-9322-ea14c1e729a7 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 200 len: 1619 microversion: 2.1 time: 0.869363 Jul 19 19:43:27.281004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 524/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:26 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 1619 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:27.294151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:27.302800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:27.326057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:27.326408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:27.331687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:27.334846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:27.849578 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4b64f92-54c5-476e-9c18-5518d15b322b tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.367755 Jul 19 19:43:27.855822 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 517/1041] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:27.861742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:27.862867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:27.873121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:27.874572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:27.877932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:27.878803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:28.072011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:28.090840 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64216e83-a496-472d-8f2e-4c6d0f1f0bc6 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1529 microversion: 2.1 time: 0.808506 Jul 19 19:43:28.092051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 525/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:27 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1529 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:28.108057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:28.109720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:28.127451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:28.128132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:28.129081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:28.129663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:28.166679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:28.402963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:28.420081 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebdf0b8e-ff00-4973-8e3a-772f1d1059b5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1273 microversion: 2.1 time: 0.326545 Jul 19 19:43:28.424195 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 526/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:28 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:28.435797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0edcecb9-dd0d-40d4-a5a8-8be6cdd3928d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef84d160>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:28.444812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:28.466227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:28.468322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:28.476592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5131900-e3db-49d1-bcfc-793f0b60f350 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.619229 Jul 19 19:43:28.479941 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 518/1044] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:27 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:28.488804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1435748028", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f65301ea-31b5-4e24-a345-ad9c73259006"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:28.641891 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0edcecb9-dd0d-40d4-a5a8-8be6cdd3928d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.216190 Jul 19 19:43:28.648206 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 527/1045] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:28 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:28.659315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2c0546f-4321-4f0a-a3ed-b1d5f4116ec9 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef994280>, body: {"security_group_rule": {"parent_group_id": "6211302c-8f4f-4dfc-9147-6473c1961e9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:28.673189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:43:29.224021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f2c0546f-4321-4f0a-a3ed-b1d5f4116ec9 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2c0546f-4321-4f0a-a3ed-b1d5f4116ec9 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 138 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:29.255938 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "6211302c-8f4f-4dfc-9147-6473c1961e9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 19:43:29.257623 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: exception: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6211302c-8f4f-4dfc-9147-6473c1961e9d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:29.258509 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d Jul 19 19:43:29.260040 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:29.261810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2c0546f-4321-4f0a-a3ed-b1d5f4116ec9 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: This rule already exists in group 6211302c-8f4f-4dfc-9147-6473c1961e9d {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:29.262869 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2c0546f-4321-4f0a-a3ed-b1d5f4116ec9 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.613397 Jul 19 19:43:29.266644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 528/1046] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 615 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:43:29.271508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:29.272117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:29.291028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.291512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.295489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.299504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.400658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:43:29.401120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:43:29.401534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:43:29.402002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:43:29.402414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:43:29.406363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:29.435687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.436073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.438862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.439376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.486396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:29.495256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:29.523074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:43:29.525768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:43:29.608249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8326c78-2895-4b79-8935-f34a644b62f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127080 Jul 19 19:43:29.609499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 519/1047] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:43:29.617577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5bc29546-b066-4d6f-926d-8c9021f2797b req-d9d448c9-4b0f-4388-af4d-851cba8c0ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-plugged", "status": "completed", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:29.637019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5bc29546-b066-4d6f-926d-8c9021f2797b req-d9d448c9-4b0f-4388-af4d-851cba8c0ad7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.637701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5bc29546-b066-4d6f-926d-8c9021f2797b req-d9d448c9-4b0f-4388-af4d-851cba8c0ad7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.674067 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5bc29546-b066-4d6f-926d-8c9021f2797b req-d9d448c9-4b0f-4388-af4d-851cba8c0ad7 service nova] Creating event network-vif-plugged:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:43:29.685034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5bc29546-b066-4d6f-926d-8c9021f2797b req-d9d448c9-4b0f-4388-af4d-851cba8c0ad7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074081 Jul 19 19:43:29.685660 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 520/1048] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:29.695758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:29.699137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a1be329-2def-4492-8a92-060731cf58e4 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef7aea60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:29.724120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b990ecc6-e006-4b72-aeb9-9eff4427941c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1529 microversion: 2.1 time: 0.456009 Jul 19 19:43:29.729899 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 529/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:29 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1529 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:29.749564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:29.753596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:29.773773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.779045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:29.784684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:29.785870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:30.242997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a1be329-2def-4492-8a92-060731cf58e4 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/d0c4a6aa-1316-450e-8b76-293c6f9307df" status: 202 len: 0 microversion: 2.1 time: 0.553064 Jul 19 19:43:30.244116 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 521/1050] 10.222.0.23 () {58 vars in 1286 bytes} [Tue Jul 19 19:43:29 2022] DELETE /compute/v2.1/os-security-group-rules/d0c4a6aa-1316-450e-8b76-293c6f9307df => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:30.258087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:30.259041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:30.272005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:30.272643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:30.275343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:30.275792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:30.440053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:30.453749 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-221374f1-4458-4b44-babb-7bfe1064b1ac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.721885 Jul 19 19:43:30.454345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 530/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:29 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:30.474955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3cc24a7-5bdc-42c3-bf11-fe591d9132fb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:30.476904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3cc24a7-5bdc-42c3-bf11-fe591d9132fb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:30.588953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a3cc24a7-5bdc-42c3-bf11-fe591d9132fb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:30.596655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3cc24a7-5bdc-42c3-bf11-fe591d9132fb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1217 microversion: 2.1 time: 0.130523 Jul 19 19:43:30.603237 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 531/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:30 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:30.608169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b05d2b8b-ea09-482d-80e0-de27e9767094 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef9949d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:30.699701 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b05d2b8b-ea09-482d-80e0-de27e9767094 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.094529 Jul 19 19:43:30.700868 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 532/1053] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:30 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:30.710898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b13c73f-1702-44f2-9df4-bf1e3c92cacd tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:30.721951 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:43:30.721951 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:43:30.729755 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7b13c73f-1702-44f2-9df4-bf1e3c92cacd tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] HTTP exception thrown: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b13c73f-1702-44f2-9df4-bf1e3c92cacd tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Request method failure captured: Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/flavors/7a52ef57-f368-4e08-af4c-f60a7ee57ad4 HTTP/1.1 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whrhPcHy5jZ5HkGQx58sv9ydmf9BFuJQCITMaqC5eFIPQa-w1VV7sXzuOtTbgnmgln-PIxhe4uQm8aR8IFxSvIh8M2UfVLV9AfXQUFlO0sBwaFpt_PUFgUtEnbwCetezN-cf9tmVlSHKI4kyLQjua75qjiKfvKKDNKHFLQpN61z6Ok Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: b79a79c2b88d4f4d80826bdd0df205c2 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MigrationsAdminTest-659395114 Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:43:30.740338 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79a79c2b88d4f4d80826bdd0df205c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79a79c2b88d4f4d80826bdd0df205c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79a79c2b88d4f4d80826bdd0df205c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79a79c2b88d4f4d80826bdd0df205c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MigrationsAdminTest-659395114 Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: b79a79c2b88d4f4d80826bdd0df205c2 Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MigrationsAdminTest-659395114 Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MigrationsAdminTest-659395114-project-admin Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 5af05fbd4f98465ba488d5fc95359327 Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MigrationsAdminTest-659395114-project-admin Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. Jul 19 19:43:30.741792 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7a52ef57-f368-4e08-af4c-f60a7ee57ad4'} Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:30.742599 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. Jul 19 19:43:30.743880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:30.746655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b13c73f-1702-44f2-9df4-bf1e3c92cacd tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Returning 404 to user: Flavor 7a52ef57-f368-4e08-af4c-f60a7ee57ad4 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:30.747803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b13c73f-1702-44f2-9df4-bf1e3c92cacd tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/7a52ef57-f368-4e08-af4c-f60a7ee57ad4" status: 404 len: 109 microversion: 2.1 time: 0.045856 Jul 19 19:43:30.752925 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 533/1054] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:30 2022] DELETE /compute/v2.1/flavors/7a52ef57-f368-4e08-af4c-f60a7ee57ad4 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:30.769249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f09fc898-454c-49bc-a19a-deb89ab02837 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23efcf15e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-681329396", "description": "tempest-description-688886582"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:31.014043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:31.038260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:31.040212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:31.041644 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3a2bb6c-4e03-4366-bdc7-8571d6b58fb9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.796202 Jul 19 19:43:31.042426 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 522/1055] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:30 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:31.047164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1859891307", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:31.139273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:43:31.322087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f09fc898-454c-49bc-a19a-deb89ab02837 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.567771 Jul 19 19:43:31.322726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 534/1056] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:31.336575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-287e8458-b2fc-4b8f-b3b3-1612f60f06b7 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef85d550>, body: {"security_group_rule": {"parent_group_id": "d041f5b3-94e1-4daf-a587-1547346aa2c6", "ip_protocol": "tcp", "from_port": 1907990750, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:31.789155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-287e8458-b2fc-4b8f-b3b3-1612f60f06b7 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Invalid port range 1907990750:22. Former value cannot be greater than the later Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-287e8458-b2fc-4b8f-b3b3-1612f60f06b7 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 146 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:31.791940 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "d041f5b3-94e1-4daf-a587-1547346aa2c6", "ip_protocol": "tcp", "from_port": 1907990750, "to_port": 22}} Jul 19 19:43:31.793319 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid port range 1907990750:22. Former value cannot be greater than the later Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd041f5b3-94e1-4daf-a587-1547346aa2c6', 'ip_protocol': 'tcp', 'from_port': 1907990750, 'to_port': 22}}} Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1907990750:22. Former value cannot be greater than the later Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:31.794119 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1907990750:22. Former value cannot be greater than the later Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1907990750:22. Former value cannot be greater than the later Jul 19 19:43:31.796522 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:31.799778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-287e8458-b2fc-4b8f-b3b3-1612f60f06b7 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: Invalid port range 1907990750:22. Former value cannot be greater than the later {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:31.800806 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-287e8458-b2fc-4b8f-b3b3-1612f60f06b7 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.470422 Jul 19 19:43:31.804357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:43:31.805106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:43:31.805820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:43:31.806456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:43:31.807136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:43:31.820337 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 535/1057] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:31 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:43:31.826457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:31.827342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:31.831664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:31.834528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:31.836925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:31.837146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:31.837608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:31.837960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:31.839115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:31.840367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:31.879095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:31.909465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Getting quotas for user f2e7f9d9c6ab4b20aa20b98a514bf701 and project b1325aa577da423abdfc6ef7f1d6995d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:31.933680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:43:31.936541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:43:32.005746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40587861-ceb8-4dc7-a653-4f82746f8d12 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957146 Jul 19 19:43:32.006669 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 523/1058] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:43:32.014049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.018885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:32.030766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.034496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.035541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.036218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.369853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:32.377643 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad0df3bb-a4ba-408e-ad6f-07b95a10a0f1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1275 microversion: 2.1 time: 0.369765 Jul 19 19:43:32.378284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 524/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:32.635719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6cd1224a-8609-44ec-907d-f5c65b77c339 tempest-InstanceUsageAuditLogTestJSON-2129772499 tempest-InstanceUsageAuditLogTestJSON-2129772499-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.636608 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:43:32.636608 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:43:32.681970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6cd1224a-8609-44ec-907d-f5c65b77c339 tempest-InstanceUsageAuditLogTestJSON-2129772499 tempest-InstanceUsageAuditLogTestJSON-2129772499-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 19:43:31" status: 200 len: 318 microversion: 2.1 time: 0.288103 Jul 19 19:43:32.682897 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 525/1060] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2019%3A43%3A31 => generated 318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:32.694776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2e35592-527a-4d7c-b969-d1ce196c74a8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef6c5dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.754830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:32.764676 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bcb5b4c-112b-42b6-8eb3-35ee34db4d2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.943170 Jul 19 19:43:32.765255 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 536/1061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:31 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:32.769764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2e7b4f2-0ce6-4f6a-addb-4cf5ce8ded2c tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef865820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1819015809", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:32.771487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f2e7b4f2-0ce6-4f6a-addb-4cf5ce8ded2c tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Security group id should be uuid Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2e7b4f2-0ce6-4f6a-addb-4cf5ce8ded2c tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 131 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:32.784798 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1819015809", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:32.786530 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group id should be uuid Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1819015809', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:32.787531 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 19 19:43:32.788954 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:32.791167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2e7b4f2-0ce6-4f6a-addb-4cf5ce8ded2c tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: Security group id should be uuid {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:32.792216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2e7b4f2-0ce6-4f6a-addb-4cf5ce8ded2c tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026055 Jul 19 19:43:32.792978 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 537/1062] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:32 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:43:32.799105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.800185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:32.807290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.808054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.809309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.809950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.837306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2e35592-527a-4d7c-b969-d1ce196c74a8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.153206 Jul 19 19:43:32.848671 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 526/1063] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:32.854377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.855029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:32.877599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.878077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.878931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:32.879598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:32.935219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:32.949521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83c905d5-5e9e-438f-8675-f2f45ee4d959 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1209 microversion: 2.1 time: 0.155284 Jul 19 19:43:32.950420 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 538/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:32.955532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8978f844-7326-4603-8c6b-8c75eca628e8 tempest-InstanceUsageAuditLogTestJSON-2129772499 tempest-InstanceUsageAuditLogTestJSON-2129772499-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:32.956722 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:43:32.956722 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:43:32.983799 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8978f844-7326-4603-8c6b-8c75eca628e8 tempest-InstanceUsageAuditLogTestJSON-2129772499 tempest-InstanceUsageAuditLogTestJSON-2129772499-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030846 Jul 19 19:43:32.984779 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 539/1065] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:33.004279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83af716f-7e15-4114-82c4-e7f147739a76 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef8653a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-363669958", "description": "tempest-description-758545265"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:33.277261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:33.291935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:33.295974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:33.299476 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34ff6101-b7f8-4624-99e7-82d428cf88d8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.449031 Jul 19 19:43:33.301028 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 527/1066] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:32 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:33.406076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:33.407878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:33.430118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:33.430678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:33.431791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:33.436689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:33.766022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:33.791760 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3f0598ac-8121-4528-974a-cfc2f79c2e68 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1275 microversion: 2.1 time: 0.399931 Jul 19 19:43:33.792836 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 528/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:33 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1275 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:33.797658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6805d5bb-3b27-4a4e-a046-58892930df05 req-6c55771e-0eac-42ef-b618-0b1dc2360b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0878399-e196-44f3-9c32-1be87e6b03de", "tag": "e9b54df8-8756-41a6-9e1a-059541193fe8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:33.809005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6805d5bb-3b27-4a4e-a046-58892930df05 req-6c55771e-0eac-42ef-b618-0b1dc2360b90 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:33.811151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6805d5bb-3b27-4a4e-a046-58892930df05 req-6c55771e-0eac-42ef-b618-0b1dc2360b90 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:33.826366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6805d5bb-3b27-4a4e-a046-58892930df05 req-6c55771e-0eac-42ef-b618-0b1dc2360b90 service nova] Creating event network-changed:e9b54df8-8756-41a6-9e1a-059541193fe8 for instance b0878399-e196-44f3-9c32-1be87e6b03de on n-h1-843834-3 Jul 19 19:43:33.832663 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6805d5bb-3b27-4a4e-a046-58892930df05 req-6c55771e-0eac-42ef-b618-0b1dc2360b90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038262 Jul 19 19:43:33.833820 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 529/1068] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:33.839441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:33.840409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:33.850509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:33.851265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:33.852910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:33.853557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:33.854801 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83af716f-7e15-4114-82c4-e7f147739a76 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.868919 Jul 19 19:43:33.855524 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 540/1069] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:33.860920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3193ff2-b67c-4cc9-ad20-a36495cc50c6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef85dca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:33.948056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3193ff2-b67c-4cc9-ad20-a36495cc50c6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.091383 Jul 19 19:43:33.956677 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 541/1070] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:33 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:33.972053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2d42836-985f-4c3e-bd09-9bcaab0d46f2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef865ca0>, body: {"security_group_rule": {"parent_group_id": "fd17e23c-6204-43cb-872e-e8a1dea3232d", "ip_protocol": "tempest-999-1704619102", "from_port": 22, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:34.102450 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f2d42836-985f-4c3e-bd09-9bcaab0d46f2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Invalid IP protocol tempest-999-1704619102. Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2d42836-985f-4c3e-bd09-9bcaab0d46f2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 157 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:34.117258 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "fd17e23c-6204-43cb-872e-e8a1dea3232d", "ip_protocol": "tempest-999-1704619102", "from_port": 22, "to_port": 22}} Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:34.119410 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid IP protocol tempest-999-1704619102. Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fd17e23c-6204-43cb-872e-e8a1dea3232d', 'ip_protocol': 'tempest-999-1704619102', 'from_port': 22, 'to_port': 22}}} Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1704619102. Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:34.120464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1704619102. Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1704619102. Jul 19 19:43:34.121906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:34.128814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2d42836-985f-4c3e-bd09-9bcaab0d46f2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: Invalid IP protocol tempest-999-1704619102. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:34.132433 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2d42836-985f-4c3e-bd09-9bcaab0d46f2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.174622 Jul 19 19:43:34.134151 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 542/1071] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:33 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:43:34.148568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:34.151289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:34.168464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:34.169601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:34.178468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:34.180449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:34.352433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:34.362174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:34.371495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d49d3dd2-21a1-450f-b4bf-1b5ada21f77d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1271 microversion: 2.1 time: 0.232975 Jul 19 19:43:34.383279 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 543/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:34 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:34.390420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b94e9897-7a9a-470e-a7de-6e2ff614b0a2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef966a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-991974979", "description": "tempest-description-1648392122"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:34.416143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:34.425262 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09a7e0af-8c19-49f8-a933-9895ae0a49f6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.589543 Jul 19 19:43:34.435387 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 530/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:33 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:34.441016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:34.441907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:34.449202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:34.449834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:34.451023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:34.451961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:34.475134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:35.196717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:35.207809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:35.219571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:35.222616 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd482396-d51f-4a73-a002-404ba5827bf0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.785571 Jul 19 19:43:35.238051 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 531/1074] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:34 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:35.243343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:35.248720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:35.261027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.261476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.262277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.267936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.504683 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b94e9897-7a9a-470e-a7de-6e2ff614b0a2 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.119809 Jul 19 19:43:35.509816 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 544/1075] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:35.518418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cbd2ef6e-ef9b-4c43-ae38-5be2df4f0981 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef849550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:35.601290 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cbd2ef6e-ef9b-4c43-ae38-5be2df4f0981 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.089881 Jul 19 19:43:35.602402 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 545/1076] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:35 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:35.607649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:35.609397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:35.622026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.622940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.623935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.625496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.729926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:35.746665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ee439b9-5c8a-4bba-ad93-8b95d05fb018 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.506385 Jul 19 19:43:35.747680 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 532/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:35 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:35.754722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:35.768297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:35.769386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:35.774091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e68cae1-c307-48fc-9a95-741fbdd068aa tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1271 microversion: 2.1 time: 0.170059 Jul 19 19:43:35.774974 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 546/1078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:35 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:35.789664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.790161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.790997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:35.791462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:35.797998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14de078c-a89c-4619-91f9-f012c8a256d8 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef966a60>, body: {"security_group_rule": {"parent_group_id": "269a4c4c-11f2-48ee-8fe4-d51819054b0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:36.404425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-14de078c-a89c-4619-91f9-f012c8a256d8 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14de078c-a89c-4619-91f9-f012c8a256d8 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 138 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:36.405978 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "269a4c4c-11f2-48ee-8fe4-d51819054b0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 19 19:43:36.407692 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': '269a4c4c-11f2-48ee-8fe4-d51819054b0f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:36.408876 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 19:43:36.410245 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:36.412280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14de078c-a89c-4619-91f9-f012c8a256d8 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:36.412280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14de078c-a89c-4619-91f9-f012c8a256d8 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.622398 Jul 19 19:43:36.412280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 547/1079] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:35 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 633 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:43:36.416464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:36.419632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:36.436123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:36.436841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:36.438989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:36.446450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:36.797003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:36.808781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7137d18c-6cd3-463d-9df4-0dc3ea7d718c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 1.058903 Jul 19 19:43:36.809378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 533/1080] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:35 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:36.827101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73bb038c-e6f8-41f0-8a50-7e6a39994c92 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef79d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-532375143", "description": "tempest-description-824410479"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:37.156085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:37.175725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:37.181709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:37.183201 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d2d3628-85f4-4557-a9ed-da8dd9c6a4bd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.773939 Jul 19 19:43:37.184309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 548/1081] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:36 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:37.198578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce5a06f6-791d-40b0-9947-efc9281972a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef85d280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:37.264339 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce5a06f6-791d-40b0-9947-efc9281972a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.076186 Jul 19 19:43:37.271552 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 549/1082] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:37 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:37.276723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:37.277550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:37.285244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:37.286067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:37.287049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:37.287829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:37.615516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73bb038c-e6f8-41f0-8a50-7e6a39994c92 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.795367 Jul 19 19:43:37.616683 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 534/1083] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:43:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:37.626651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:37.627538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:37.638551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:37.639050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:37.639848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:37.640291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:37.814676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:37.827277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bc4b1d6-a3b8-444e-9ed8-7d5b7c3a70c1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.554174 Jul 19 19:43:37.840477 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 550/1084] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:37 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:37.854124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69f68ae2-38e6-47f0-a2cc-f81e16499bc3 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef865160>, body: {"security_group_rule": {"parent_group_id": "fcb45d39-1748-41e1-b968-a575310316e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 432632583}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:38.103522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:38.123643 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a6cca2d1-0f8d-40ac-bd84-dec4e217edbc tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.505624 Jul 19 19:43:38.134239 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 535/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:37 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:38.139430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:38.140228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:38.149267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:38.149947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:38.151113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:38.151768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:38.411313 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-69f68ae2-38e6-47f0-a2cc-f81e16499bc3 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69f68ae2-38e6-47f0-a2cc-f81e16499bc3 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 145 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:38.413758 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "fcb45d39-1748-41e1-b968-a575310316e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 432632583}} Jul 19 19:43:38.415415 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fcb45d39-1748-41e1-b968-a575310316e0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 432632583}}} Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:38.416347 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 Jul 19 19:43:38.417740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:38.420218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69f68ae2-38e6-47f0-a2cc-f81e16499bc3 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 400 to user: Invalid port range 22:432632583. Valid TCP ports should be between 1-65535 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:38.421287 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-69f68ae2-38e6-47f0-a2cc-f81e16499bc3 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.579571 Jul 19 19:43:38.422108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 551/1086] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:37 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 581 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:43:38.430809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:38.433580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:38.452297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:38.453942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:38.456291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:38.457006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:39.099506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:39.121889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:39.124047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:39.125457 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67442d72-d86a-4234-b666-e6ee84b940fb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.702098 Jul 19 19:43:39.126043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 552/1087] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:38 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:39.141677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bbbdbc49-b532-4e04-bc04-6b6e9f12ca62 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef80b280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:39.206315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bbbdbc49-b532-4e04-bc04-6b6e9f12ca62 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.068759 Jul 19 19:43:39.207330 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 553/1088] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:39 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:39.211772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:39.220395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Action: 'create', calling method: .version_select at 0x7f23ef80b040>, body: {"security_group_rule": {"parent_group_id": "4ef737c1-2af5-4efd-9e64-aa11c628b203", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:39.241816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7fa8565-26dc-4aa6-951a-b8fbd39b89a7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 1.106013 Jul 19 19:43:39.242866 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 536/1089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:38 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:39.268528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:39.274730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:39.285721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:39.286811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:39.287957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:39.289043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:39.293763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:43:39.294479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.security_group_api [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Neutron security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 not found {{(pid=131229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:43:39.295149 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.295149 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 138 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:43:39.297985 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: {"security_group_rule": {"parent_group_id": "4ef737c1-2af5-4efd-9e64-aa11c628b203", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 19:43:39.299529 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ef737c1-2af5-4efd-9e64-aa11c628b203', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:43:39.300418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 19 19:43:39.301795 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.303181 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] Jul 19 19:43:39.304637 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:43:39.306289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 404 to user: Security group 4ef737c1-2af5-4efd-9e64-aa11c628b203 does not exist Jul 19 19:43:39.306289 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-2107ffc9-d8ea-4d86-a035-65b46afe7737'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:39.307531 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44efca9b-ae21-4efc-ad77-3560be8630fb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.098963 Jul 19 19:43:39.308311 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 554/1090] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:43:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:39.324643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2369e17c-aaaa-488b-97ff-07bcedd3ce06 req-1c62c8ec-28a9-4546-9f57-afc4048c170b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4442c-6871-400e-9654-315913202748", "name": "network-vif-unplugged", "status": "completed", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:39.355944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2369e17c-aaaa-488b-97ff-07bcedd3ce06 req-1c62c8ec-28a9-4546-9f57-afc4048c170b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:39.356734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2369e17c-aaaa-488b-97ff-07bcedd3ce06 req-1c62c8ec-28a9-4546-9f57-afc4048c170b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:39.374280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2369e17c-aaaa-488b-97ff-07bcedd3ce06 req-1c62c8ec-28a9-4546-9f57-afc4048c170b service nova] Creating event network-vif-unplugged:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:43:39.380324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2369e17c-aaaa-488b-97ff-07bcedd3ce06 req-1c62c8ec-28a9-4546-9f57-afc4048c170b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070520 Jul 19 19:43:39.381890 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 555/1091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:39.387466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:39.388516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:39.398191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:39.399200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:39.400232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:39.401552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.083941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:40.096628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2281df85-47e6-492c-bc1c-217e434befaf tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.852019 Jul 19 19:43:40.107688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 537/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:39 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:40.114060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef722820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:40.178468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:40.188701 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a39562e-5b4c-4924-ab09-de30022ad8df tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.803493 Jul 19 19:43:40.201060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 556/1093] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:39 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:40.206311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e7d87f86-8f22-45a4-a2b7-663fece3229f req-9cc465e9-c744-4b10-9d31-c0236bf9890a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2", "tag": "f8430797-91ea-45c3-9097-9ebc5a3a9040"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:40.218648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e7d87f86-8f22-45a4-a2b7-663fece3229f req-9cc465e9-c744-4b10-9d31-c0236bf9890a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:40.219420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e7d87f86-8f22-45a4-a2b7-663fece3229f req-9cc465e9-c744-4b10-9d31-c0236bf9890a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.236254 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e7d87f86-8f22-45a4-a2b7-663fece3229f req-9cc465e9-c744-4b10-9d31-c0236bf9890a service nova] Creating event network-changed:f8430797-91ea-45c3-9097-9ebc5a3a9040 for instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 on n-h2-843834-3 Jul 19 19:43:40.242526 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e7d87f86-8f22-45a4-a2b7-663fece3229f req-9cc465e9-c744-4b10-9d31-c0236bf9890a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039824 Jul 19 19:43:40.243504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 557/1094] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:40.249497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:40.250536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:40.260710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:40.262381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.263555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:40.264203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.335241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:43:40.335849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Neutron security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 not found {{(pid=131230) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 19 19:43:40.336580 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] HTTP exception thrown: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.336580 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Request method failure captured: Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-group-rules/f58c01ba-61ac-48d8-959e-70c7590abb36 HTTP/1.1 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlde6oHZKQXu58OXJL1m1Yfjzf3j6HuRKLQqnc_tQhKIzzCOVr2ilRXk7CnUH_9w17A_NPMZJMrfghmYQjItVrLtJOX32qeoD5qJVteFjh_jR1izIrKkFaYGwBZ2mZkl30UQEi9yiAlN4V4hLBkRy0dJuENiwt2ii28Q_j1gQWArzk Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:43:40.339498 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51f4264541403f8de49f50b5d23f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ca51f4264541403f8de49f50b5d23f23 Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543 Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3e42f39357fc4817bc44087b5e6c3a04 Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-543669543-project Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.340849 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'f58c01ba-61ac-48d8-959e-70c7590abb36'} Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:40.341751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 19 19:43:40.342886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.344018 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] Jul 19 19:43:40.345286 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:43:40.348621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Returning 404 to user: Security group rule f58c01ba-61ac-48d8-959e-70c7590abb36 does not exist Jul 19 19:43:40.348621 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6a3eafad-fb32-472d-a1ea-28eecdb7ca85'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:43:40.350285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fa8d4e4-770f-4d85-82fe-7c88ed8c9c43 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/f58c01ba-61ac-48d8-959e-70c7590abb36" status: 404 len: 199 microversion: 2.1 time: 0.249542 Jul 19 19:43:40.351397 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 538/1095] 10.222.0.23 () {58 vars in 1286 bytes} [Tue Jul 19 19:43:40 2022] DELETE /compute/v2.1/os-security-group-rules/f58c01ba-61ac-48d8-959e-70c7590abb36 => generated 199 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:43:40.356604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ea218c5-d13f-4aa4-8e33-698fe39c9a41 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef71aca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:40.424037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ea218c5-d13f-4aa4-8e33-698fe39c9a41 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1411 microversion: 2.1 time: 0.071105 Jul 19 19:43:40.424638 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 539/1096] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:40 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:40.463223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:40.465992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:40.483568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:40.485589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.488490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:40.491005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:40.857073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:40.895113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:40.896648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:40.897868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2c0a891-de0b-4802-8feb-fa9e23293c44 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.652783 Jul 19 19:43:40.903698 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 558/1097] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:40 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:40.911698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db794bc8-853b-43d9-b7e2-f503763327ba tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef80baf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:41.149141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:41.156930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f604f63-0662-4626-ae0d-87d85aac11b3 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.729578 Jul 19 19:43:41.166666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 540/1098] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:40 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:41.171974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:41.172591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:41.179809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:41.180261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:41.181046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:41.181482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:41.499494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:41.513568 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c10ba085-510b-4040-830e-ad46e4ee3204 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.345493 Jul 19 19:43:41.515427 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 541/1099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:41 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:41.527257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:41.529241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:41.547457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:41.548711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:41.551567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:41.552177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:41.584897 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db794bc8-853b-43d9-b7e2-f503763327ba tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fcb45d39-1748-41e1-b968-a575310316e0" status: 202 len: 0 microversion: 2.1 time: 0.679737 Jul 19 19:43:41.586153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 559/1100] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:43:40 2022] DELETE /compute/v2.1/os-security-groups/fcb45d39-1748-41e1-b968-a575310316e0 => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:41.590969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-606739ab-dc2d-4fd3-9da2-69a5241e4775 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef8f24c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:41.666179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-606739ab-dc2d-4fd3-9da2-69a5241e4775 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1420 microversion: 2.1 time: 0.073148 Jul 19 19:43:41.666955 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 560/1101] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:41 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:41.673055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-47d45f48-5099-4271-b07a-3de9028d2aeb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23fc0c5b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:41.862246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:42.185823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:42.201954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ae93fac-8344-44db-a0c6-b7e639fec8be tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.684911 Jul 19 19:43:42.203503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 542/1102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:41 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:42.217659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3322a71d-cce6-4314-aca3-774f973999f4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef72db80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:42.282116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3322a71d-cce6-4314-aca3-774f973999f4 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 200 len: 1420 microversion: 2.1 time: 0.077130 Jul 19 19:43:42.283163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 543/1103] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:43:42 2022] GET /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:42.287943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b8883330-c9aa-4d82-8fa3-92c799cedd68 req-51f1fc70-9202-44cd-ad83-88e2a2a8e4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a4442c-6871-400e-9654-315913202748", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:42.305375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8883330-c9aa-4d82-8fa3-92c799cedd68 req-51f1fc70-9202-44cd-ad83-88e2a2a8e4de service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.306732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8883330-c9aa-4d82-8fa3-92c799cedd68 req-51f1fc70-9202-44cd-ad83-88e2a2a8e4de service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:42.327873 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b8883330-c9aa-4d82-8fa3-92c799cedd68 req-51f1fc70-9202-44cd-ad83-88e2a2a8e4de service nova] Creating event network-changed:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:43:42.335546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b8883330-c9aa-4d82-8fa3-92c799cedd68 req-51f1fc70-9202-44cd-ad83-88e2a2a8e4de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050333 Jul 19 19:43:42.336473 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 544/1104] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:42.347568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:42.348495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:42.358114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.358853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:42.359897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.360655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:42.511481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-47d45f48-5099-4271-b07a-3de9028d2aeb tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/269a4c4c-11f2-48ee-8fe4-d51819054b0f" status: 202 len: 0 microversion: 2.1 time: 0.842881 Jul 19 19:43:42.512572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 561/1105] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:43:41 2022] DELETE /compute/v2.1/os-security-groups/269a4c4c-11f2-48ee-8fe4-d51819054b0f => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:42.518047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:42.518837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:42.535167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:42.537083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.542486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:42.543943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.544544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:42.673323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=18 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:42.893067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:42.932997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:42.937608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:42.947977 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c0e9406-77ef-4e49-ae90-fa1e41715a92 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.601285 Jul 19 19:43:42.948723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 545/1106] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:42 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:42.958821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a4dc5bf1-7162-484b-837d-d04c7c9a88b7 req-59256850-6e84-4f5d-958c-875089c7c79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:42.977389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:42.987584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a4dc5bf1-7162-484b-837d-d04c7c9a88b7 req-59256850-6e84-4f5d-958c-875089c7c79b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:42.988282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a4dc5bf1-7162-484b-837d-d04c7c9a88b7 req-59256850-6e84-4f5d-958c-875089c7c79b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:43.006979 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a4dc5bf1-7162-484b-837d-d04c7c9a88b7 req-59256850-6e84-4f5d-958c-875089c7c79b service nova] Creating event network-changed:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:43:43.037559 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a4dc5bf1-7162-484b-837d-d04c7c9a88b7 req-59256850-6e84-4f5d-958c-875089c7c79b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087637 Jul 19 19:43:43.038749 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 546/1107] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:43.050238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b8bf7fa-0098-4a11-b935-3522c8e2943a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef597040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:43.217869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:43.232837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-314ebe47-3181-4996-a79b-e2d9870d6513 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.718056 Jul 19 19:43:43.242029 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 562/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:42 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:43.242029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdbae24c-79e9-4ab7-8699-324578abd144 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef80b790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:43.886462 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdbae24c-79e9-4ab7-8699-324578abd144 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fd17e23c-6204-43cb-872e-e8a1dea3232d" status: 202 len: 0 microversion: 2.1 time: 0.651349 Jul 19 19:43:43.887242 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 563/1109] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:43:43 2022] DELETE /compute/v2.1/os-security-groups/fd17e23c-6204-43cb-872e-e8a1dea3232d => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:43.895356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:43.896261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:43.908323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:43.909897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:43.911155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:43.913855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:43.998327 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b8bf7fa-0098-4a11-b935-3522c8e2943a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 204 len: 0 microversion: 2.1 time: 0.954949 Jul 19 19:43:43.999812 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 547/1110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:43 2022] DELETE /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:44.009258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:44.010083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:44.036027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:44.038372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:44.040629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:44.041751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:44.359726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:44.386017 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9982525d-dc2e-4023-a50b-5453459aba2e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.493047 Jul 19 19:43:44.388884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 564/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:43 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:44.427201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba3543b6-7037-4d46-8dca-c40d5e39c420 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef8df1f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:44.495533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:44.505931 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-302bf410-048a-42ac-afd9-d7e032affd01 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.499487 Jul 19 19:43:44.513819 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 548/1112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:44 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:44.527548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:44.528160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:44.537545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:44.538008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:44.538785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:44.539264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.021245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:45.034258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:45.035808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:45.037021 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5dbe214e-e819-494e-8119-83216a4674bb tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.521628 Jul 19 19:43:45.051329 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 549/1113] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:44 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:45.057631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:45.058296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:45.064741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:45.065801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.066794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:45.067454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.108624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:43:45.232904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-814bac95-57a5-4824-b2a4-4b823d7b0030 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 204 len: 0 microversion: 2.1 time: 0.179236 Jul 19 19:43:45.234982 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 550/1114] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:43:45 2022] DELETE /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:43:45.247952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:45.249035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:45.264749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:45.266787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.274948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:45.275851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.381763 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba3543b6-7037-4d46-8dca-c40d5e39c420 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d041f5b3-94e1-4daf-a587-1547346aa2c6" status: 202 len: 0 microversion: 2.1 time: 0.990740 Jul 19 19:43:45.382437 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 565/1115] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:43:44 2022] DELETE /compute/v2.1/os-security-groups/d041f5b3-94e1-4daf-a587-1547346aa2c6 => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:45.387904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f59a59d4-2d4f-46f6-ba6b-19e2b5a51cb3 req-107cbb4a-65de-43d0-8afb-ff0150abb506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0878399-e196-44f3-9c32-1be87e6b03de", "name": "network-vif-plugged", "status": "completed", "tag": "e9b54df8-8756-41a6-9e1a-059541193fe8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:45.421096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f59a59d4-2d4f-46f6-ba6b-19e2b5a51cb3 req-107cbb4a-65de-43d0-8afb-ff0150abb506 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:45.421583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f59a59d4-2d4f-46f6-ba6b-19e2b5a51cb3 req-107cbb4a-65de-43d0-8afb-ff0150abb506 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:45.462261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f59a59d4-2d4f-46f6-ba6b-19e2b5a51cb3 req-107cbb4a-65de-43d0-8afb-ff0150abb506 service nova] Creating event network-vif-plugged:e9b54df8-8756-41a6-9e1a-059541193fe8 for instance b0878399-e196-44f3-9c32-1be87e6b03de on n-h1-843834-3 Jul 19 19:43:45.500061 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f59a59d4-2d4f-46f6-ba6b-19e2b5a51cb3 req-107cbb4a-65de-43d0-8afb-ff0150abb506 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116004 Jul 19 19:43:45.504592 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 566/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:45.526311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3163414-8a77-4cfc-a670-8f7cda79ff53 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] Calling method '.version_select at 0x7f23ef966af0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:46.221611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:46.231924 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-94bd5460-11b4-426b-b02c-a32a47ddc763 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.992797 Jul 19 19:43:46.235179 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 551/1117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:45 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:46.247759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:46.248632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:46.257012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.257996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:46.258987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.259583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:46.496191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:46.503632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:46.510055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81bef132-1ba6-47e0-92c2-b952334d256d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.273397 Jul 19 19:43:46.511364 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 552/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:46 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:46.527880 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3163414-8a77-4cfc-a670-8f7cda79ff53 tempest-SecurityGroupRulesNegativeTestJSON-543669543 tempest-SecurityGroupRulesNegativeTestJSON-543669543-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6211302c-8f4f-4dfc-9147-6473c1961e9d" status: 202 len: 0 microversion: 2.1 time: 1.018324 Jul 19 19:43:46.528395 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 567/1119] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:43:45 2022] DELETE /compute/v2.1/os-security-groups/6211302c-8f4f-4dfc-9147-6473c1961e9d => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:46.529891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:46.533769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:46.533938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1930654310", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "45b415df-4896-4487-90b1-97e9e05cd7c2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:46.555828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.556305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:46.557123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.557565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:46.640137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] validate_networks() for [('45b415df-4896-4487-90b1-97e9e05cd7c2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:43:46.910880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:46.934166 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0afe17ef-0828-4bad-9260-02ed9c885ac8 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.421414 Jul 19 19:43:46.945334 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 553/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:46 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:46.969958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:46.975233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:46.985452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.986275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:46.987289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:46.994461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.272414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:43:47.273198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:43:47.273912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:43:47.275294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:43:47.275763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:43:47.277491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:47.298905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:47.300523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:47.302168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ce8f09b-a163-4754-9ac1-90e07d27675b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.347812 Jul 19 19:43:47.303314 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 554/1121] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:46 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:47.308707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:47.317854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:47.326343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.327529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.330016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.331427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.335171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.336076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.338355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.339003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.376523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:43:47.394130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for user cf462f1353f342b395e856a1f3cbafb2 and project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:43:47.446655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:43:47.454468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:43:47.558568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-164730e3-399c-46e0-921b-ca1d66256e76 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028963 Jul 19 19:43:47.566880 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 568/1122] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:43:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:43:47.578386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:47.579110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:47.594475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.596274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.597296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:47.599477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:47.818677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:47.834778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40724803-70a5-42b6-b99a-88971a6f9bff tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1315 microversion: 2.1 time: 0.530034 Jul 19 19:43:47.851359 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 555/1123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:47 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:47.883178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af487b68-4727-4902-b977-a973420e2e25 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:47.883910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af487b68-4727-4902-b977-a973420e2e25 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:48.240336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af487b68-4727-4902-b977-a973420e2e25 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:48.250188 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af487b68-4727-4902-b977-a973420e2e25 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1208 microversion: 2.1 time: 0.397609 Jul 19 19:43:48.251096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 556/1124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:47 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1208 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:48.270366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2e4dad88-e8ec-4fc4-849b-3828e1aeff8b req-064a4043-1b5d-48f5-bd61-8756adde306b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-plugged", "status": "completed", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:48.298638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e4dad88-e8ec-4fc4-849b-3828e1aeff8b req-064a4043-1b5d-48f5-bd61-8756adde306b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.302156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e4dad88-e8ec-4fc4-849b-3828e1aeff8b req-064a4043-1b5d-48f5-bd61-8756adde306b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.324738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2e4dad88-e8ec-4fc4-849b-3828e1aeff8b req-064a4043-1b5d-48f5-bd61-8756adde306b service nova] Creating event network-vif-plugged:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:43:48.330565 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2e4dad88-e8ec-4fc4-849b-3828e1aeff8b req-064a4043-1b5d-48f5-bd61-8756adde306b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068374 Jul 19 19:43:48.332086 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 557/1125] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:48.337700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:48.338742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:48.346961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.347846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.348637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.349254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.366434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:48.375256 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eabbbc95-efef-4870-99cf-5c75564d6243 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.806203 Jul 19 19:43:48.378727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 569/1126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:47 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:48.396560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:48.397339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:48.413070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.423910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:48.425183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:48.425882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.133044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.151674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-45803725-a6d8-4ca3-9a7c-a1ee9029645c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1313 microversion: 2.1 time: 0.818073 Jul 19 19:43:49.152627 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 558/1127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:48 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:49.165742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:49.170674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:49.187143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.189622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.192431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.193703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.301102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.308205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:49.313464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.315689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.317157 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c181469-e3cd-4114-b9e0-d639dc335dca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.937170 Jul 19 19:43:49.317895 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 570/1128] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:48 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:49.323418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3536169f-c0df-4836-94a0-0c2ba4ca9689 req-14449bbd-ae31-43a4-be3d-ea60506e2dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd", "name": "network-vif-deleted", "tag": "7f8ff442-d5ff-44bd-8530-4a6bd1170e3e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:49.340614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3536169f-c0df-4836-94a0-0c2ba4ca9689 req-14449bbd-ae31-43a4-be3d-ea60506e2dba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.341498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3536169f-c0df-4836-94a0-0c2ba4ca9689 req-14449bbd-ae31-43a4-be3d-ea60506e2dba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.373178 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3536169f-c0df-4836-94a0-0c2ba4ca9689 req-14449bbd-ae31-43a4-be3d-ea60506e2dba service nova] Creating event network-vif-deleted:7f8ff442-d5ff-44bd-8530-4a6bd1170e3e for instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd on n-h2-843834-3 Jul 19 19:43:49.392218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3536169f-c0df-4836-94a0-0c2ba4ca9689 req-14449bbd-ae31-43a4-be3d-ea60506e2dba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072757 Jul 19 19:43:49.392855 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 571/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:49.400472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:49.400921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:49.418683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.419178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.424598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.426713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.630101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.640738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90c221da-49fb-463d-adf0-f337d4c8926b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1502 microversion: 2.1 time: 0.486206 Jul 19 19:43:49.656360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 559/1130] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:49 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1502 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:49.665055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:49.679045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78cf94a0-d725-4175-bdba-9eb94f454c1c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1268 microversion: 2.1 time: 0.284007 Jul 19 19:43:49.682779 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 572/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:49 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:49.689149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1051162451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:49.689592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:49.690894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:49.695108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:49.703562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:49.713742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.716319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.719283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.720052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.721262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.722549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:49.727031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:49.731363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:50.594846 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Adding security group c60b8331-db4e-4bf3-884d-1525daedebf8 to port e9b54df8-8756-41a6-9e1a-059541193fe8 Jul 19 19:43:50.824990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:50.836229 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-50e7a5f8-d921-486e-95da-3dc576d7e109 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 1.176003 Jul 19 19:43:50.837691 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 560/1132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:49 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:50.842786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:50.843443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:50.874932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:50.889183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:50.891988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:50.892567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:51.357915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:51.377795 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cc9cdc2-297e-4f66-9b86-c3aa79ed85a3 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1462 microversion: 2.1 time: 0.538739 Jul 19 19:43:51.391747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 561/1133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:50 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1462 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:51.398290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:51.399320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:51.407711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:51.408541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:51.410388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:51.411166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:52.066545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:52.080115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:52.085829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:52.090014 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d09c262-af72-421c-b286-51f5b334d04f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.696721 Jul 19 19:43:52.093516 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 562/1134] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:51 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:52.108703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2", "name": "network-vif-plugged", "status": "completed", "tag": "f8430797-91ea-45c3-9097-9ebc5a3a9040"}, {"server_uuid": "c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd", "name": "network-vif-unplugged", "status": "completed", "tag": "7f8ff442-d5ff-44bd-8530-4a6bd1170e3e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:52.127384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:52.133491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:52.171501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] Creating event network-vif-plugged:f8430797-91ea-45c3-9097-9ebc5a3a9040 for instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 on n-h2-843834-3 Jul 19 19:43:52.173654 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] Creating event network-vif-unplugged:7f8ff442-d5ff-44bd-8530-4a6bd1170e3e for instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd on n-h2-843834-3 Jul 19 19:43:52.191901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-063dceb3-d482-446a-b992-75410e3ad22e req-dfa26e96-b5a1-46d3-bb59-33df60cb13ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.093955 Jul 19 19:43:52.193800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 563/1135] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:52.212177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:52.213726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:52.248504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:52.249927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:52.255711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:52.256522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:53.143641 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e15a69e-ddd2-40e4-8666-7346fbacf9fd tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/action" status: 202 len: 0 microversion: 2.1 time: 3.459452 Jul 19 19:43:53.145160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 573/1136] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:49 2022] POST /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/action => generated 0 bytes in 3461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:53.150183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:53.151070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:53.168704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:53.169454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:53.173026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:53.173740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:53.536524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:53.552067 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e7114d1-15ab-4f57-a86c-1aad8b45e218 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 1.355772 Jul 19 19:43:53.559145 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 564/1137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:52 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:53.564738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:53.568313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:53.580746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:53.583673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:53.584694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:53.585816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:54.079241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:54.094205 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-658a4f91-9a92-49c3-9f18-7610e042b135 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1317 microversion: 2.1 time: 0.532730 Jul 19 19:43:54.107049 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-52c009eb-5930-429b-9fef-357d8883bba2 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1613 microversion: 2.1 time: 0.957249 Jul 19 19:43:54.108423 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 574/1138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:53 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1613 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:54.109396 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 565/1139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:53 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:54.120509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:54.121398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:54.136308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:54.136942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:54.137887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:54.138645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:54.150780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-491596349"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:54.151498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:54.161404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:54.162396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:54.163500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:54.164151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:54.880291 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.network.security_group_api [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Adding security group ee854909-67db-4a91-9325-839e1ed29094 to port e9b54df8-8756-41a6-9e1a-059541193fe8 Jul 19 19:43:55.211397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:55.228668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:55.233509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:55.235338 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc2bc3c3-081c-437d-a40e-b24ef1f54ea2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 1.125428 Jul 19 19:43:55.237875 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 575/1140] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:54 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:55.243960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5b889202-3c5e-4ec6-aff7-f917ad0bf6a0 req-71730ccd-64be-4504-8c17-c38a846bfd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0878399-e196-44f3-9c32-1be87e6b03de", "tag": "e9b54df8-8756-41a6-9e1a-059541193fe8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:55.273649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5b889202-3c5e-4ec6-aff7-f917ad0bf6a0 req-71730ccd-64be-4504-8c17-c38a846bfd5c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:55.278991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5b889202-3c5e-4ec6-aff7-f917ad0bf6a0 req-71730ccd-64be-4504-8c17-c38a846bfd5c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:55.310451 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5b889202-3c5e-4ec6-aff7-f917ad0bf6a0 req-71730ccd-64be-4504-8c17-c38a846bfd5c service nova] Creating event network-changed:e9b54df8-8756-41a6-9e1a-059541193fe8 for instance b0878399-e196-44f3-9c32-1be87e6b03de on n-h1-843834-3 Jul 19 19:43:55.317243 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5b889202-3c5e-4ec6-aff7-f917ad0bf6a0 req-71730ccd-64be-4504-8c17-c38a846bfd5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077715 Jul 19 19:43:55.321971 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 576/1141] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:55.336460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:55.337157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:55.362126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:55.362590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:55.371087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:55.371558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:55.474319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5af05fbd4f98465ba488d5fc95359327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79a79c2b88d4f4d80826bdd0df205c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:55.475134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: e00c5f64-277f-4358-aace-889f5a135209] flavor_id is None. Assuming migration. {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 19:43:55.475687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: e00c5f64-277f-4358-aace-889f5a135209] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 19:43:56.190238 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b7b26f6-bf73-4eae-a526-1a8caccc04f0 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209/action" status: 202 len: 0 microversion: 2.1 time: 0.866632 Jul 19 19:43:56.191992 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 577/1142] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:55 2022] POST /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:56.204495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8edb8372-e633-4226-825b-6e494a1a5eeb req-cab29895-6171-4b9d-b2f0-e895cf80dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4442c-6871-400e-9654-315913202748", "name": "network-vif-unplugged", "status": "completed", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:56.233626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8edb8372-e633-4226-825b-6e494a1a5eeb req-cab29895-6171-4b9d-b2f0-e895cf80dc9a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:56.235486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8edb8372-e633-4226-825b-6e494a1a5eeb req-cab29895-6171-4b9d-b2f0-e895cf80dc9a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:56.264823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8edb8372-e633-4226-825b-6e494a1a5eeb req-cab29895-6171-4b9d-b2f0-e895cf80dc9a service nova] Creating event network-vif-unplugged:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h1-843834-3 Jul 19 19:43:56.278607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8edb8372-e633-4226-825b-6e494a1a5eeb req-cab29895-6171-4b9d-b2f0-e895cf80dc9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084647 Jul 19 19:43:56.279922 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 578/1143] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:56.287221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:56.288317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:56.301929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:56.302626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:56.303769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:56.304378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:57.073762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:57.089350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a4539605-6b48-4671-a54e-fabeed0b7d48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 0.807960 Jul 19 19:43:57.090600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 579/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:56 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:57.099824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:57.100761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:57.117559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:57.118247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:57.119240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:57.123509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:57.354260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:57.407522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:57.481956 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7d23ad6-3730-470c-99cf-6578c340aac0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/action" status: 202 len: 0 microversion: 2.1 time: 3.370766 Jul 19 19:43:57.484549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 566/1145] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:43:54 2022] POST /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/action => generated 0 bytes in 3374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:43:57.492862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:57.493676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:57.522123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:57.526671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:57.530440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:57.532104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:58.251572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:43:58.494623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:58.511612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3cee8714-aa5a-44b2-8b76-42598c9c4799 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1467 microversion: 2.1 time: 1.419560 Jul 19 19:43:58.514414 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 580/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:57 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1467 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:58.521867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:58.523162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:58.531565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:58.532539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:58.533916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:58.534963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:58.949731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:58.963411 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-420e0b19-b9b8-420e-be93-8b46305d2a7c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1471 microversion: 2.1 time: 1.476828 Jul 19 19:43:58.967650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 567/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:43:57 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1471 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:43:58.974150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22fc7209-5a58-4774-969b-cf8a4da8ce3e"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:58.981044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:59.005498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:59.006065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:59.006989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:59.007550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:59.218614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:59.228198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:59.229140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:43:59.230526 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-119bddef-d338-4ee6-b1af-2f173cbc7438 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1813 microversion: 2.25 time: 0.714228 Jul 19 19:43:59.243038 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 581/1148] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:43:58 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1813 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:43:59.500613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-563737388", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "fb087bda-9d04-4001-99de-3fb667d5f62c"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:43:59.579022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] validate_networks() for [('fb087bda-9d04-4001-99de-3fb667d5f62c', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:43:59.666498 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ca82691-bd4e-4e3d-a672-6d05f2f24c88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "POST /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696268 Jul 19 19:43:59.672696 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 568/1149] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 19:43:58 2022] POST /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:43:59.680011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:43:59.680947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:43:59.688408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:59.689227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:43:59.690148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:43:59.691070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.124926 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-857631e4-463d-42e3-bad4-446a566276b8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.450390 Jul 19 19:44:01.125591 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 569/1150] 10.222.0.23 () {58 vars in 1292 bytes} [Tue Jul 19 19:43:59 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de/os-security-groups => generated 1157 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:01.143674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-44fc7181-06f2-4ecb-93b4-b066d5208cff req-5cfaea43-7074-47eb-8a81-9078128648b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0878399-e196-44f3-9c32-1be87e6b03de", "tag": "e9b54df8-8756-41a6-9e1a-059541193fe8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:01.152852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-44fc7181-06f2-4ecb-93b4-b066d5208cff req-5cfaea43-7074-47eb-8a81-9078128648b1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.153302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-44fc7181-06f2-4ecb-93b4-b066d5208cff req-5cfaea43-7074-47eb-8a81-9078128648b1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.171204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-44fc7181-06f2-4ecb-93b4-b066d5208cff req-5cfaea43-7074-47eb-8a81-9078128648b1 service nova] Creating event network-changed:e9b54df8-8756-41a6-9e1a-059541193fe8 for instance b0878399-e196-44f3-9c32-1be87e6b03de on n-h1-843834-3 Jul 19 19:44:01.178056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-44fc7181-06f2-4ecb-93b4-b066d5208cff req-5cfaea43-7074-47eb-8a81-9078128648b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038711 Jul 19 19:44:01.178843 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 570/1151] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:01.187053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:01.188011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:01.219965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.220425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.221215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.221653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.538221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:44:01.538704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:44:01.539134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:44:01.539545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:44:01.539955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:44:01.554040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.558795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.560051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.560750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.604954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:44:01.618028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for user a15f9dbf22624cb49d4d817fed35e3b5 and project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:44:01.645434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:44:01.648241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:44:01.692549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:01.696615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:01.716840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c25e15f0-e5ef-4aee-b17a-917eeb373808 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 0.536163 Jul 19 19:44:01.717458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 571/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:01 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:01.732145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:01.732895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:01.760970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.761424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.762505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.762650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.787932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f75cc97-16cd-4029-b5f0-a4b2b918e81e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543477 Jul 19 19:44:01.814844 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 582/1153] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:44:01.837214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:01.848747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:01.876858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.877222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:01.878063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:01.878501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:02.395587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3bf4961f-418c-4266-aa55-8d8b0e843bf0 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1618 microversion: 2.1 time: 0.677030 Jul 19 19:44:02.403297 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 572/1154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:01 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1618 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:02.417551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:02.418419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:02.433777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:02.434212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:02.435373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:02.435507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:02.779687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:02.792216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b25a318-078b-446b-b5f6-c43664f17c78 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1471 microversion: 2.1 time: 0.972862 Jul 19 19:44:02.793477 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 583/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:01 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1471 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:02.808778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a879c35-2b96-42aa-a514-70a03d4376b9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef84d040>, body: {"security_group": {"name": " tempest-securitygroup -555539693 ", "description": "tempest-description-2008726171"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:03.236584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:03.254835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:03.260485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:03.267196 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d702dedf-26a9-44d3-988e-4f82b2d7e941 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1803 microversion: 2.25 time: 0.860757 Jul 19 19:44:03.271456 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 573/1156] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:02 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1803 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:03.283216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:03.284416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:03.301881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:03.302568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:03.309022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:03.309708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:03.319232 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a879c35-2b96-42aa-a514-70a03d4376b9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.523438 Jul 19 19:44:03.320599 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 584/1157] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:02 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:03.325672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-821990586", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f65301ea-31b5-4e24-a345-ad9c73259006"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:03.412715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:44:03.446255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:03.453998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-87416ec5-0061-4bf2-9184-d115310a7b22 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1262 microversion: 2.1 time: 0.181100 Jul 19 19:44:03.454649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 574/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:03 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:03.487830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:03.488443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:03.507840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:03.508298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:03.509097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:03.509537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.495491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:04.524152 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2643f41-1618-44c8-b704-f535362aee03 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 1.033645 Jul 19 19:44:04.531611 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 575/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:03 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:04.545086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-87cf71bd-3c89-4d86-807b-cb5f888e4d7c req-abc009d3-0d55-47c6-ba9d-4c7221e2a8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c786080-abef-4e8c-8d7e-be521e836f20", "tag": "a4e33570-7425-43c4-89a4-4c2c89cbff1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:04.561072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87cf71bd-3c89-4d86-807b-cb5f888e4d7c req-abc009d3-0d55-47c6-ba9d-4c7221e2a8a2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.562298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87cf71bd-3c89-4d86-807b-cb5f888e4d7c req-abc009d3-0d55-47c6-ba9d-4c7221e2a8a2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.608499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-87cf71bd-3c89-4d86-807b-cb5f888e4d7c req-abc009d3-0d55-47c6-ba9d-4c7221e2a8a2 service nova] Creating event network-changed:a4e33570-7425-43c4-89a4-4c2c89cbff1c for instance 8c786080-abef-4e8c-8d7e-be521e836f20 on n-h2-843834-3 Jul 19 19:44:04.620362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-87cf71bd-3c89-4d86-807b-cb5f888e4d7c req-abc009d3-0d55-47c6-ba9d-4c7221e2a8a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082527 Jul 19 19:44:04.621666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 576/1160] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:04.646271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ab057f7-8dba-4359-91a7-42a1c815e213 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '.version_select at 0x7f23ef930af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:04.650208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ab057f7-8dba-4359-91a7-42a1c815e213 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.651769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ab057f7-8dba-4359-91a7-42a1c815e213 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.677592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ab057f7-8dba-4359-91a7-42a1c815e213 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2965 microversion: 2.25 time: 0.054297 Jul 19 19:44:04.680428 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 577/1161] 10.222.0.23 () {60 vars in 1183 bytes} [Tue Jul 19 19:44:04 2022] GET /compute/v2.1/os-migrations => generated 2965 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:04.692712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0c34a43-f586-4009-9721-9f18a056b912 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23efb929d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:04.805920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:44:04.807402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:44:04.808159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:44:04.808781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:44:04.809822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:44:04.836174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.837015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.840325 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0c34a43-f586-4009-9721-9f18a056b912 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8" status: 200 len: 223 microversion: 2.1 time: 0.151495 Jul 19 19:44:04.840933 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 578/1162] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:44:04 2022] GET /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:04.841556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.843029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.847754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:04.848505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:04.865648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.866177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.867613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:04.869829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:04.907410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:44:04.921131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:44:04.937572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:44:04.941214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:44:05.028583 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55c869d6-2a6c-4796-bcb5-14258c0f19ec tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706545 Jul 19 19:44:05.034514 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 585/1163] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:44:05.042134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:05.042756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:05.058586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:05.061464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:05.061947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:05.065192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:05.218618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:05.229000 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54343974-9fe8-43b9-90e3-4560bcda786d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1268 microversion: 2.1 time: 0.193310 Jul 19 19:44:05.243587 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 586/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:05 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:05.248605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:05.252066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:05.284396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:05.286433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:05.288992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:05.291426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:05.324993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:05.333171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49ce3075-3087-40ee-84ee-c89011c908d9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.491118 Jul 19 19:44:05.347336 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 579/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:04 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:05.352449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a41c25d2-b61b-40f6-92db-7acd4270761b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef77a280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:06.058162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:06.086239 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c19b44c2-d7c3-4d09-b36c-cfd2dabf4c6c tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 2421 microversion: 2.25 time: 0.841374 Jul 19 19:44:06.087763 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 587/1166] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:05 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 2421 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:06.092724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:06.093674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:06.101989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:06.102702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:06.104401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:06.105059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:06.613606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:06.628347 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1190999d-579b-4837-b80d-5495b1c138e4 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1212 microversion: 2.1 time: 0.536971 Jul 19 19:44:06.629223 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 588/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:06 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1212 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:06.641820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:06.645727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:06.666168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:06.667929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:06.669934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:06.670496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:07.572450 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a41c25d2-b61b-40f6-92db-7acd4270761b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8" status: 202 len: 0 microversion: 2.1 time: 2.223834 Jul 19 19:44:07.573377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 580/1168] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:44:05 2022] DELETE /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 => generated 0 bytes in 2225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:07.579483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:07.580246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:07.599134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:07.599929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:07.600985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:07.601542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:07.961820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:07.974398 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cdfcd90f-81b8-48ef-aa76-46900db3854d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 1.341057 Jul 19 19:44:07.976182 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 589/1169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:06 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:07.982682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:07.985151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:08.002101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.002826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.004310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.005175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.012049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:08.147055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:08.172383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30b5dfea-52d5-442f-9120-66322ac42197 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 2421 microversion: 2.25 time: 0.597768 Jul 19 19:44:08.173780 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 581/1170] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:07 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 2421 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:08.197966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c49c3ee8-71d9-4ad6-a8d2-0644e756027a req-0af6bce9-654f-4dfb-babe-a7d0b6966a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c786080-abef-4e8c-8d7e-be521e836f20", "name": "network-vif-plugged", "status": "completed", "tag": "a4e33570-7425-43c4-89a4-4c2c89cbff1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:08.219065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c49c3ee8-71d9-4ad6-a8d2-0644e756027a req-0af6bce9-654f-4dfb-babe-a7d0b6966a94 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.226505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c49c3ee8-71d9-4ad6-a8d2-0644e756027a req-0af6bce9-654f-4dfb-babe-a7d0b6966a94 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.258850 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c49c3ee8-71d9-4ad6-a8d2-0644e756027a req-0af6bce9-654f-4dfb-babe-a7d0b6966a94 service nova] Creating event network-vif-plugged:a4e33570-7425-43c4-89a4-4c2c89cbff1c for instance 8c786080-abef-4e8c-8d7e-be521e836f20 on n-h2-843834-3 Jul 19 19:44:08.271400 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c49c3ee8-71d9-4ad6-a8d2-0644e756027a req-0af6bce9-654f-4dfb-babe-a7d0b6966a94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095664 Jul 19 19:44:08.278296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 582/1171] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:08.285468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:08.286565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:08.297325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.298410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.299473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.300314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.460091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:08.475260 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fca6803f-9dc7-4e85-855e-710402cb59fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.497579 Jul 19 19:44:08.476429 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 590/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:07 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:08.482536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef865b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:08.750792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:44:08.751488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.security_group_api [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group 5aeda715-6a97-4578-bf8e-5103834d13a8 not found {{(pid=131229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:44:08.752019 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.752019 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 HTTP/1.1 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:44:08.753979 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.756320 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '5aeda715-6a97-4578-bf8e-5103834d13a8'} Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:08.757211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:44:08.758439 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.761938 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-444aed8e-c651-42cf-918a-a7624f3d5954'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a33bee3-3014-4615-8eae-5941bc97e216 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8" status: 404 len: 194 microversion: 2.1 time: 0.277896 Jul 19 19:44:08.765957 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 591/1173] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:44:08 2022] GET /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 => generated 194 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:44:08.770781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:08.771501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:08.781188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.781726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.782547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.783004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.942164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:08.961103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f960e23-d7a9-4bfc-868d-3e535f37f483 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1274 microversion: 2.1 time: 0.203285 Jul 19 19:44:08.962331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 592/1174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:08 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:08.968812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:08.969678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:08.971862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:08.978714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.979579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.980943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:08.981609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:08.982153 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00a403dc-ca5a-4f79-b85c-b3c6c70b0e83 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.701544 Jul 19 19:44:08.984956 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 583/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:08 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:08.996974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3b560a3-60f0-4b4b-b976-09b0c4854d08 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23efcb0820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1297143188", "description": "tempest-description-842795185"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:09.200232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lazy-loading 'services' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:09.394098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-473e0017-c670-462c-85ba-48e3f7ca97a7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments/f80f52eb-8213-4a9e-aa07-295798421cb7" status: 202 len: 0 microversion: 2.25 time: 0.427480 Jul 19 19:44:09.395639 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 593/1176] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jul 19 19:44:08 2022] DELETE /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments/f80f52eb-8213-4a9e-aa07-295798421cb7 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:44:09.411750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:09.412677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:09.424646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.425356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.426313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.426988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.557980 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3b560a3-60f0-4b4b-b976-09b0c4854d08 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.571730 Jul 19 19:44:09.561229 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 584/1177] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:09.563481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:09.564465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:09.576192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.576979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.577965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.578621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.620746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d317b82d-cb6d-411d-8854-6d1167c3d5fe tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061033 Jul 19 19:44:09.622002 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 585/1178] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:09 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:44:09.629906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:09.630707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:09.639560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.640017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.640883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:09.641932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:09.896338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:09.907100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0444b1d-fb94-4892-b9ed-55ceb5063fc6 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1308 microversion: 2.1 time: 0.507293 Jul 19 19:44:09.908214 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 594/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:09 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:09.913673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-308bfa4e-4b87-4607-9c9b-40f0aca1b6bf tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef89e790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1197979766", "description": "tempest-description-985602089"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:10.108563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:10.132997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21d96d2d-3fbe-4982-a761-c9656d128bb6 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.502461 Jul 19 19:44:10.138401 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 586/1180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:09 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:10.143961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:10.149389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:10.166956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:10.167421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:10.170454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:10.170960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:10.439969 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-308bfa4e-4b87-4607-9c9b-40f0aca1b6bf tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.529867 Jul 19 19:44:10.441533 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 595/1181] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:10.446406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:10.447455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:10.449720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:10.457867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:10.458364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:10.459336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:10.460050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:10.553071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:10.565942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-329b1105-0db4-4383-a281-da9c7de76da8 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.424826 Jul 19 19:44:10.568781 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 587/1182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:10 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:10.580296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a7ffafb4-0595-49ec-b6f5-a7a775d148b2 req-c28900d9-3782-49f6-8d0b-9c49977291f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:10.594509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a7ffafb4-0595-49ec-b6f5-a7a775d148b2 req-c28900d9-3782-49f6-8d0b-9c49977291f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:10.595236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a7ffafb4-0595-49ec-b6f5-a7a775d148b2 req-c28900d9-3782-49f6-8d0b-9c49977291f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:10.648403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a7ffafb4-0595-49ec-b6f5-a7a775d148b2 req-c28900d9-3782-49f6-8d0b-9c49977291f0 service nova] Creating event network-changed:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h1-843834-3 Jul 19 19:44:10.678550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a7ffafb4-0595-49ec-b6f5-a7a775d148b2 req-c28900d9-3782-49f6-8d0b-9c49977291f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097366 Jul 19 19:44:10.679296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 588/1183] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:10.685771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9469fb75-6dda-4efa-a0da-505673ec9f16 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23efb92b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2097232589", "description": "tempest-description-1020020982"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:11.233234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:11.248087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d84d5198-d6f4-4243-af55-0ce74b1b730b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.804118 Jul 19 19:44:11.248761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 596/1184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:10 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:11.270798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:11.274145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:11.289290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.289850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.291582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.293206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.361775 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8447b02-72a3-4bfc-b3b7-49ea07f463aa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100859 Jul 19 19:44:11.362594 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 597/1185] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:11 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:44:11.375540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:11.376177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:11.383410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.383856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.384641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.385075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.514874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9469fb75-6dda-4efa-a0da-505673ec9f16 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.834194 Jul 19 19:44:11.516665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 589/1186] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:11.522573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:11.523746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:11.540802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.543988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.547938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:11.548696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:11.976306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:11.995606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee9124c6-69f6-460f-ae1f-f0fed5f2101a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1488 microversion: 2.1 time: 0.624781 Jul 19 19:44:11.996828 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 598/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:11 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1488 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:12.011714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7899cf09-c6e1-4cd2-ad32-3e47259c7629 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef865ee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:12.224254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:12.244348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25cb3b27-2f7a-4831-a8f2-068da99f4681 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.726432 Jul 19 19:44:12.252223 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 590/1188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:11 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:12.276594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:12.285424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:12.295155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:12.296159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:12.297306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:12.297957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.487993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:13.501304 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5aed7e6-e90a-47f9-86e2-fd02fb1d97eb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 1.246656 Jul 19 19:44:13.503320 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 591/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:12 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:13.520606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:13.523061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:13.545219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.547214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.549886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.553603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.608163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lazy-loading 'flavor' on Instance uuid 8c786080-abef-4e8c-8d7e-be521e836f20 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:13.826365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7899cf09-c6e1-4cd2-ad32-3e47259c7629 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.827911 Jul 19 19:44:13.827343 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 599/1190] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:44:11 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:13.834077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:13.834717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:13.863445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.864745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.865561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.870538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.915667 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e323870-f8a3-4eb5-8104-1c5b8dffee4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20/action" status: 202 len: 0 microversion: 2.1 time: 0.405515 Jul 19 19:44:13.919413 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 592/1191] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:44:13 2022] POST /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:13.945131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:13.952059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:13.977680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.978164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:13.978972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:13.979421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:14.001987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:14.080227 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81e5d4b5-2443-43ab-a31e-34b0425ce61e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162302 Jul 19 19:44:14.087250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 593/1192] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:13 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:44:14.103978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:14.104517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:14.116071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:14.116534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:14.122169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:14.122640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:14.654138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:14.683261 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d03f0aa-3d3e-45df-ab61-a5d35515b3ec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.590745 Jul 19 19:44:14.693088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 594/1193] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:14 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:14.697496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eaf27b15-d54f-45ed-86ca-5c0a00eec9c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23efe9d700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:14.776785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:14.804063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e83a9ee-7b29-4daa-b468-cbe599a26b39 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.974310 Jul 19 19:44:14.806406 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 600/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:13 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:14.817120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c6d70c51-0aed-4934-9b52-7bd858e381bc req-936bb7e7-9261-427d-8f37-72dba87cc825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c7e3a8-d242-45e3-9105-43160d24ce39", "tag": "fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:14.838090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6d70c51-0aed-4934-9b52-7bd858e381bc req-936bb7e7-9261-427d-8f37-72dba87cc825 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:14.844144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6d70c51-0aed-4934-9b52-7bd858e381bc req-936bb7e7-9261-427d-8f37-72dba87cc825 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:14.907057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:14.932662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:14.934685 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c6d70c51-0aed-4934-9b52-7bd858e381bc req-936bb7e7-9261-427d-8f37-72dba87cc825 service nova] Creating event network-changed:fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e for instance 82c7e3a8-d242-45e3-9105-43160d24ce39 on n-h2-843834-3 Jul 19 19:44:14.949569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c6d70c51-0aed-4934-9b52-7bd858e381bc req-936bb7e7-9261-427d-8f37-72dba87cc825 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140713 Jul 19 19:44:14.950540 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 601/1195] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:14.967427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:14.973419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:15.019026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:15.023087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:15.024291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:15.027462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:15.889738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:15.913129 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-509a843f-ed0a-47ac-a0af-3ee46ddaaf7a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 200 len: 1479 microversion: 2.1 time: 0.956396 Jul 19 19:44:15.924027 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 602/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:14 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 1479 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:15.933271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:15.934816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:15.947940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:15.948376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:15.953488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:15.955813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.385398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:16.396541 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ffe91a1-91eb-4b84-a4ce-0b02bb0e56a1 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.480942 Jul 19 19:44:16.397145 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 603/1197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:15 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:16.412740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:16.414090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:16.421558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.422216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.423370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.423948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.429309 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eaf27b15-d54f-45ed-86ca-5c0a00eec9c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b" status: 202 len: 0 microversion: 2.1 time: 1.743846 Jul 19 19:44:16.429899 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 595/1198] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:44:14 2022] DELETE /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b => generated 0 bytes in 1745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:16.445624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:16.446731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:16.461043 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b97b625a-ae4f-4b62-bd08-8f6bdc274673 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053317 Jul 19 19:44:16.461896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 604/1199] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:16 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:44:16.466890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:16.468041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:16.473365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.475193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.475862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.476849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.477510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.479605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.480528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.480865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.543343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68e50dd2-cffb-48cf-ae68-cae0c0ff018b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108394 Jul 19 19:44:16.543918 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 596/1200] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:44:16 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:16.557611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:16.558229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:16.584196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.584661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.585450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.601331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.744803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:16.754329 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be2ba7b0-d291-41f4-b2f2-0b7a52b6894e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.291035 Jul 19 19:44:16.755744 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 605/1201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:16 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:16.761575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1433164839"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:16.762866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:16.771750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.772462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:16.773553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:16.774175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.162508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:17.174131 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e61e0abc-43c3-4ea8-ae40-d43c48471370 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.629031 Jul 19 19:44:17.177032 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 597/1202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:16 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:17.186196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef892a60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.215177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:44:17.218098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:44:17.219054 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.219054 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b HTTP/1.1 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:44:17.221398 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.222866 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '79ab64d4-3a0a-4813-a1b4-5044dedd241b'} Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.223711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:44:17.224888 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.225971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] Jul 19 19:44:17.227249 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.231502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:44:17.231502 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-fada03f3-b08f-40bc-bcca-d93fc64ada5d'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:44:17.232504 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4a2f4ae-4526-45c8-bcc6-c8f615018efc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b" status: 404 len: 194 microversion: 2.1 time: 0.054216 Jul 19 19:44:17.236351 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 598/1203] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:44:17.245969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.246464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:17.255564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.256015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.256797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.257232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.322076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce6cd93e-5ad4-48dd-82c0-5c0a707f7727 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20/action" status: 202 len: 0 microversion: 2.1 time: 0.564495 Jul 19 19:44:17.324738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 606/1204] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:44:16 2022] POST /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:44:17.335794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e668cd1f-20fa-4f33-93a0-b8b96acb5cf9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef805f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.406781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lazy-loading 'services' on Instance uuid 4e769d2a-f48e-4372-aaa3-8603394d3e55 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:17.537350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08967351-e2dd-4917-8021-ba1284a35ff6 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments/22fc7209-5a58-4774-969b-cf8a4da8ce3e" status: 202 len: 0 microversion: 2.1 time: 0.299670 Jul 19 19:44:17.538327 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 599/1205] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 19:44:17 2022] DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments/22fc7209-5a58-4774-969b-cf8a4da8ce3e => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:17.546413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f228316-d7d9-449f-a1da-cba2d2fdcdd2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbaa3a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.603187 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e668cd1f-20fa-4f33-93a0-b8b96acb5cf9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea" status: 202 len: 0 microversion: 2.1 time: 0.274772 Jul 19 19:44:17.604610 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 607/1206] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:44:17 2022] DELETE /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:17.612133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.615240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:17.632340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f228316-d7d9-449f-a1da-cba2d2fdcdd2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.092587 Jul 19 19:44:17.633508 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 600/1207] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:17.637201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.637796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.638697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.639939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.643298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.644819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:17.661495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.662374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.663450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.664088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.715306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a2149c7-97d3-4a82-89be-5273fa29be64 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080536 Jul 19 19:44:17.715886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 601/1208] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:44:17.723253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23efce0ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.754749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:44:17.755605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group d327718c-4a56-422c-a37e-a3c373ba4cea not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:44:17.756249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.756249 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea HTTP/1.1 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:44:17.758603 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.760066 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd327718c-4a56-422c-a37e-a3c373ba4cea'} Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.760927 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:44:17.762108 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.764278 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] Jul 19 19:44:17.766011 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:17.767451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:44:17.767451 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-3530dd8c-e946-4d1d-b9f2-e39ce57df3e9'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:44:17.768600 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4779f3a8-e82b-4e63-a003-9b448d10cdd7 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea" status: 404 len: 194 microversion: 2.1 time: 0.051536 Jul 19 19:44:17.772435 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 602/1209] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:44:17.778756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:17.782051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:17.796589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.797871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:17.798812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:17.801696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.145154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:18.153346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a940d7c-4634-4c5b-8829-198046c12b01 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.379662 Jul 19 19:44:18.174063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 603/1210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:18.177307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:18.179221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce794675-9ae4-4607-8623-de4e78d9cb7f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23efcba5e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:18.190818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-636d9141-7a79-4aa4-9197-7819c137b8d0 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.580227 Jul 19 19:44:18.191505 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 608/1211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:17 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:18.203405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:18.204303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:18.222475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:18.222961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.223800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:18.224173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.263009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:18.631822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:18.643844 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8912f52-08ba-4fe7-bcc5-0d3b1737ba2d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.449058 Jul 19 19:44:18.646297 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 609/1212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:18 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:18.657985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6929940c-384e-426f-8f45-2121d5a161bb tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef865e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:18.750670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6929940c-384e-426f-8f45-2121d5a161bb tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.098097 Jul 19 19:44:18.751327 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 610/1213] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:18 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:18.767162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:18.770256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:18.794619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:18.799180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.802354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:18.804849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.813418 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce794675-9ae4-4607-8623-de4e78d9cb7f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686" status: 202 len: 0 microversion: 2.1 time: 0.637878 Jul 19 19:44:18.815011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 604/1214] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:44:18 2022] DELETE /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:18.821279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c700355b-7bb6-49c5-bc91-bdf5f70c9f23 req-fd0eb53b-c91b-4d58-8b45-6d6da90db97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "name": "network-vif-plugged", "status": "completed", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:18.853731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c700355b-7bb6-49c5-bc91-bdf5f70c9f23 req-fd0eb53b-c91b-4d58-8b45-6d6da90db97d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:18.854418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c700355b-7bb6-49c5-bc91-bdf5f70c9f23 req-fd0eb53b-c91b-4d58-8b45-6d6da90db97d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:18.886094 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c700355b-7bb6-49c5-bc91-bdf5f70c9f23 req-fd0eb53b-c91b-4d58-8b45-6d6da90db97d service nova] Creating event network-vif-plugged:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h1-843834-3 Jul 19 19:44:18.891781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c700355b-7bb6-49c5-bc91-bdf5f70c9f23 req-fd0eb53b-c91b-4d58-8b45-6d6da90db97d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075089 Jul 19 19:44:18.892936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 605/1215] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:18.897068 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3300a3a9-49c0-401d-b3f3-23bd3e26d06b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.144377 Jul 19 19:44:18.898494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef8dd0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:18.904606 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 611/1216] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:44:18 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:18.941212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:44:18.942043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:44:18.946757 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.946757 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686 HTTP/1.1 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:44:18.949066 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.950680 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'e8ec84cc-36fd-47f7-b83c-6fda36ed6686'} Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:18.951706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:44:18.952938 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.954665 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] Jul 19 19:44:18.956995 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:44:18.959694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:44:18.959694 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-a0079315-473e-4647-9f69-5ade2b961d29'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:44:18.961282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-163d4883-c60a-4a0f-82e1-702b6ed1581b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686" status: 404 len: 194 microversion: 2.1 time: 0.067087 Jul 19 19:44:18.962497 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 606/1217] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:44:18 2022] GET /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:44:18.971647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-531f4f48-79c6-4d68-8faa-49a53889d058 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef640430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:19.169850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:19.172418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:19.186325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.191598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:19.192460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.192910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:19.601280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:19.613298 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bdfb0913-4dde-4717-8ce6-a219a7409331 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.443594 Jul 19 19:44:19.614520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 607/1218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:19 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:19.624180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:19.625178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:19.641097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.641617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:19.642422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.642869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:19.678784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-531f4f48-79c6-4d68-8faa-49a53889d058 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.712350 Jul 19 19:44:19.679735 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 612/1219] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:44:18 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:19.684282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:19.684886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:19.704136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.704881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:19.705682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:19.706112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:20.077364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:20.080303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:20.087674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-824259cb-832b-4b25-9674-c315dfd37c6d tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.471715 Jul 19 19:44:20.097710 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b79e417c-6f3d-4b6b-9e15-6bfcd9f3fa9d tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.407781 Jul 19 19:44:20.097710 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 613/1220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:19 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:20.100624 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 608/1221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:19 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:20.105691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-789426c4-e129-4119-a503-4f9017719d6a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef6c25e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1373547338", "description": "tempest-description-961392773"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:20.106130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ab06caa-c21e-4b95-9c20-1dcc0af25294 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbaab80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:20.233442 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ab06caa-c21e-4b95-9c20-1dcc0af25294 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.131423 Jul 19 19:44:20.234785 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 609/1222] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:20 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:20.344873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-789426c4-e129-4119-a503-4f9017719d6a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.244799 Jul 19 19:44:20.345490 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 614/1223] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:20.359578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcf3c752-9944-453f-b435-0635282e63e5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef6f03a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2015673188", "description": "tempest-description-821603500"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:20.632722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:20.633801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:20.649644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:20.651633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:20.654339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:20.656883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:20.705050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcf3c752-9944-453f-b435-0635282e63e5 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.350042 Jul 19 19:44:20.706229 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 610/1224] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:44:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:20.908524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1509181037", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "75a0e96b-eb29-4e07-a4f9-7d2011c03d19"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:20.925835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:20.934424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=75 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:20.950363 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e708c83-c7a3-4c90-85a2-f8f8b8eb9d60 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1310 microversion: 2.1 time: 0.323166 Jul 19 19:44:20.950969 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 615/1225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:20 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1310 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:21.105847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:21.106452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:21.117087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:21.117536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:21.118344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:21.118780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:21.322238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:21.333342 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30e44e93-f0b8-416f-b2b3-4b7265e65dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.231633 Jul 19 19:44:21.333955 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 616/1226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:21 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:44:21.352464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:21.353164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:21.366098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:21.366455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:21.374170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:21.374523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:21.628431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:21.637267 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-102aeea0-413c-494f-80d3-bda8643a391f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1476 microversion: 2.1 time: 0.302230 Jul 19 19:44:21.638411 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 617/1227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:21 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:21.643519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62bbd589-fc7a-4ff1-a7dd-a14307929f15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef6621f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:30.082845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:30.965966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:31.365497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=33 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:31.633180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=32 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:33.379131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] validate_networks() for [('75a0e96b-eb29-4e07-a4f9-7d2011c03d19', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:44:33.393302 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62bbd589-fc7a-4ff1-a7dd-a14307929f15 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 11.753302 Jul 19 19:44:33.394069 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 618/1228] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:21 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 11755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:33.398688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:33.399427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:33.405774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:33.406227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:33.407055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:33.407493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:33.958880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:33.975104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45c8cafd-b9e5-4a1d-90fd-e606d7f64409 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1492 microversion: 2.1 time: 0.579825 Jul 19 19:44:33.975697 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 619/1229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:33 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1492 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:33.980690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:33.981475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:33.988665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.011458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.014560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.017691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.259469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:34.268349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75f26b5b-e16a-4522-8f1b-9f12adc71d16 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.291313 Jul 19 19:44:34.268944 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 620/1230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:33 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:34.297885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:44:34.298316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:44:34.298795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:44:34.299788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:44:34.300351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:44:34.311492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.312689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.314102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.315807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.344400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Getting quotas for project db24051a3a4840f3a4e77d476d6caff2. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:44:34.350219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Getting quotas for user 31cc87c2c9ed45c883b44a3c14c3a1a2 and project db24051a3a4840f3a4e77d476d6caff2. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:44:34.365059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:44:34.367948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:44:34.436560 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c4e7a4e-5485-4cfd-ad15-8fb02da8342f tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.532913 Jul 19 19:44:34.440609 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 611/1231] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 13538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:44:34.440970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:34.446156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0a58495b-ed55-4581-8fb4-4eb81202031f req-eed61746-d765-4199-bd3a-6ac0c877c3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c7e3a8-d242-45e3-9105-43160d24ce39", "name": "network-vif-plugged", "status": "completed", "tag": "fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:34.449705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:34.454853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a58495b-ed55-4581-8fb4-4eb81202031f req-eed61746-d765-4199-bd3a-6ac0c877c3f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.455354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a58495b-ed55-4581-8fb4-4eb81202031f req-eed61746-d765-4199-bd3a-6ac0c877c3f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.465973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.466731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.469104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.469799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.471636 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0a58495b-ed55-4581-8fb4-4eb81202031f req-eed61746-d765-4199-bd3a-6ac0c877c3f2 service nova] Creating event network-vif-plugged:fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e for instance 82c7e3a8-d242-45e3-9105-43160d24ce39 on n-h2-843834-3 Jul 19 19:44:34.479894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0a58495b-ed55-4581-8fb4-4eb81202031f req-eed61746-d765-4199-bd3a-6ac0c877c3f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037229 Jul 19 19:44:34.481284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 612/1232] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:34.490539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:34.492334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:34.511345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.512018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.513055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.513736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.647691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d12383ef-6729-4ccc-a125-38ccc5c4e0a2 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165000 Jul 19 19:44:34.648280 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 613/1233] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:44:34 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:44:34.834618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-unplugged", "status": "completed", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:34.850231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:34.850683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:34.869601 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] Creating event network-vif-unplugged:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h2-843834-3 Jul 19 19:44:34.879158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] Instance e00c5f64-277f-4358-aace-889f5a135209 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:44:34.900452 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c5c24189-2d50-4ad3-a112-976941cbc882 req-5e05fe5b-b031-40aa-8e46-52d0ce29a3f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.248365 Jul 19 19:44:34.902158 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 614/1234] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:34.964782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:34.975065 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8427120f-1e14-4811-a02b-3f4aa388391e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1470 microversion: 2.1 time: 0.694799 Jul 19 19:44:34.988359 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 621/1235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:34 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1470 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:35.002737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-215d96ec-41d2-4e57-97f9-e3cf8a3efee8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef77a430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.198853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.199593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:35.207541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.207986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.208781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.209226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.420908 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ba2752a-12ee-41ec-8bca-563eb717993f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1643 microversion: 2.1 time: 0.517614 Jul 19 19:44:35.438628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 615/1236] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:34 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1643 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:35.450380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.452274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:35.468356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.469652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.472088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.472530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.555306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:35.564901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8acd167d-737c-4809-ae94-1c4aea3d5c58 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1212 microversion: 2.1 time: 0.124809 Jul 19 19:44:35.566373 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 616/1237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:35 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:35.573849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.575156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:35.588387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.589507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.590575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.591233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.636165 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-33cb9713-c5d2-44b2-bfc5-7a159a75bda7 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068154 Jul 19 19:44:35.638237 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 617/1238] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:44:35 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:44:35.643631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:35.644367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:35.651305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.652234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.653247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.653841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.806176 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2cda4a0d-ecf3-4992-8675-5d1fc2306cdf tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "POST /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209/action" status: 202 len: 0 microversion: 2.1 time: 0.165993 Jul 19 19:44:35.807346 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 618/1239] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:44:35 2022] POST /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:35.814612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.815736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:35.822895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.823370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.824209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:35.824591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:35.981154 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-215d96ec-41d2-4e57-97f9-e3cf8a3efee8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.990958 Jul 19 19:44:35.981721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 622/1240] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:34 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:35.989106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:35.990583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.003347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.004379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.006398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.007909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.096563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:36.109123 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-413787af-ca59-46b6-84e7-e6ef3e470f99 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1316 microversion: 2.1 time: 0.300270 Jul 19 19:44:36.116049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 619/1241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:35 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:36.121637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:36.122392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.134867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.135499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.136454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.136994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.184957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:44:36.320522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5fc46426-1b30-42f4-9180-6e7c4bd6e666 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1643 microversion: 2.1 time: 0.337734 Jul 19 19:44:36.322066 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 623/1242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:35 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1643 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:36.327686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:36.328902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.339735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.341368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.342458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.342901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.347671 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d6d5cdf9-6419-422f-ad2a-df9093f4dbd0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 204 len: 0 microversion: 2.1 time: 0.230483 Jul 19 19:44:36.355013 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 620/1243] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:44:36 2022] DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:44:36.370941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:36.372402 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:44:36.372402 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:44:36.373946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.374545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.375863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.376523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.440867 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10d9b4e2-9149-429e-9871-fe72163cb4f7 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083989 Jul 19 19:44:36.447720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 621/1244] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:44:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:36.447720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:36.451130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.465253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.465468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.466203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.466633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.516431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:36.526893 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81b0a48c-35bf-48a6-b07c-3ba27eebadcb tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.202935 Jul 19 19:44:36.528341 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 624/1245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:36 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:36.533038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843834-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:36.534482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.541878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.542570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.543579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.544165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.673865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lazy-loading 'flavor' on Instance uuid e5596707-8f32-4c72-a28a-789ec105689c {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:36.706201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Going to try to live migrate instance to n-h2-843834-3 {{(pid=131229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:44:36.758125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:36.770347 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09565537-06c2-489b-9307-5b718d30d6ae tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1683 microversion: 2.1 time: 0.325564 Jul 19 19:44:36.770491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 622/1246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:36 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1683 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:36.785080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c786080-abef-4e8c-8d7e-be521e836f20", "name": "network-vif-plugged", "status": "completed", "tag": "a4e33570-7425-43c4-89a4-4c2c89cbff1c"}, {"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-plugged", "status": "completed", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:36.795710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.796178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.811045 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Creating event network-vif-plugged:a4e33570-7425-43c4-89a4-4c2c89cbff1c for instance 8c786080-abef-4e8c-8d7e-be521e836f20 on n-h2-843834-3 Jul 19 19:44:36.812206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Creating event network-vif-plugged:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h2-843834-3 Jul 19 19:44:36.819105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] Instance e00c5f64-277f-4358-aace-889f5a135209 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:44:36.837603 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-bdd64164-8a48-4c7c-b1a0-7ed9828d34d5 req-af123168-92ce-474e-897f-0b5ac8b134d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053188 Jul 19 19:44:36.838581 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 623/1247] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:36.855667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:36.856598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:36.881287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.882006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:36.884520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:36.885703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.041037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:37.051705 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35220cb6-c902-4d38-bf23-90eeb18c1ce9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1268 microversion: 2.1 time: 0.211833 Jul 19 19:44:37.052693 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 624/1248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:36 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1268 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:37.058400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-95b9429a-1132-4d1f-9894-b8a9c3fffc48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23fc0d64c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:37.123496 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-95b9429a-1132-4d1f-9894-b8a9c3fffc48 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.069605 Jul 19 19:44:37.128458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 625/1249] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:37 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:37.144863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:37.175339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:37.177659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.204935 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] Creating event network-changed:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h2-843834-3 Jul 19 19:44:37.210834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] Instance e00c5f64-277f-4358-aace-889f5a135209 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:44:37.247259 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0d2ad292-66aa-4d7e-a875-fe86311ada29 req-5dcd0d3c-bbf2-473e-8bf7-8f16fcff0a85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110700 Jul 19 19:44:37.248170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 626/1250] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:37.265924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:37.265924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:37.275950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:37.276446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.277242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:37.277675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.746290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:37.754536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-349c5ea3-18ee-4f22-9a2f-f050a1f707b2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1466 microversion: 2.1 time: 0.505134 Jul 19 19:44:37.755161 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 627/1251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:37 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1466 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:37.762328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:37.765000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:37.791554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:37.792957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.793999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:37.794594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:37.800396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:38.078879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:38.086900 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7046f149-678d-4bfc-b277-c8e3c38a138c tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.330675 Jul 19 19:44:38.087532 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 628/1252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:37 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:38.107061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:38.107061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:38.149529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:38.149994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:38.150805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:38.151305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:38.450217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-97134781-e180-4da0-880a-a85bd9514301 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1617 microversion: 2.1 time: 0.348083 Jul 19 19:44:38.450842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 629/1253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:38 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1617 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:38.486470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:38.489935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:38.506130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:38.506862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:38.507875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:38.508482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.025081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:39.038039 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-18bf2615-7e7f-4503-9c87-9abb99c588dc tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1683 microversion: 2.1 time: 0.564702 Jul 19 19:44:39.048448 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 630/1254] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:38 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1683 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:39.062353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:39.063016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:39.079870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.080397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.081080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.081522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.295716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:39.307348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-591b5d9a-918f-4b54-80cb-0659f9e1a26e tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1274 microversion: 2.1 time: 0.257670 Jul 19 19:44:39.309171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:39 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:39.343446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57692be8-e27e-43cf-975d-0f43fc2e92cd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efbaa820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:39.455727 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57692be8-e27e-43cf-975d-0f43fc2e92cd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.120542 Jul 19 19:44:39.456334 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 632/1256] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:39 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:39.475467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-900163004", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f65301ea-31b5-4e24-a345-ad9c73259006"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:39.612682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:44:39.637364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e4e7682-4ec5-4b27-b455-ea9633ed1c12 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c/action" status: 202 len: 0 microversion: 2.1 time: 3.107744 Jul 19 19:44:39.639321 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 625/1257] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:44:36 2022] POST /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c/action => generated 0 bytes in 3110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:39.645380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:39.646005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:39.678328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.678795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:39.689799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:39.690878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:40.607069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:40.624888 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-482417aa-a2d6-4728-94ac-0eefa4649358 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.984360 Jul 19 19:44:40.634868 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 626/1258] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:39 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:40.640612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:40.643691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:40.661560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:40.662274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:40.674609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:40.685589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.160270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:44:41.161350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:44:41.162062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:44:41.162835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:44:41.163501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:44:41.180906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.181408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.182214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.182959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.247339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:44:41.261448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Getting quotas for user 739f00235d7f4f81a47e2c3b31720c45 and project a78c5bd5d33e486598f6b0ffdd504282. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:44:41.264219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:41.272951 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-977c6c18-f6e4-452d-bf7f-6d190c517d82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 0.636697 Jul 19 19:44:41.277542 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 627/1259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:40 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:41.298715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:41.299480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:41.309734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.313225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.314243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.318518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.320706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:44:41.323614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:44:41.456094 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-79862d5c-29cb-4c47-8436-e9214586acfb tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.990772 Jul 19 19:44:41.464257 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 633/1260] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:44:41.484102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:41.484868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:41.496855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.500010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.501169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.503977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.687894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:41.699021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9455cc33-3366-4910-b358-3ee12a0b3e41 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1615 microversion: 2.1 time: 0.420240 Jul 19 19:44:41.711676 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 628/1261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:41 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1615 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:41.721809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef96626e-eb29-4739-b664-c8341ca4ab1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef672b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:41.834623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef96626e-eb29-4739-b664-c8341ca4ab1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.116687 Jul 19 19:44:41.835494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 629/1262] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:41 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:41.846719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-647368a9-834f-4b5e-8a56-3de0b261b921 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:41.847532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-647368a9-834f-4b5e-8a56-3de0b261b921 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:41.934774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-647368a9-834f-4b5e-8a56-3de0b261b921 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:41.946123 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-647368a9-834f-4b5e-8a56-3de0b261b921 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1216 microversion: 2.1 time: 0.104415 Jul 19 19:44:41.949318 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 630/1263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:41 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:41.966714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:41.972711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:41.992141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.995243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:41.996093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:41.996535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:43.117056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:43.125173 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de9a3670-e0a0-4df9-b66b-5de031d2a370 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 1.660033 Jul 19 19:44:43.143308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 634/1264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:41 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:43.148616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:43.149280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:43.195304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:43.196258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:43.203433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:43.204147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:43.387819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:43.406858 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-179dff9c-0f74-4c69-99e6-05f8943be9d5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 1.452875 Jul 19 19:44:43.410583 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 631/1265] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:41 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:43.436262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:43.437089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:43.468193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:43.473375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:43.475994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:43.479372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.085640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:44.095963 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62ae3dbc-2415-43b6-a9e9-659b490bd725 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1615 microversion: 2.1 time: 0.681643 Jul 19 19:44:44.111752 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 632/1266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:43 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1615 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:44.142740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bae99931-5f8b-47d4-b7e2-f1e3ab3e2f00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef76f430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:44.248074 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bae99931-5f8b-47d4-b7e2-f1e3ab3e2f00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.134752 Jul 19 19:44:44.253744 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 633/1267] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:44 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:44.262185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:44.262812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:44.305698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.306149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.313347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.313976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.352346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:44.360822 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d43b9aab-b835-4c09-a022-eee2f7bc4b1b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 1.216299 Jul 19 19:44:44.361424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 635/1268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:43 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:44.397042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a227ef52-dd51-4845-9234-7e606c06a9db req-4fa5bb03-c641-4357-9bad-68faaf41d991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "name": "network-vif-unplugged", "status": "completed", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:44.413192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a227ef52-dd51-4845-9234-7e606c06a9db req-4fa5bb03-c641-4357-9bad-68faaf41d991 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.413643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a227ef52-dd51-4845-9234-7e606c06a9db req-4fa5bb03-c641-4357-9bad-68faaf41d991 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.483840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a227ef52-dd51-4845-9234-7e606c06a9db req-4fa5bb03-c641-4357-9bad-68faaf41d991 service nova] Creating event network-vif-unplugged:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h1-843834-3 Jul 19 19:44:44.514678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a227ef52-dd51-4845-9234-7e606c06a9db req-4fa5bb03-c641-4357-9bad-68faaf41d991 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151940 Jul 19 19:44:44.515449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 636/1269] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:44.521253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:44.527784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:44.545611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.546100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.554247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.554952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.716873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:44.727202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-545f1a02-f9d7-4c3f-b4a0-6bd2800c5d61 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1274 microversion: 2.1 time: 0.474586 Jul 19 19:44:44.727795 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 634/1270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:44 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1274 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:44.770016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:44.770762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:44.786702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.788553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:44.794041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:44.795234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.317158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:45.332038 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7241e52-d89c-40bf-8218-1942616d8352 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 0.815157 Jul 19 19:44:45.332936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 637/1271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:44 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:45.338538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3f39e624-dd9a-42a2-95c0-6dee16c1d457 req-fdcdebb1-5c5c-40e4-943e-27a6345d6ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e769d2a-f48e-4372-aaa3-8603394d3e55", "name": "network-vif-deleted", "tag": "ca376b2c-714d-406a-be0d-9a73b864562a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:45.381279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3f39e624-dd9a-42a2-95c0-6dee16c1d457 req-fdcdebb1-5c5c-40e4-943e-27a6345d6ba6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.381983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3f39e624-dd9a-42a2-95c0-6dee16c1d457 req-fdcdebb1-5c5c-40e4-943e-27a6345d6ba6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.419665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3f39e624-dd9a-42a2-95c0-6dee16c1d457 req-fdcdebb1-5c5c-40e4-943e-27a6345d6ba6 service nova] Creating event network-vif-deleted:ca376b2c-714d-406a-be0d-9a73b864562a for instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 on n-h2-843834-3 Jul 19 19:44:45.431875 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3f39e624-dd9a-42a2-95c0-6dee16c1d457 req-fdcdebb1-5c5c-40e4-943e-27a6345d6ba6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096733 Jul 19 19:44:45.432936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 638/1272] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:45.446765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:45.448004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:45.469243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.472555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.473621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.477547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.580192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:45.589493 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4b0475f5-92a8-4d34-b4b7-6ea900fb2206 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.848972 Jul 19 19:44:45.602317 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 635/1273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:44 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:45.610639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5ce4ceb-ea28-41e3-9b06-4527a67505c3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef865160>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:45.701326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5ce4ceb-ea28-41e3-9b06-4527a67505c3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.097329 Jul 19 19:44:45.702671 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 636/1274] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:45 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:45.718135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:45.718686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:45.726297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:45.727381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a6a41c32-bbb0-4fa0-8ef7-e08ce9e64f88 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1327 microversion: 2.1 time: 0.292841 Jul 19 19:44:45.727976 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 639/1275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:45 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1327 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:45.780442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.782957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.786160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.793206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.800368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:45.803523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:45.820460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.821114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:45.822208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:45.827339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:46.171425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:46.223447 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98e88fc0-fd99-48e3-9170-6acc6e62fb30 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1274 microversion: 2.1 time: 0.473152 Jul 19 19:44:46.225834 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 640/1276] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:45 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:46.349301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:46.349945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:46.370255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:46.373184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:46.373184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:46.373184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:46.773865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:46.796557 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e869912c-2b10-4d32-ba77-78ba219edb05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 1.091076 Jul 19 19:44:46.799994 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 637/1277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:45 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:46.810573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1958f0f5-2790-4617-a12c-d82b0ee0c066", "tag": "f9e18d41-b785-462a-a30d-38f9b5282299"}, {"name": "network-changed", "server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:46.846652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:46.847399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:46.893529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] Creating event network-changed:f9e18d41-b785-462a-a30d-38f9b5282299 for instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 on n-h2-843834-3 Jul 19 19:44:46.894402 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] Creating event network-changed:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h1-843834-3 Jul 19 19:44:46.905700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-fd678f08-3d10-4287-8be9-7133bc50e2e8 req-52abe06e-5e71-4cb1-b183-da92566c7037 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103765 Jul 19 19:44:46.909262 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 638/1278] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:46.930969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:46.943409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:46.982011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:46.986580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:46.986580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:46.986580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.066044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:47.084465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:47.137772 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-942a7906-883d-4a76-a0c8-ae52656333b6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 0.789543 Jul 19 19:44:47.149791 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 641/1279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:46 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:44:47.178432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6eb82d78-c95f-4aa3-9be2-8c686ea02ec2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef6f64c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:47.348452 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6eb82d78-c95f-4aa3-9be2-8c686ea02ec2 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.204464 Jul 19 19:44:47.354682 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 642/1280] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:47 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:47.372591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:47.384135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:47.412893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.418526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.419888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.421449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.563224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:47.573419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.578832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.580073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lazy-loading 'fault' on Instance uuid 4e769d2a-f48e-4372-aaa3-8603394d3e55 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:44:47.744594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc74f3b686f74bce88d1ab84828220f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48554aefbc564866bc55a7ef61395374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:47.755491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e7bd8ef-9100-4cda-a3fa-32238c615a7f tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 200 len: 1332 microversion: 2.1 time: 0.398415 Jul 19 19:44:47.759928 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 643/1281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:47 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 1332 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:47.783072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:47.784033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:47.797494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.807080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.808325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.808933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.844807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:47.857670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8fba202-34f0-4569-86c2-c2321defcf0e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.945535 Jul 19 19:44:47.866187 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 639/1282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:46 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:47.874328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:47.887457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:47.908269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.911882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:47.914349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:47.917061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:48.074294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:48.092923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c38eb233-dd92-44af-8335-80f288dbf439 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1274 microversion: 2.1 time: 0.310492 Jul 19 19:44:48.092923 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 644/1283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:47 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:48.158620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:48.159253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:48.171004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:48.184196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:48.192507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:48.192997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.091022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:49.106871 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4badb8e-22b6-41ef-8ac8-59898ab22c91 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 0.952899 Jul 19 19:44:49.109778 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 645/1284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:48 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:44:49.131957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83cf9f44-8304-45aa-a8ea-480d6da15830 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef6c5820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:49.197329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:49.214640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa696f71-23e0-4fa7-ad96-69fec18b9bf9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 1.343776 Jul 19 19:44:49.221018 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 640/1285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:47 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:49.239247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83cf9f44-8304-45aa-a8ea-480d6da15830 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.123601 Jul 19 19:44:49.240430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 646/1286] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:49 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:49.245434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:49.248436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:49.249975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:49.253210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:49.267456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.268772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.269157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.269783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.269920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.270417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.273297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.275585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.313189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] HTTP exception thrown: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Request method failure captured: Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 HTTP/1.1 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wkJVwW8XjL5PE0E5rDfdAZO7InDcRjhLhfxp7KSUqwMuOqmheX68CC0DqYvyXGQM7FXt-z9YdufVE8kNzdKYIzb-xa8M9MgrTjE-qNLjfAirqh92atGPeHKPmJLntGOhD3QFyZO2nwn9o80D5DycmcP5fNk1hqub0QQkIHmKT3RL64 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:44:49.335276 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48554aefbc564866bc55a7ef61395374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48554aefbc564866bc55a7ef61395374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: fc74f3b686f74bce88d1ab84828220f3 Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:44:49.337022 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '4e769d2a-f48e-4372-aaa3-8603394d3e55'} Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:44:49.338023 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:44:49.339463 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:44:49.345935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Returning 404 to user: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:44:49.353403 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56d51b32-f8e3-4541-a6a4-933b85dda0f0 tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 404 len: 111 microversion: 2.1 time: 0.129318 Jul 19 19:44:49.354174 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 641/1287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:49 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:44:49.365147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:49.369669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:49.389466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.389933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.390730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:49.391199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:49.899768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:49.908635 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-270862e5-0af3-44e3-8ef7-990ca2b6e119 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 0.666889 Jul 19 19:44:49.909232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 647/1288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:49 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:49.933148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ef4ea6e-147a-43cc-9276-75f6e89ce8ef tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '.version_select at 0x7f23fc0d6670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:49.969690 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ef4ea6e-147a-43cc-9276-75f6e89ce8ef tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697136917" status: 202 len: 0 microversion: 2.1 time: 0.045871 Jul 19 19:44:49.976775 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 648/1289] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697136917 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:44:50.047545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:50.056789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d03aa2a6-8f5e-4776-bc3a-c2176a7473df tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 0.701353 Jul 19 19:44:50.070136 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 642/1290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:49 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:50.117799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-unplugged", "status": "completed", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:50.126433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:50.130340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:50.148594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:50.149520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:50.150076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:50.154999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:50.154999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:50.154999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:50.198059 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] Creating event network-vif-unplugged:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:44:50.214769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] Instance e00c5f64-277f-4358-aace-889f5a135209 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:44:50.265825 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8aa3c274-ee80-4734-bc46-b24e5fca7383 req-b1612fab-bd5e-4c86-906b-1aa7da00a0bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151596 Jul 19 19:44:50.267092 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 649/1291] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:44:50.272922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:50.275966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:50.286169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:50.286965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:50.288862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:50.289539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:51.208245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:51.297147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:51.373110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:51.384561 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ee1afeb-5c3b-49cd-a6a8-a93b82d62817 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 1.262440 Jul 19 19:44:51.387157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 643/1292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:50 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:51.398145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58e774f9-4b40-4f2e-99a9-251971f15079 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efee45e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:51.458309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:51.463590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:51.487682 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8ad296d-2797-42a5-95c8-bb2ff5934ce0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 1.218888 Jul 19 19:44:51.488310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 650/1293] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:50 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:51.498049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-367479209", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e1fb5a5d-f185-4eab-959a-40101db7e714"}], "block_device_mapping_v2": [{"uuid": "86dc92af-e5a9-409c-b15f-53088d2b48de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:51.513067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58e774f9-4b40-4f2e-99a9-251971f15079 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.124663 Jul 19 19:44:51.519165 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 644/1294] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:51 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:51.528176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:51.537187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:51.565497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:51.569416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:51.572216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:51.574688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:51.647204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] validate_networks() for [('e1fb5a5d-f185-4eab-959a-40101db7e714', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:44:51.948396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:44:52.657119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:52.677932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-910100d2-7865-4321-84f2-2ade4ac194b9 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 1.157546 Jul 19 19:44:52.681353 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 645/1295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:51 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:52.699533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:52.700465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:52.708600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:52.709315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:52.710321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:52.710943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.113305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:53.130399 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5d5bc5d-7b21-43fb-b974-40799fe10ff2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 0.436708 Jul 19 19:44:53.134199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 646/1296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:52 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:53.143771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:53.144412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:53.156818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.157452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.158698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.159325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.487520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:44:53.488068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:44:53.488405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:44:53.488813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:44:53.489012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:53.489224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:44:53.504729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b1ded03-9f68-4e93-a8c9-8d7e38223593 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 0.369322 Jul 19 19:44:53.506057 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 647/1297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:53 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:53.506281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.506742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.507599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.508108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.513321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:53.514186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:53.526206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.526979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.528405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:53.529167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:53.549347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:44:53.566561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Getting quotas for user df971d67f21747f2afa56647d78a7fa5 and project 4c8cdd547c7641ce9ad5fe49e15eb6d7. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:44:53.705582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:44:53.707711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86dc92af-e5a9-409c-b15f-53088d2b48de',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:44:53.967346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01e830c7-28c1-4f29-b2e5-a018c95f6c04 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.476498 Jul 19 19:44:53.969918 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 651/1298] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:44:53.989704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b628b28-29fc-42df-8e7e-34f64def35f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23fc00f9d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:54.150565 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b628b28-29fc-42df-8e7e-34f64def35f8 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.179331 Jul 19 19:44:54.156424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 652/1299] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:53 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:54.173461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:54.254476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.255022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:54.313201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:54.341033 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5a192d1-74c7-440d-a7b1-c927a82861e5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 0.833175 Jul 19 19:44:54.345125 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 648/1300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:53 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:54.355188 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] Creating event network-changed:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:44:54.355424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ff22d55d-0f86-418e-9e76-ddcf7383f612 req-0f26a87e-bd5c-4c07-80fe-1f31c9fbf76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b841a34-7fad-4080-962a-dc22909dec8a", "tag": "ad38764b-1549-449f-b02b-291200da3f53"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:54.399211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ff22d55d-0f86-418e-9e76-ddcf7383f612 req-0f26a87e-bd5c-4c07-80fe-1f31c9fbf76a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.402303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ff22d55d-0f86-418e-9e76-ddcf7383f612 req-0f26a87e-bd5c-4c07-80fe-1f31c9fbf76a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:54.405568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] Instance e00c5f64-277f-4358-aace-889f5a135209 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 19:44:54.448466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ff22d55d-0f86-418e-9e76-ddcf7383f612 req-0f26a87e-bd5c-4c07-80fe-1f31c9fbf76a service nova] Creating event network-changed:ad38764b-1549-449f-b02b-291200da3f53 for instance 0b841a34-7fad-4080-962a-dc22909dec8a on n-h1-843834-3 Jul 19 19:44:54.466700 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-aff358e1-677e-451d-81b6-889db8c54d18 req-daffd87a-d961-4e7a-84bd-24fb40b0d213 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309175 Jul 19 19:44:54.474991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 653/1301] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:54.483717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ff22d55d-0f86-418e-9e76-ddcf7383f612 req-0f26a87e-bd5c-4c07-80fe-1f31c9fbf76a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134045 Jul 19 19:44:54.491727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 649/1302] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:54.501437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:54.504954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:54.513455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:54.514236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:54.532216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.532679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:54.550219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.551033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:54.873073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:54.881906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:54.886449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:54.894483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71c4ecb5-6af5-4bc1-8655-e5d7cc7bdfbc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1103 microversion: 2.25 time: 0.400400 Jul 19 19:44:54.896806 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 650/1303] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:54 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1103 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:54.907115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:54.911171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:54.927666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.929570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:54.931981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:54.932645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:55.710225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:55.728787 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e70f1d47-b260-4ec7-8af5-e2af65fc7d85 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1469 microversion: 2.1 time: 1.251012 Jul 19 19:44:55.731799 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 654/1304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:54 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1469 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:55.900820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-88b7adb4-0af5-4bd8-a790-b693049cf9f1 req-ef247339-ed2f-43be-a10d-847ce9fef986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1958f0f5-2790-4617-a12c-d82b0ee0c066", "name": "network-vif-plugged", "status": "completed", "tag": "f9e18d41-b785-462a-a30d-38f9b5282299"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:55.929110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88b7adb4-0af5-4bd8-a790-b693049cf9f1 req-ef247339-ed2f-43be-a10d-847ce9fef986 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:55.929954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88b7adb4-0af5-4bd8-a790-b693049cf9f1 req-ef247339-ed2f-43be-a10d-847ce9fef986 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:55.952433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:55.968082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43384a3b-5159-4d22-846a-6d92fa419132 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 1.068418 Jul 19 19:44:55.973255 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 651/1305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:54 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:55.986632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-88b7adb4-0af5-4bd8-a790-b693049cf9f1 req-ef247339-ed2f-43be-a10d-847ce9fef986 service nova] Creating event network-vif-plugged:f9e18d41-b785-462a-a30d-38f9b5282299 for instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 on n-h2-843834-3 Jul 19 19:44:55.988192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:55.992165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:55.997951 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-88b7adb4-0af5-4bd8-a790-b693049cf9f1 req-ef247339-ed2f-43be-a10d-847ce9fef986 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256815 Jul 19 19:44:56.001627 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 655/1306] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:56.004624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.008693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.009771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.014119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.019504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c2d9705-9121-4192-8579-437fad0ae37f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef4d5790>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:56.115316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2c2d9705-9121-4192-8579-437fad0ae37f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.109622 Jul 19 19:44:56.117664 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 656/1307] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:56 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:56.127710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:56.128452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:56.162001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.162699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.164097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.164718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.879662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:56.888469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6229841-296a-4633-9bf0-11a9af902367 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1502 microversion: 2.1 time: 0.767631 Jul 19 19:44:56.901567 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 657/1308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:56 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1502 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:56.912845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:56.923830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:56.931120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.931784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.934154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:56.934783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:56.954175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:56.978762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c33b3f13-d620-424d-a0fa-6962bf547ddc tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1316 microversion: 2.1 time: 1.004015 Jul 19 19:44:56.999757 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 652/1309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:55 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1316 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:57.020290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-97c7329f-acef-43ae-9b57-d2085ecf965d req-140d7a88-20ca-4531-87a9-1fb459860229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "name": "network-vif-unplugged", "status": "completed", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:57.058201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-97c7329f-acef-43ae-9b57-d2085ecf965d req-140d7a88-20ca-4531-87a9-1fb459860229 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:57.058902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-97c7329f-acef-43ae-9b57-d2085ecf965d req-140d7a88-20ca-4531-87a9-1fb459860229 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:57.104714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:57.116294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:57.131188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:57.141048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-97c7329f-acef-43ae-9b57-d2085ecf965d req-140d7a88-20ca-4531-87a9-1fb459860229 service nova] Creating event network-vif-unplugged:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h1-843834-3 Jul 19 19:44:57.142642 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8bb3a9e4-22a4-47b8-8dfc-2b4d25a433ec tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1250 microversion: 2.25 time: 0.239576 Jul 19 19:44:57.157873 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 658/1310] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:56 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1250 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:44:57.157873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:57.157873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:57.162893 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-97c7329f-acef-43ae-9b57-d2085ecf965d req-140d7a88-20ca-4531-87a9-1fb459860229 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161734 Jul 19 19:44:57.171370 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 653/1311] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:57.179181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:57.194905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:57.198388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:57.198806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:57.201628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:57.210308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:57.226880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:57.233968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:57.235110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:57.235781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:57.881966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:57.891924 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cc29b6d9-f5a7-409d-9014-c25a9d6c1ab4 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1462 microversion: 2.1 time: 0.742352 Jul 19 19:44:57.912148 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 659/1312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:57 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1462 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:57.933331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd5e43da-4e98-4f72-894a-46d5bad48fc3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef4eaf70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:58.043766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd5e43da-4e98-4f72-894a-46d5bad48fc3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1438 microversion: 2.1 time: 0.129888 Jul 19 19:44:58.051231 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 660/1313] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:44:57 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:58.067099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:58.068231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:58.084665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:58.086763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:58.087996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:58.091772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:58.287624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:58.306167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-279272a4-31ac-4690-90c9-1c1d91cacca6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 1.133241 Jul 19 19:44:58.312503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 654/1314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:57 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:58.727904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:58.729185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:58.743760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:58.750841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:58.754402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:58.754862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:59.673424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:44:59.682377 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23babab4-5423-472a-838b-6eb96b0c386d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1492 microversion: 2.1 time: 1.629522 Jul 19 19:44:59.694222 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 661/1315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:58 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1492 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:59.708569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:59.714437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:59.725787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:59.726535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:59.727512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:59.729711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:59.736797 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-abb9bf46-8e47-4f78-8ad2-bf47e7cbe681 tempest-MigrationsAdminTest-659395114 tempest-MigrationsAdminTest-659395114-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1613 microversion: 2.1 time: 1.421295 Jul 19 19:44:59.747060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 655/1316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:58 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1613 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:44:59.749990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4e8f8b33-cdf1-4d20-ab9e-c5290de62b26 req-bfefa6f7-e7a5-41bb-a7b8-2f005edefa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-plugged", "status": "completed", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:44:59.772017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e8f8b33-cdf1-4d20-ab9e-c5290de62b26 req-bfefa6f7-e7a5-41bb-a7b8-2f005edefa72 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:59.773301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e8f8b33-cdf1-4d20-ab9e-c5290de62b26 req-bfefa6f7-e7a5-41bb-a7b8-2f005edefa72 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:59.804792 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4e8f8b33-cdf1-4d20-ab9e-c5290de62b26 req-bfefa6f7-e7a5-41bb-a7b8-2f005edefa72 service nova] Creating event network-vif-plugged:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:44:59.815155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4e8f8b33-cdf1-4d20-ab9e-c5290de62b26 req-bfefa6f7-e7a5-41bb-a7b8-2f005edefa72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074389 Jul 19 19:44:59.818072 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 656/1317] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:44:59.832830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:44:59.833901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:44:59.853024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:59.854187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:44:59.855277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:44:59.856805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.086886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:00.100265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:00.102541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:00.106959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da4d75c2-2b71-463f-b728-ba07090997d2 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1250 microversion: 2.25 time: 0.284101 Jul 19 19:45:00.110667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 657/1318] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:44:59 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1250 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:00.120911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fbce7ffb-8e9d-46a4-9be1-7724f44af1dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef5d3040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.192395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:00.200345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5e776e8-ba19-402b-bf7c-e7a5174c7394 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1503 microversion: 2.1 time: 0.495758 Jul 19 19:45:00.219388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 662/1319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:44:59 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1503 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:00.225120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.226034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:00.247962 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fbce7ffb-8e9d-46a4-9be1-7724f44af1dd tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1447 microversion: 2.1 time: 0.135654 Jul 19 19:45:00.248808 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 658/1320] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:00 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:00.255820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-170f467b-cfc9-431c-95a5-1e120cbb4947 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '.version_select at 0x7f23ef77a8b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.257499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.259514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.260800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170f467b-cfc9-431c-95a5-1e120cbb4947 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.261364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170f467b-cfc9-431c-95a5-1e120cbb4947 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.262015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.275045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-170f467b-cfc9-431c-95a5-1e120cbb4947 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3122 microversion: 2.1 time: 0.024193 Jul 19 19:45:00.283721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.284664 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 659/1321] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:45:00 2022] GET /compute/v2.1/os-migrations => generated 3122 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:00.290816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.290816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:00.298333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.298944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.299874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.300470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.391679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:00.518823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:00.602674 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b726232-6910-4fb1-b6b3-b11e11671be5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 204 len: 0 microversion: 2.1 time: 0.315914 Jul 19 19:45:00.604564 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 660/1322] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:00 2022] DELETE /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:00.618748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1373547338"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:00.619773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:00.628178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.628924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.629951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.630551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.856517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:00.868270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ebc2df84-8a69-4bef-94df-de409ab1b8f6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 0.647356 Jul 19 19:45:00.868908 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 663/1323] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:00 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:00.898738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb72c4da-9f2e-42fe-a076-f995f12e851d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef4eaee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.960684 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb72c4da-9f2e-42fe-a076-f995f12e851d tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 200 len: 1447 microversion: 2.1 time: 0.078088 Jul 19 19:45:00.961598 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 664/1324] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:00 2022] GET /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:00.966712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:00.967377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:00.985643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.996663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:00.997535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:00.997998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:01.044311 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Adding security group 83fb6162-7a93-4d44-89c2-5084a189a463 to port f9e18d41-b785-462a-a30d-38f9b5282299 Jul 19 19:45:02.447825 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c40a6ee5-196e-4d9c-ac03-12cfb74e0fba tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1643 microversion: 2.1 time: 1.484518 Jul 19 19:45:02.451621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 665/1325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:00 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1643 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:02.497354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:02.500363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:02.518753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:02.520993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:02.524024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:02.524714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:03.361449 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c113cd1d-6671-4091-b31f-d7340f126290 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action" status: 202 len: 0 microversion: 2.1 time: 2.748257 Jul 19 19:45:03.362185 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 661/1326] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:00 2022] POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action => generated 0 bytes in 2750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:03.370966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a711e79-4148-45ad-b205-a45fd5826cf0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef6400d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:03.515717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:03.580927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:04.125497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:04.147610 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d3bd184-edf6-4b4b-8825-5bac0287994e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 200 len: 1468 microversion: 2.1 time: 1.683779 Jul 19 19:45:04.147745 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a711e79-4148-45ad-b205-a45fd5826cf0 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 204 len: 0 microversion: 2.1 time: 0.780651 Jul 19 19:45:04.148490 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 666/1327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:02 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 1468 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:04.161759 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 662/1328] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:03 2022] DELETE /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:04.164826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:04.165420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:04.165710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:04.166143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:04.173131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.173823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.174796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.175434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.183455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:04.192344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.193164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.194280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.194727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.200363 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] HTTP exception thrown: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Request method failure captured: Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 HTTP/1.1 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wkJVwW8XjL5PE0E5rDfdAZO7InDcRjhLhfxp7KSUqwMuOqmheX68CC0DqYvyXGQM7FXt-z9YdufVE8kNzdKYIzb-xa8M9MgrTjE-qNLjfAirqh92atGPeHKPmJLntGOhD3QFyZO2nwn9o80D5DycmcP5fNk1hqub0QQkIHmKT3RL64 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:04.202113 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48554aefbc564866bc55a7ef61395374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48554aefbc564866bc55a7ef61395374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: fc74f3b686f74bce88d1ab84828220f3 Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:04.203536 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '4e769d2a-f48e-4372-aaa3-8603394d3e55'} Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:04.204318 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:04.205539 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:04.206758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Returning 404 to user: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:04.206758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e219df5-d120-4c07-ad2d-78e47f72376b tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 404 len: 111 microversion: 2.1 time: 0.054132 Jul 19 19:45:04.215308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 667/1329] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:04 2022] DELETE /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:04.220312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:04.220938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:04.227343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.227795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.228579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.229012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.752613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:04.761608 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b5ef8a7-b6e3-48cc-b372-f81225ab8c79 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 0.545106 Jul 19 19:45:04.763686 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 668/1330] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:04 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:04.770642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8f41664c-6e1d-4346-9189-cca5db96e6ed req-a369650a-d1af-4dd4-9b4e-cd85e8c7d8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b841a34-7fad-4080-962a-dc22909dec8a", "name": "network-vif-plugged", "status": "completed", "tag": "ad38764b-1549-449f-b02b-291200da3f53"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:04.811197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8f41664c-6e1d-4346-9189-cca5db96e6ed req-a369650a-d1af-4dd4-9b4e-cd85e8c7d8df service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:04.812373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8f41664c-6e1d-4346-9189-cca5db96e6ed req-a369650a-d1af-4dd4-9b4e-cd85e8c7d8df service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:04.832494 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8f41664c-6e1d-4346-9189-cca5db96e6ed req-a369650a-d1af-4dd4-9b4e-cd85e8c7d8df service nova] Creating event network-vif-plugged:ad38764b-1549-449f-b02b-291200da3f53 for instance 0b841a34-7fad-4080-962a-dc22909dec8a on n-h1-843834-3 Jul 19 19:45:04.838106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8f41664c-6e1d-4346-9189-cca5db96e6ed req-a369650a-d1af-4dd4-9b4e-cd85e8c7d8df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070815 Jul 19 19:45:04.839354 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 669/1331] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:04.853178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:04.866062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-215613338", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "fb087bda-9d04-4001-99de-3fb667d5f62c"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:04.881765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:04.886309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:04.893160 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f6d6b2b6-860d-4c9d-9cef-dd62e056917e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1292 microversion: 2.25 time: 0.732667 Jul 19 19:45:04.907792 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 663/1332] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:04 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1292 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:04.914118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef6acca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:04.935435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:04.984702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] validate_networks() for [('fb087bda-9d04-4001-99de-3fb667d5f62c', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:05.606470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use.", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:05.607805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.607805 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463 HTTP/1.1 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:05.612837 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: exception: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.614312 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '83fb6162-7a93-4d44-89c2-5084a189a463'} Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:05.615197 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.616418 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:05.617606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] Jul 19 19:45:05.621951 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:05.635093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 400 to user: Security Group 83fb6162-7a93-4d44-89c2-5084a189a463 in use. Jul 19 19:45:05.635093 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-968c5669-52c3-4794-bc06-50d158ba572a'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:05.636494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f52c2e46-b9fd-491b-a8e7-00989f51aaf0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463" status: 400 len: 185 microversion: 2.1 time: 0.727056 Jul 19 19:45:05.641118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 664/1333] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:04 2022] DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463 => generated 185 bytes in 732 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:45:05.647961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-edd4fdb1-1eba-4cfa-ba9b-016ff6e39b0f req-a974265f-8c16-413d-8be3-cca694c9d3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1958f0f5-2790-4617-a12c-d82b0ee0c066", "tag": "f9e18d41-b785-462a-a30d-38f9b5282299"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:05.664232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-edd4fdb1-1eba-4cfa-ba9b-016ff6e39b0f req-a974265f-8c16-413d-8be3-cca694c9d3c5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:05.665933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-edd4fdb1-1eba-4cfa-ba9b-016ff6e39b0f req-a974265f-8c16-413d-8be3-cca694c9d3c5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:05.680217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-edd4fdb1-1eba-4cfa-ba9b-016ff6e39b0f req-a974265f-8c16-413d-8be3-cca694c9d3c5 service nova] Creating event network-changed:f9e18d41-b785-462a-a30d-38f9b5282299 for instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 on n-h2-843834-3 Jul 19 19:45:05.687093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-edd4fdb1-1eba-4cfa-ba9b-016ff6e39b0f req-a974265f-8c16-413d-8be3-cca694c9d3c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043869 Jul 19 19:45:05.688537 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 665/1334] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:05.695472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ad8bf41-9f08-49c9-b309-af4a5a87f75a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Action: 'create', calling method: .version_select at 0x7f23ef9fcdc0>, body: {"keypair": {"name": "tempest-keypair-636491091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWuj0s8Eh81neMzK6VC9fAY30N0XSzw7yUxGrFzFSwxdjlIH6BDYrN7sUYdlf5zwtlTftNgjsA4/Yr+kXj1M4+z3v3XrlyAy0g1IdVplNn3NrfsbTPLRTxFghUgHKL1g=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:05.749749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ad8bf41-9f08-49c9-b309-af4a5a87f75a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Getting quotas for project 7de2997249e341bc845c655354f66909. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:05.757379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ad8bf41-9f08-49c9-b309-af4a5a87f75a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Getting quotas for user b26d4f35890d4ed189dac8851965128f and project 7de2997249e341bc845c655354f66909. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:05.793483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ad8bf41-9f08-49c9-b309-af4a5a87f75a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.101377 Jul 19 19:45:05.795115 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 666/1335] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:45:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:45:05.809720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:05.811029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:05.829141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:05.831007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:05.833127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:05.835175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:05.899879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:06.067332 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-454a3408-debc-43f1-a2f4-29aca6875cce tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 204 len: 0 microversion: 2.1 time: 0.269597 Jul 19 19:45:06.068171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 667/1336] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:05 2022] DELETE /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:06.077717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:06.096861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] [instance: 4e769d2a-f48e-4372-aaa3-8603394d3e55] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:06.125368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.135284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.136221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.136677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.168689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] HTTP exception thrown: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Request method failure captured: Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 HTTP/1.1 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wkJVwW8XjL5PE0E5rDfdAZO7InDcRjhLhfxp7KSUqwMuOqmheX68CC0DqYvyXGQM7FXt-z9YdufVE8kNzdKYIzb-xa8M9MgrTjE-qNLjfAirqh92atGPeHKPmJLntGOhD3QFyZO2nwn9o80D5DycmcP5fNk1hqub0QQkIHmKT3RL64 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:06.170461 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48554aefbc564866bc55a7ef61395374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48554aefbc564866bc55a7ef61395374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48554aefbc564866bc55a7ef61395374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 48554aefbc564866bc55a7ef61395374 Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-374887028 Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: fc74f3b686f74bce88d1ab84828220f3 Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-374887028-project Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:06.171879 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '4e769d2a-f48e-4372-aaa3-8603394d3e55'} Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:06.172647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. Jul 19 19:45:06.176211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.178628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] Returning 404 to user: Instance 4e769d2a-f48e-4372-aaa3-8603394d3e55 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:06.178628 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32471247-1368-4c6e-82d5-6f9cc7cb95af tempest-AttachSCSIVolumeTestJSON-374887028 tempest-AttachSCSIVolumeTestJSON-374887028-project] 10.222.0.23 "GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55" status: 404 len: 111 microversion: 2.1 time: 0.102908 Jul 19 19:45:06.183160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 668/1337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:06 2022] GET /compute/v2.1/servers/4e769d2a-f48e-4372-aaa3-8603394d3e55 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:06.188118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:06.188735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e00c5f64-277f-4358-aace-889f5a135209] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:06.204566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.205046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.205808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.206241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.246887 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] HTTP exception thrown: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Request method failure captured: Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 HTTP/1.1 Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whn-eF1vBE4jYYG48DzjVdRU_eVGp4x6DOQNX9ra8L0QJ7cSJb5CwTIHLLGrP-RcOxX9CqssHV_5UPwohrWQmN-47YTKUjW14bnHZmcqQ3KOrOmq-SNAzcIE0wi1aBAaW27AAA-mc2vwrJM-a556s9OTIiWKatW9VFWXLUb3ESn5bM Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:06.251804 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f2e7f9d9c6ab4b20aa20b98a514bf701 Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. Jul 19 19:45:06.253263 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e00c5f64-277f-4358-aace-889f5a135209'} Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:06.254036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. Jul 19 19:45:06.255289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:06.258036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Returning 404 to user: Instance e00c5f64-277f-4358-aace-889f5a135209 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:06.259176 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bd50da3-3e49-49ad-bb00-1352d14910dd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209" status: 404 len: 111 microversion: 2.1 time: 0.074940 Jul 19 19:45:06.261447 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 669/1338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:06 2022] GET /compute/v2.1/servers/e00c5f64-277f-4358-aace-889f5a135209 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:06.267098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:06.268726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:06.276218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.277123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.278199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.278847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.402148 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-627f49f9-2363-4239-b2e0-1076f949b093 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action" status: 202 len: 0 microversion: 2.1 time: 0.138145 Jul 19 19:45:06.407028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 670/1339] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:06 2022] POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:06.414133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:06.414848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:06.423439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.423804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.425201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.425201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.723488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:06.732030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa294bea-3a81-4eff-ab70-eef5c60a0327 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1316 microversion: 2.1 time: 0.323167 Jul 19 19:45:06.742063 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 671/1340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:06 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:06.818589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:06.819085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:06.819571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:06.820347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:06.821163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:06.823582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:06.824369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:06.831041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.831776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.832771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.833909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.834340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.834831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.836199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:06.837071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:06.879159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:06.886976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for user a15f9dbf22624cb49d4d817fed35e3b5 and project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:06.908253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:06.911345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:07.001266 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9448d63b-f25f-466c-8d99-7576f324b5d7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.160511 Jul 19 19:45:07.002570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 670/1341] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:07.018120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:07.024071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:07.027385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:07.034796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:07.038276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.040359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:07.040756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.041556 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7be1ea00-f1fc-4a30-bc0d-9eb60982842d tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1292 microversion: 2.25 time: 0.298237 Jul 19 19:45:07.052707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.052707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.053114 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 672/1342] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:06 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1292 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:07.053845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-96727330", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "45b415df-4896-4487-90b1-97e9e05cd7c2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:07.123278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:07.156452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] validate_networks() for [('45b415df-4896-4487-90b1-97e9e05cd7c2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:07.312298 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-853bab83-035f-41e5-bdac-3fdc8fb2b500 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 204 len: 0 microversion: 2.1 time: 0.308037 Jul 19 19:45:07.314491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 671/1343] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:07 2022] DELETE /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:07.336085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:07.338891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:07.360404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.363154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.365190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.366111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.697266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:07.709786 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b26e60a3-7fa8-45ee-9627-8d661563abac tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1574 microversion: 2.1 time: 0.387303 Jul 19 19:45:07.710834 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 672/1344] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:07 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1574 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:07.718405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6b2c0f29-0dd3-42db-b624-55c5aeb84db6 req-5ac932f4-e9eb-43ab-a40c-11c7ec284168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c786080-abef-4e8c-8d7e-be521e836f20", "name": "network-vif-unplugged", "status": "completed", "tag": "a4e33570-7425-43c4-89a4-4c2c89cbff1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:07.734134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6b2c0f29-0dd3-42db-b624-55c5aeb84db6 req-5ac932f4-e9eb-43ab-a40c-11c7ec284168 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.736076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6b2c0f29-0dd3-42db-b624-55c5aeb84db6 req-5ac932f4-e9eb-43ab-a40c-11c7ec284168 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.758056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6b2c0f29-0dd3-42db-b624-55c5aeb84db6 req-5ac932f4-e9eb-43ab-a40c-11c7ec284168 service nova] Creating event network-vif-unplugged:a4e33570-7425-43c4-89a4-4c2c89cbff1c for instance 8c786080-abef-4e8c-8d7e-be521e836f20 on n-h2-843834-3 Jul 19 19:45:07.765584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6b2c0f29-0dd3-42db-b624-55c5aeb84db6 req-5ac932f4-e9eb-43ab-a40c-11c7ec284168 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052531 Jul 19 19:45:07.766326 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 673/1345] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:07.777072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:07.779091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:07.786428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.786842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.787730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.788393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.793602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:07.874391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:07.889364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-110a128b-0ae2-4fbb-83e7-748afd118a82 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1214 microversion: 2.1 time: 0.117223 Jul 19 19:45:07.898682 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 674/1346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:07 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:07.905589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:07.906230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:07.914353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.914786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.915810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.916694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.920618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:07.920958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:07.921495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:07.921909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:07.922316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:07.933581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.934029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.934898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:07.935365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:07.962859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:07.969699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Getting quotas for user cf462f1353f342b395e856a1f3cbafb2 and project 2e8830f9585045faa9bf80f94604f7d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:07.986240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:07.989373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:08.043815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d2bbe75-2ae4-443d-abc2-5d249b90a458 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995977 Jul 19 19:45:08.044835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 673/1347] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:08.050194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.050817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.059919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.060406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.061631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.062242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.147478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.162434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-abba3de9-f9a1-4906-a230-d5f292b1aa8b tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1535 microversion: 2.1 time: 0.266307 Jul 19 19:45:08.163852 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 675/1348] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:07 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1535 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:08.170580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}, {"server_uuid": "e00c5f64-277f-4358-aace-889f5a135209", "name": "network-vif-deleted", "tag": "fcbef83d-2bfa-4426-b564-fbac00571a5f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:08.181279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.182139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.204869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] Creating event network-changed:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h2-843834-3 Jul 19 19:45:08.205032 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] Creating event network-vif-deleted:fcbef83d-2bfa-4426-b564-fbac00571a5f for instance e00c5f64-277f-4358-aace-889f5a135209 on n-h1-843834-3 Jul 19 19:45:08.216233 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-109e45e0-552b-4ed4-81ca-e4c85528f2b4 req-9467ad92-34df-49ef-964f-c1b078e0fe9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049670 Jul 19 19:45:08.217264 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 676/1349] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:08.224288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-15352923-663d-4497-a54f-d13e0558b620 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.225224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-15352923-663d-4497-a54f-d13e0558b620 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.239713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.257582 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5ec5e16d-62a7-4040-b361-fee11a360d98 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1466 microversion: 2.1 time: 0.211379 Jul 19 19:45:08.269088 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 674/1350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:08.274541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.275392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.283518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.284332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.285357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.285871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.292636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-15352923-663d-4497-a54f-d13e0558b620 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.306905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-15352923-663d-4497-a54f-d13e0558b620 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1206 microversion: 2.1 time: 0.084890 Jul 19 19:45:08.307759 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 677/1351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1206 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:08.326838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.327471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.354117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.354946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.363661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.364141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.561895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.576845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.578369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:08.583580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ee4b387-d8ef-4f0e-8a66-47647c6e823f tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1292 microversion: 2.25 time: 0.312988 Jul 19 19:45:08.584188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 675/1352] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1292 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:08.692898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d599637d-e5fa-4bbb-9f6d-5e5c7f5cb610 tempest-ServersOnMultiNodesTest-943170342 tempest-ServersOnMultiNodesTest-943170342-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1617 microversion: 2.1 time: 0.369706 Jul 19 19:45:08.693504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 678/1353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1617 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:08.712321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.712952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.720993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.722243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.723298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.724134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.728658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.729741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.736094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:08.740647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.741119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.742211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.742782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.763233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:08.864017 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6121e6e3-ea94-4892-8832-1e968c1bf388 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 204 len: 0 microversion: 2.1 time: 0.156177 Jul 19 19:45:08.865329 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 676/1354] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:08 2022] DELETE /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:08.875459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:08.876822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:08.884831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.885427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:08.886232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:08.886723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.151424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:09.159877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de7ed954-7af2-4e69-8870-2fe7207b8658 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1574 microversion: 2.1 time: 0.437148 Jul 19 19:45:09.161370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 679/1355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1574 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:09.166264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:09.166857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:09.174432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.175023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.175824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.176509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.261825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:09.271808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ff8864c-3d55-41b2-a68a-2a38dd882995 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1472 microversion: 2.1 time: 0.402283 Jul 19 19:45:09.283022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:09.283565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 677/1356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:08 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:09.288689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:09.289533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:09.297708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.298156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.299080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.299509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.300038 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c6c7e595-2489-4ed0-9598-2585637e080a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1268 microversion: 2.1 time: 0.137586 Jul 19 19:45:09.300904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 680/1357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:09 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:09.324598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:09.326756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:09.342859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.343667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.345235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.345740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.428556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:09.440705 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0537b2bf-4d51-4daa-9eb4-7cead6fbb3a3 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1202 microversion: 2.1 time: 0.120035 Jul 19 19:45:09.451901 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 681/1358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:09 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1202 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:45:09.531112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:09.536358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:09.554429 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4c29e814-cd22-42c8-9bf3-3c330585d80e tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 200 len: 1535 microversion: 2.1 time: 0.269414 Jul 19 19:45:09.557946 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 678/1359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:09 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:09.583584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-508471860", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "53df4652-4f34-47ec-93da-cbc19ac15845"}, {"port": "7168f45a-88d6-4b33-8b84-0152aeee34d0", "tag": "port-1"}, {"port": "b2de3852-6a7d-42da-8fb1-52ee4948ff67", "tag": "port-2"}, {"uuid": "edb7d78e-b34b-4b70-9e4d-d21ac07bd280", "tag": "net-1"}, {"uuid": "edb7d78e-b34b-4b70-9e4d-d21ac07bd280"}, {"uuid": "3f3720c4-bd04-4093-9f89-f24e9109d2f7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3f3720c4-bd04-4093-9f89-f24e9109d2f7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d4201846-452c-4c75-8cfe-8419817b5af4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aeeea3dc-1b67-410c-b09f-11c40d335eff", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6fc43b76-2558-4f7e-9379-855cef16aadd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1456986427"}], "key_name": "tempest-keypair-636491091", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:09.607349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:09.608025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:09.618173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.618624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.620150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:09.620607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:09.943603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] validate_networks() for [('53df4652-4f34-47ec-93da-cbc19ac15845', None, None, None, None, None), (None, None, '7168f45a-88d6-4b33-8b84-0152aeee34d0', None, None, None), (None, None, 'b2de3852-6a7d-42da-8fb1-52ee4948ff67', None, None, None), ('edb7d78e-b34b-4b70-9e4d-d21ac07bd280', None, None, None, None, None), ('edb7d78e-b34b-4b70-9e4d-d21ac07bd280', None, None, None, None, None), ('3f3720c4-bd04-4093-9f89-f24e9109d2f7', '10.2.2.100', None, None, None, None), ('3f3720c4-bd04-4093-9f89-f24e9109d2f7', '10.2.2.200', None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:10.150155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:10.159477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:10.160995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:10.162139 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77e2140e-155b-4593-bfa1-ed28898f2b38 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.558958 Jul 19 19:45:10.162709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 679/1360] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:09 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:45:10.177836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:10.178455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:10.194689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:10.195172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:10.195986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:10.196428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:11.509597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:11.518325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86768e84-9d5a-4913-a209-74b87df7dee6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1574 microversion: 2.1 time: 1.344293 Jul 19 19:45:11.529504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 680/1361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:10 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1574 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:11.535231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:11.536084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:11.543954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:11.544711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:11.545759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:11.546347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:12.339773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:12.353602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7f3d4d9b-3c14-4355-b6d6-5cd338253a93 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 200 len: 1472 microversion: 2.1 time: 0.822072 Jul 19 19:45:12.373189 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 681/1362] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:11 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 1472 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:12.388152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:12.389133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:12.403771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:12.404165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:12.405046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:12.408725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.088066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:13.096693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-204bc8f9-81b7-4d0c-a443-905a4eff2fc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.722289 Jul 19 19:45:13.097287 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 682/1363] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:12 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:13.105118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:13.106520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:13.115332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.115789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.116849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.117405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.360371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:13.374052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2f4ba17-a479-424d-99b3-61aaa0190f1e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1264 microversion: 2.1 time: 0.274757 Jul 19 19:45:13.374650 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 683/1364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:13 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1264 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:13.384262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:13.385179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: e432da26-c067-498f-b73f-b1f6592283dd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:13.397788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.402043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.403624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.407675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.432139 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] HTTP exception thrown: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Request method failure captured: Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd HTTP/1.1 Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whn-eF1vBE4jYYG48DzjVdRU_eVGp4x6DOQNX9ra8L0QJ7cSJb5CwTIHLLGrP-RcOxX9CqssHV_5UPwohrWQmN-47YTKUjW14bnHZmcqQ3KOrOmq-SNAzcIE0wi1aBAaW27AAA-mc2vwrJM-a556s9OTIiWKatW9VFWXLUb3ESn5bM Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:13.434165 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f2e7f9d9c6ab4b20aa20b98a514bf701 Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. Jul 19 19:45:13.435925 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e432da26-c067-498f-b73f-b1f6592283dd'} Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:13.436859 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. Jul 19 19:45:13.438328 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:13.440853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Returning 404 to user: Instance e432da26-c067-498f-b73f-b1f6592283dd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:13.442021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-99c0d6b7-edf0-49c9-87fe-db4b102a8f80 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd" status: 404 len: 111 microversion: 2.1 time: 0.066211 Jul 19 19:45:13.449810 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 684/1365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:13 2022] GET /compute/v2.1/servers/e432da26-c067-498f-b73f-b1f6592283dd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:13.533633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-48fa4cbb-316f-4f7b-8e1a-2e867e8757bf req-4f2d9c83-65cd-4175-aa0a-5de92a1460bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432da26-c067-498f-b73f-b1f6592283dd", "name": "network-vif-deleted", "tag": "6db41234-67c5-489e-b355-7327b6995257"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:13.545770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-48fa4cbb-316f-4f7b-8e1a-2e867e8757bf req-4f2d9c83-65cd-4175-aa0a-5de92a1460bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.546422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-48fa4cbb-316f-4f7b-8e1a-2e867e8757bf req-4f2d9c83-65cd-4175-aa0a-5de92a1460bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.572660 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-48fa4cbb-316f-4f7b-8e1a-2e867e8757bf req-4f2d9c83-65cd-4175-aa0a-5de92a1460bc service nova] Creating event network-vif-deleted:6db41234-67c5-489e-b355-7327b6995257 for instance e432da26-c067-498f-b73f-b1f6592283dd on n-h2-843834-3 Jul 19 19:45:13.579928 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-48fa4cbb-316f-4f7b-8e1a-2e867e8757bf req-4f2d9c83-65cd-4175-aa0a-5de92a1460bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128386 Jul 19 19:45:13.584707 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 685/1366] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:13.596811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:13.597518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:13.624404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.625991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:13.628835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:13.629509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.383153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:14.395316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:14.397295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:14.398821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-086be3b1-abf5-4d56-b3e3-983a72c63230 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.812681 Jul 19 19:45:14.409294 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 686/1367] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:13 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:14.415598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:14.416522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:14.426542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:14.427310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.428310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:14.429171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.879315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:14.889600 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92d61e93-5946-4b29-9a17-e7f3c18f8d79 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1572 microversion: 2.1 time: 0.478769 Jul 19 19:45:14.891204 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 687/1368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:14 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1572 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:14.897345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d85a7e9c-cbce-4cbd-95c2-b94edd449a82 req-c826ef38-d937-41d1-b107-490836d6def4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c786080-abef-4e8c-8d7e-be521e836f20", "name": "network-vif-deleted", "tag": "a4e33570-7425-43c4-89a4-4c2c89cbff1c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:14.907802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d85a7e9c-cbce-4cbd-95c2-b94edd449a82 req-c826ef38-d937-41d1-b107-490836d6def4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:14.908458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d85a7e9c-cbce-4cbd-95c2-b94edd449a82 req-c826ef38-d937-41d1-b107-490836d6def4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.924291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d85a7e9c-cbce-4cbd-95c2-b94edd449a82 req-c826ef38-d937-41d1-b107-490836d6def4 service nova] Creating event network-vif-deleted:a4e33570-7425-43c4-89a4-4c2c89cbff1c for instance 8c786080-abef-4e8c-8d7e-be521e836f20 on n-h2-843834-3 Jul 19 19:45:14.930052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d85a7e9c-cbce-4cbd-95c2-b94edd449a82 req-c826ef38-d937-41d1-b107-490836d6def4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036269 Jul 19 19:45:14.931869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 688/1369] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:14.939133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:14.942948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 0b841a34-7fad-4080-962a-dc22909dec8a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:14.951637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:14.952116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.953295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:14.953734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:14.987675 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a HTTP/1.1 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:14.997124 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. Jul 19 19:45:15.002807 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0b841a34-7fad-4080-962a-dc22909dec8a'} Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:15.005553 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. Jul 19 19:45:15.009992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:15.015267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 0b841a34-7fad-4080-962a-dc22909dec8a could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:15.016429 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51725b4a-3298-40bf-a8a0-98140f02e042 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a" status: 404 len: 111 microversion: 2.1 time: 0.083269 Jul 19 19:45:15.018565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 689/1370] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:14 2022] GET /compute/v2.1/servers/0b841a34-7fad-4080-962a-dc22909dec8a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:15.027466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:15.029537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:15.039232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.040205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:15.041575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.042243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:15.086321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:15.193043 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c3e5c32-be92-4774-997f-fa5dfbdf14bd tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 204 len: 0 microversion: 2.1 time: 0.172198 Jul 19 19:45:15.197243 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 690/1371] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:15 2022] DELETE /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:15.204209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:15.205069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:15.212902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.212902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:15.214109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.214438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:15.808860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:15.817660 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-79541c4c-16e0-4842-8192-2fa6af9674ff tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.618591 Jul 19 19:45:15.818253 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 691/1372] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:15 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:15.823055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:15.823876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:15.830588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.831222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:15.832174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:15.832447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:16.281046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:16.289074 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-39cd019d-82b8-4867-9d41-f13e5920cf64 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.469591 Jul 19 19:45:16.289764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 692/1373] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:15 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:16.294337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2015673188"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:16.294863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:16.297007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:16.303130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:16.303650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:16.304492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:16.304990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:16.856675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:17.210781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Adding security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 to port f9e18d41-b785-462a-a30d-38f9b5282299 Jul 19 19:45:17.947616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:17.981230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:18.297370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:18.556788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:18.557476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:18.558107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:18.559895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:18.560924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:18.582348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:18.583058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:18.584062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:18.584711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:18.667492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Getting quotas for project 7de2997249e341bc845c655354f66909. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:18.681328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Getting quotas for user b26d4f35890d4ed189dac8851965128f and project 7de2997249e341bc845c655354f66909. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:18.803755 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5ebea769-4d78-4c92-af93-9dca3d276b56 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action" status: 202 len: 0 microversion: 2.1 time: 2.512882 Jul 19 19:45:18.805384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 693/1374] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:16 2022] POST /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066/action => generated 0 bytes in 2515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:18.812944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:18.815361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:18.830256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:18.831755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:18.832687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:18.833912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:18.886903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:19.062333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:19.068109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d4201846-452c-4c75-8cfe-8419817b5af4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aeeea3dc-1b67-410c-b09f-11c40d335eff',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6fc43b76-2558-4f7e-9379-855cef16aadd',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:19.077595 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58d3e21b-8c62-4f4e-a7c8-f88d2c1b4ab7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 204 len: 0 microversion: 2.1 time: 0.270781 Jul 19 19:45:19.078186 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 694/1375] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:18 2022] DELETE /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:19.097206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:19.097920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:19.130624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.131669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.132842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.133684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.178471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:19.259457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:19.268756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65e062d4-4522-4bb6-814f-4e725fa613ae tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 200 len: 1426 microversion: 2.1 time: 0.183158 Jul 19 19:45:19.279560 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 695/1376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:19 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 1426 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:19.285646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:19.286525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:19.293818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.294562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.295642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.296319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.470620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:19.480234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:19.482184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:19.483863 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-622107e7-b357-4b4e-9477-41298e1b0c0e tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.202982 Jul 19 19:45:19.484909 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 696/1377] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:19 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:19.503342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:19.503975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:19.514460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.515305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.516429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.517680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.691597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7b5e5bab-758b-48f7-ae76-ab278c3e31e4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.109468 Jul 19 19:45:19.696368 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 682/1378] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Jul 19 19:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 10118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:45:19.716389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b841a34-7fad-4080-962a-dc22909dec8a", "name": "network-vif-deleted", "tag": "ad38764b-1549-449f-b02b-291200da3f53"}, {"name": "network-changed", "server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:19.728192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:19.736999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50abb973-aa53-4e46-b209-51c7d3c96b25 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.250875 Jul 19 19:45:19.748399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.749138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.760103 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 697/1379] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:19 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:19.767770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:19.769742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:19.771322 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] Creating event network-vif-deleted:ad38764b-1549-449f-b02b-291200da3f53 for instance 0b841a34-7fad-4080-962a-dc22909dec8a on n-h1-843834-3 Jul 19 19:45:19.772148 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] Creating event network-changed:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h1-843834-3 Jul 19 19:45:19.776406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.776968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.778560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:19.779416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:19.781914 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-afa60c83-6e44-4f5f-bdc6-742fc4282158 req-2f07761b-83d4-4c79-ad5e-7004c41dfd6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077562 Jul 19 19:45:19.787632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 683/1380] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:19.799458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef4eaa60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.185280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:20.193962 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98129d51-b4be-4b58-8563-f288d0273e22 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.432310 Jul 19 19:45:20.195055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 698/1381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:19 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:20.196128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use.", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:20.197031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.197031 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680 HTTP/1.1 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:20.199055 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: exception: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.200719 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b1772ab0-1a11-4c3e-9a12-29bf25bf2680'} Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:20.201847 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.203377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.204724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] Jul 19 19:45:20.206268 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.207391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 400 to user: Security Group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 in use. Jul 19 19:45:20.207391 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f85db739-a897-4a9d-897e-852b2e8b633e'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:20.208469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f97210c-d4d8-4331-bed9-4e8f0552164a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680" status: 400 len: 185 microversion: 2.1 time: 0.417512 Jul 19 19:45:20.212487 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 684/1382] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:19 2022] DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680 => generated 185 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:45:20.218218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.219034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.224152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.225355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.233579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.234652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.235687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.236366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.345942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:20.355486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:20.370628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:20.377946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc3ce094-d4e8-4b53-820d-a5084e28c0e7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1284 microversion: 2.42 time: 0.164003 Jul 19 19:45:20.385260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 685/1383] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:20 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:20.394671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.395205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.407272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.407996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.409518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.410415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.451083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:20.589293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ee9b67d-2a56-4f4e-8866-c89b6fd827d1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 204 len: 0 microversion: 2.1 time: 0.201283 Jul 19 19:45:20.591298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 686/1384] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:20 2022] DELETE /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:20.613059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.613816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: 99ed56a7-e411-444c-b8bd-257d3c0635b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.639719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.640194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.641018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.641551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.662458 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] HTTP exception thrown: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Request method failure captured: Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 HTTP/1.1 Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1whn-eF1vBE4jYYG48DzjVdRU_eVGp4x6DOQNX9ra8L0QJ7cSJb5CwTIHLLGrP-RcOxX9CqssHV_5UPwohrWQmN-47YTKUjW14bnHZmcqQ3KOrOmq-SNAzcIE0wi1aBAaW27AAA-mc2vwrJM-a556s9OTIiWKatW9VFWXLUb3ESn5bM Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:20.669301 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f2e7f9d9c6ab4b20aa20b98a514bf701 Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. Jul 19 19:45:20.671172 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '99ed56a7-e411-444c-b8bd-257d3c0635b8'} Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:20.672216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. Jul 19 19:45:20.673736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:20.675628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Returning 404 to user: Instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:20.675628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e1c4dc9-b9be-49cb-bd61-20a8fa12a0c2 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8" status: 404 len: 111 microversion: 2.1 time: 0.077350 Jul 19 19:45:20.681112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 687/1385] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:20 2022] GET /compute/v2.1/servers/99ed56a7-e411-444c-b8bd-257d3c0635b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:20.687317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.688457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.696927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.697510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.698404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.698868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.789582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:20.800496 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f6c9c094-c114-4ad3-8865-fd28bda3d970 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1472 microversion: 2.1 time: 0.604122 Jul 19 19:45:20.801473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 699/1386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:20 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:20.810207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:20.810942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:20.822855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.824711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:20.826499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:20.831618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.067273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.077607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.081209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.082397 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a530765-ff95-470b-98c6-6674fcdabcb6 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.403517 Jul 19 19:45:21.082991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 688/1387] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:20 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:21.089747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.090434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.097492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.098149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.098989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.099456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.128438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:21.223134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce5059fe-39a5-4c1d-8331-53483fe4d0c5 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 204 len: 0 microversion: 2.1 time: 0.136246 Jul 19 19:45:21.224250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 689/1388] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:21 2022] DELETE /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:21.229924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.230330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.230816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.237814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.238263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.238439 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5564915f-161b-4366-ac95-a32be7cace97 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1647 microversion: 2.1 time: 0.433968 Jul 19 19:45:21.239203 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 700/1389] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:20 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1647 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:21.239408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.239913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.248707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b08b1eb1-9c51-486a-984e-ead54fbe62fa req-d349ec55-855a-4277-8558-08425fa974e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "name": "network-vif-plugged", "status": "completed", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:21.257197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b08b1eb1-9c51-486a-984e-ead54fbe62fa req-d349ec55-855a-4277-8558-08425fa974e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.257896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b08b1eb1-9c51-486a-984e-ead54fbe62fa req-d349ec55-855a-4277-8558-08425fa974e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.270217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b08b1eb1-9c51-486a-984e-ead54fbe62fa req-d349ec55-855a-4277-8558-08425fa974e6 service nova] Creating event network-vif-plugged:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h2-843834-3 Jul 19 19:45:21.275114 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b08b1eb1-9c51-486a-984e-ead54fbe62fa req-d349ec55-855a-4277-8558-08425fa974e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Jul 19 19:45:21.275718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 701/1390] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:21.280761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.281387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.287664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.288121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.288911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.289352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.427049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.435528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba7512a5-d5bd-4a50-9f69-64054bb5ea97 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.209907 Jul 19 19:45:21.436189 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 690/1391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:21 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:21.449167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.449779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.456187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.456671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.457439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.457749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.457924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.467867 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d30aef82-cb01-49fb-a3a0-2106f6d32f1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.190617 Jul 19 19:45:21.468804 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 702/1392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:21 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:21.474750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.475574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.482579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.483026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.483860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.484332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.600285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.609246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.610749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.612085 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de7d38d2-e0be-4375-a127-6f7eee64f0a7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1574 microversion: 2.42 time: 0.141961 Jul 19 19:45:21.612796 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 703/1393] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:21 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:21.615463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:21.626032 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2dad133-8f28-4171-933f-499bd7b8dea0 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1467 microversion: 2.1 time: 0.188899 Jul 19 19:45:21.626648 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 691/1394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:21 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1467 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:21.818528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717007ee-8203-4588-ba1e-0ecee45479b4", "tag": "e54f6190-4815-4ddf-a7a3-bf84caee46d5"}, {"name": "network-changed", "server_uuid": "1958f0f5-2790-4617-a12c-d82b0ee0c066", "tag": "f9e18d41-b785-462a-a30d-38f9b5282299"}, {"server_uuid": "99ed56a7-e411-444c-b8bd-257d3c0635b8", "name": "network-vif-deleted", "tag": "87356a3c-a454-4ef6-8c68-94d32b4efd9d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:21.819839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:21.820583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:21.829349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.829624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.830227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.830583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.831314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:21.831697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:21.845764 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Creating event network-changed:e54f6190-4815-4ddf-a7a3-bf84caee46d5 for instance 717007ee-8203-4588-ba1e-0ecee45479b4 on n-h2-843834-3 Jul 19 19:45:21.846529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Creating event network-changed:f9e18d41-b785-462a-a30d-38f9b5282299 for instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 on n-h2-843834-3 Jul 19 19:45:21.847046 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] Creating event network-vif-deleted:87356a3c-a454-4ef6-8c68-94d32b4efd9d for instance 99ed56a7-e411-444c-b8bd-257d3c0635b8 on n-h1-843834-3 Jul 19 19:45:21.857843 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-667f108d-91c7-46ef-bacf-f167db55e6d4 req-6082b201-0c0a-482a-b390-0e74a741ed24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.043053 Jul 19 19:45:21.858466 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 692/1395] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:22.101622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:22.102641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:22.110215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.111013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:22.112292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.112963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:22.424507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:22.433074 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8de61559-a5c0-4b05-b3ec-efbd4f08d0ed tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 200 len: 1472 microversion: 2.1 time: 0.618600 Jul 19 19:45:22.434322 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 704/1396] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:21 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 1472 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:22.448696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:22.461825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:22.469526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.469988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:22.470783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.471282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:22.491895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:22.496100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:22.530353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:22.531925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:22.533286 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6983d035-d8c5-4635-b170-dda5f4dffb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.436282 Jul 19 19:45:22.543349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 693/1397] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:22 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:22.553104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:22.553923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:22.563025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.563803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:22.564555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:22.565656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:23.210205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:23.224843 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a1bfeb4-c82a-4f37-a93c-6b229323ac40 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.680023 Jul 19 19:45:23.225463 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 694/1398] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:22 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:23.238497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:23.238497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:23.254777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:23.255311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:23.256160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:23.256609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:23.269101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:23.313431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70655464-a977-40a7-80f8-d3e7756a69a6 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 200 len: 1647 microversion: 2.1 time: 0.877569 Jul 19 19:45:23.322247 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 705/1399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:22 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 1647 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:23.336830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-47f89ee6-8106-4271-bebb-72c9c252e59b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef805700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:23.417198 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-47f89ee6-8106-4271-bebb-72c9c252e59b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced" status: 200 len: 662 microversion: 2.1 time: 0.093720 Jul 19 19:45:23.424080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 706/1400] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:23 2022] GET /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:23.446800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:23.448741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:23.492888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:23.493353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:23.494167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:23.494604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.233066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:24.245265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:24.246750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:24.247965 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7840ea8b-706a-464b-adf1-133f8992eb9e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1592 microversion: 2.42 time: 0.820187 Jul 19 19:45:24.248558 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 707/1401] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:23 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1592 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:24.268499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:24.269419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:24.282745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.283579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.284384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.284927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.492834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:24.502997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-06d90e38-6f39-4db5-9c74-6fad0076354e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 1.276235 Jul 19 19:45:24.504451 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 695/1402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:23 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:24.509673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a1f81af-20cd-49f9-a503-b9583777a425 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef512e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:24.589013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a1f81af-20cd-49f9-a503-b9583777a425 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced" status: 200 len: 662 microversion: 2.1 time: 0.082994 Jul 19 19:45:24.589915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 696/1403] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:24 2022] GET /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:24.618210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:24.621494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 82c7e3a8-d242-45e3-9105-43160d24ce39] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:24.646895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.656300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.658021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.663648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.683850 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 HTTP/1.1 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:24.686713 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. Jul 19 19:45:24.688458 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '82c7e3a8-d242-45e3-9105-43160d24ce39'} Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:24.689375 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. Jul 19 19:45:24.691209 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:24.693671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 82c7e3a8-d242-45e3-9105-43160d24ce39 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:24.694811 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85769971-4a4d-4958-bc08-ac1a2655ed2f tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39" status: 404 len: 111 microversion: 2.1 time: 0.096115 Jul 19 19:45:24.695928 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 697/1404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:24 2022] GET /compute/v2.1/servers/82c7e3a8-d242-45e3-9105-43160d24ce39 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:24.705904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:24.706725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:24.716871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.721022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.722039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.722641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.734337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f9d9c6ab4b20aa20b98a514bf701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1325aa577da423abdfc6ef7f1d6995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:24.743498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d485b825-c16d-4ba8-88b5-caf93d1b2a30 tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 200 len: 1467 microversion: 2.1 time: 0.487267 Jul 19 19:45:24.744140 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 708/1405] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:24 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 1467 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:24.759746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a7f3fe93-9282-4eeb-a497-82f96eff8795 req-a127a6e9-a168-4cba-8e52-9d0e7dd51825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1958f0f5-2790-4617-a12c-d82b0ee0c066", "name": "network-vif-deleted", "tag": "f9e18d41-b785-462a-a30d-38f9b5282299"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:24.774066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a7f3fe93-9282-4eeb-a497-82f96eff8795 req-a127a6e9-a168-4cba-8e52-9d0e7dd51825 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.774547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a7f3fe93-9282-4eeb-a497-82f96eff8795 req-a127a6e9-a168-4cba-8e52-9d0e7dd51825 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.789498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a7f3fe93-9282-4eeb-a497-82f96eff8795 req-a127a6e9-a168-4cba-8e52-9d0e7dd51825 service nova] Creating event network-vif-deleted:f9e18d41-b785-462a-a30d-38f9b5282299 for instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 on n-h2-843834-3 Jul 19 19:45:24.795710 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a7f3fe93-9282-4eeb-a497-82f96eff8795 req-a127a6e9-a168-4cba-8e52-9d0e7dd51825 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041200 Jul 19 19:45:24.797500 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 709/1406] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:24.803433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0ee62182-a88d-498d-8afa-b04f85057298 req-c1c9a01e-26a5-4b2e-8326-6c56db672c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c7e3a8-d242-45e3-9105-43160d24ce39", "name": "network-vif-deleted", "tag": "fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:24.813082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0ee62182-a88d-498d-8afa-b04f85057298 req-c1c9a01e-26a5-4b2e-8326-6c56db672c36 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.813525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0ee62182-a88d-498d-8afa-b04f85057298 req-c1c9a01e-26a5-4b2e-8326-6c56db672c36 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.829867 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0ee62182-a88d-498d-8afa-b04f85057298 req-c1c9a01e-26a5-4b2e-8326-6c56db672c36 service nova] Creating event network-vif-deleted:fa6dc80f-d7fc-4a0a-bb16-ae691213ab0e for instance 82c7e3a8-d242-45e3-9105-43160d24ce39 on n-h2-843834-3 Jul 19 19:45:24.836322 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0ee62182-a88d-498d-8afa-b04f85057298 req-c1c9a01e-26a5-4b2e-8326-6c56db672c36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Jul 19 19:45:24.838591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 710/1407] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:24.846391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:24.847154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:24.854805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.855494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:24.856339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:24.856778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.297871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.310373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.319305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.321072 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c64630a-5cd7-42db-83b3-01566db04f12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1280 microversion: 2.25 time: 0.623933 Jul 19 19:45:25.323048 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 698/1408] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:24 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1280 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:25.331581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:25.337315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:25.344988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.345867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.346944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.347461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.363234 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 HTTP/1.1 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:25.365231 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:25.366694 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1958f0f5-2790-4617-a12c-d82b0ee0c066'} Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:25.367844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:25.369109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:25.371818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:25.372948 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f25c7e74-5104-4468-89c2-b1bb68d71358 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 404 len: 111 microversion: 2.1 time: 0.048899 Jul 19 19:45:25.373876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 699/1409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:25 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:25.374751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.382452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7050f5b5-5042-4bb9-9f25-c46da78e896d req-adc750d6-2d00-4e40-8155-ccd60b8817e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "name": "network-vif-plugged", "status": "completed", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:25.391727 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce16fd2c-9056-405d-80f8-1ad6bd0b2f7c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1310 microversion: 2.1 time: 0.551536 Jul 19 19:45:25.392314 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 711/1410] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:24 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1310 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:25.401097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:25.402125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:25.403034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7050f5b5-5042-4bb9-9f25-c46da78e896d req-adc750d6-2d00-4e40-8155-ccd60b8817e1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.403775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7050f5b5-5042-4bb9-9f25-c46da78e896d req-adc750d6-2d00-4e40-8155-ccd60b8817e1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.417542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.419508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.421801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.422674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.435878 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7050f5b5-5042-4bb9-9f25-c46da78e896d req-adc750d6-2d00-4e40-8155-ccd60b8817e1 service nova] Creating event network-vif-plugged:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h1-843834-3 Jul 19 19:45:25.448194 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7050f5b5-5042-4bb9-9f25-c46da78e896d req-adc750d6-2d00-4e40-8155-ccd60b8817e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072263 Jul 19 19:45:25.462199 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 700/1411] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:25.475402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:25.478950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:25.492433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.494646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:25.495534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.499015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.499720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.714409 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dccc50c8-bc58-4bf9-97b3-393d2294659e tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 204 len: 0 microversion: 2.1 time: 0.320622 Jul 19 19:45:25.715032 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 712/1412] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:25 2022] DELETE /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:25.723926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ee4227b-1699-453c-a84f-2b4c1da512a2 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef5d31f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:25.791112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.824666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.826993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:25.829280 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1ae8581-db8e-4f9f-87c5-84a94a3a1aa0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1592 microversion: 2.42 time: 0.364927 Jul 19 19:45:25.831393 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 701/1413] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:25 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1592 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:25.839631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:25.840523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:25.849393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.850128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:25.853042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:25.855617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.229600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:26.241938 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b4cc22d-d324-4f42-b4a9-6e645d2b0be7 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.409067 Jul 19 19:45:26.251544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 702/1414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:25 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:26.256432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:26.257054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:26.263822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.264282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.265067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.265502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.316926 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ee4227b-1699-453c-a84f-2b4c1da512a2 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463" status: 202 len: 0 microversion: 2.1 time: 0.600048 Jul 19 19:45:26.318098 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 713/1415] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:25 2022] DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:26.324593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:26.325658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] [instance: bc02e141-d945-4ebf-bbd1-cbc57b3325f5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:26.335439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.336247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.337633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.338295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.344717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:26.362598 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] HTTP exception thrown: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Request method failure captured: Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 HTTP/1.1 Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1whn-eF1vBE4jYYG48DzjVdRU_eVGp4x6DOQNX9ra8L0QJ7cSJb5CwTIHLLGrP-RcOxX9CqssHV_5UPwohrWQmN-47YTKUjW14bnHZmcqQ3KOrOmq-SNAzcIE0wi1aBAaW27AAA-mc2vwrJM-a556s9OTIiWKatW9VFWXLUb3ESn5bM Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:26.365831 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b1325aa577da423abdfc6ef7f1d6995d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: b1325aa577da423abdfc6ef7f1d6995d Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MigrationsAdminTest-2115400133 Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f2e7f9d9c6ab4b20aa20b98a514bf701 Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MigrationsAdminTest-2115400133-project Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. Jul 19 19:45:26.367237 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'bc02e141-d945-4ebf-bbd1-cbc57b3325f5'} Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:26.368022 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. Jul 19 19:45:26.369247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:26.373074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] Returning 404 to user: Instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:26.374247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8ea989f-aa11-4754-8732-db1d4e1afb0f tempest-MigrationsAdminTest-2115400133 tempest-MigrationsAdminTest-2115400133-project] 10.222.0.23 "GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5" status: 404 len: 111 microversion: 2.1 time: 0.054407 Jul 19 19:45:26.375784 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 714/1416] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:26 2022] GET /compute/v2.1/servers/bc02e141-d945-4ebf-bbd1-cbc57b3325f5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:26.387446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b37f98c7-36e7-4510-9919-e7c9b2de862c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef6220d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:26.477124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b37f98c7-36e7-4510-9919-e7c9b2de862c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b" status: 200 len: 662 microversion: 2.1 time: 0.099899 Jul 19 19:45:26.478097 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 715/1417] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:26 2022] GET /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:26.490960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee47a56b-5653-4007-afe8-fd1a24d10226 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef6564c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:26.642995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:26.655673 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7cbe05c-251d-4518-aadd-1f0b97124a2a tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1473 microversion: 2.1 time: 0.401920 Jul 19 19:45:26.656305 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 703/1418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:26 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:26.663663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:26.664598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:26.674684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.675835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:26.677081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:26.677933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.276861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:27.290140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:27.291718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:27.292969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72cfab0d-6237-457b-b8ff-9e68982166bf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1475 microversion: 2.25 time: 0.635257 Jul 19 19:45:27.293555 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 704/1419] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:26 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1475 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:27.298937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.299773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:27.307920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.308631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.309640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.310250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.327449 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee47a56b-5653-4007-afe8-fd1a24d10226 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680" status: 202 len: 0 microversion: 2.1 time: 0.847422 Jul 19 19:45:27.328346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 716/1420] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:26 2022] DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680 => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:27.336126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8940432-1653-4cbe-907e-9f2736f50242 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef662d30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.400577 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8940432-1653-4cbe-907e-9f2736f50242 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b" status: 200 len: 662 microversion: 2.1 time: 0.070648 Jul 19 19:45:27.401159 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 717/1421] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:27.422571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:27.428721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:27.446137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.448193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:27.449285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:27.449976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.172781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:28.184463 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cd4dbe7-4fbe-41e9-a9c1-55fb9e678e2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1493 microversion: 2.1 time: 0.889190 Jul 19 19:45:28.185803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 705/1422] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1493 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:28.191326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0d6b977f-bc4d-42d8-beec-05edb5a10861 req-648373e8-5e9d-4cd3-af9e-38a0e10de59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e141-d945-4ebf-bbd1-cbc57b3325f5", "name": "network-vif-deleted", "tag": "9f4eba53-a459-4dcc-bce1-0662e517df33"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:28.203316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d6b977f-bc4d-42d8-beec-05edb5a10861 req-648373e8-5e9d-4cd3-af9e-38a0e10de59a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.204137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d6b977f-bc4d-42d8-beec-05edb5a10861 req-648373e8-5e9d-4cd3-af9e-38a0e10de59a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.221105 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0d6b977f-bc4d-42d8-beec-05edb5a10861 req-648373e8-5e9d-4cd3-af9e-38a0e10de59a service nova] Creating event network-vif-deleted:9f4eba53-a459-4dcc-bce1-0662e517df33 for instance bc02e141-d945-4ebf-bbd1-cbc57b3325f5 on n-h1-843834-3 Jul 19 19:45:28.221305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:28.230212 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0d6b977f-bc4d-42d8-beec-05edb5a10861 req-648373e8-5e9d-4cd3-af9e-38a0e10de59a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042481 Jul 19 19:45:28.232308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:28.232525 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 706/1423] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:28.234286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:28.236038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b7de224-8db8-4e88-a16e-dbae31ce274d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1660 microversion: 2.42 time: 0.833441 Jul 19 19:45:28.237108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 718/1424] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:27 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1660 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:28.252803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.256872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:28.275474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.278763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.280645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.281951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.550177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:28.551075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:28.558849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.562776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.568347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:28.570996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:28.644355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:28.735244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:28.750278 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe17b9cf-8ead-418e-ac2d-9082c620c232 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.516067 Jul 19 19:45:28.753473 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 707/1425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:28.765593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-041f5e11-6e5d-4711-853b-5c2d3b030327 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'create', calling method: .version_select at 0x7f23ef48ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1342650648", "description": "tempest-description-2079676984"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:29.038054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 77e26a50-74b8-4607-acbc-7c2346753274 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:45:29.089428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6631c9a-fcab-41df-86ad-58bbae180c1f tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1967 microversion: 2.25 time: 0.836949 Jul 19 19:45:29.090031 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 719/1426] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:28 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1967 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:29.103758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a9f2d388-a09e-4834-95a6-f00d4ad77951 req-b245988a-e21b-43dd-9c97-ce540e1e25ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717007ee-8203-4588-ba1e-0ecee45479b4", "name": "network-vif-plugged", "status": "completed", "tag": "e54f6190-4815-4ddf-a7a3-bf84caee46d5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:29.116851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a9f2d388-a09e-4834-95a6-f00d4ad77951 req-b245988a-e21b-43dd-9c97-ce540e1e25ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.117306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a9f2d388-a09e-4834-95a6-f00d4ad77951 req-b245988a-e21b-43dd-9c97-ce540e1e25ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.145708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a9f2d388-a09e-4834-95a6-f00d4ad77951 req-b245988a-e21b-43dd-9c97-ce540e1e25ea service nova] Creating event network-vif-plugged:e54f6190-4815-4ddf-a7a3-bf84caee46d5 for instance 717007ee-8203-4588-ba1e-0ecee45479b4 on n-h2-843834-3 Jul 19 19:45:29.158904 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a9f2d388-a09e-4834-95a6-f00d4ad77951 req-b245988a-e21b-43dd-9c97-ce540e1e25ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057825 Jul 19 19:45:29.162668 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 720/1427] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:29.181457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.184004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:29.202144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.205892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.208249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.211113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.651209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:29.661428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dc04d26-43d8-44ad-b357-ae2a5a0ec852 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 200 len: 1302 microversion: 2.1 time: 0.495715 Jul 19 19:45:29.662022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 721/1428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 1302 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:29.674183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.677579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:29.697504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.698041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.699088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.699548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.865717 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-041f5e11-6e5d-4711-853b-5c2d3b030327 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.110708 Jul 19 19:45:29.867981 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 708/1429] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:45:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:29.873307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:29.874378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:29.893358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.893717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:29.894623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:29.895263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.308125 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84043dd9-1d3d-431e-b939-dea7d7199f0f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1644 microversion: 2.1 time: 0.630545 Jul 19 19:45:30.314245 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 722/1430] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1644 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.323965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.324926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:30.332578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.333265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.334731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.335351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.350904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:30.373416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 77e26a50-74b8-4607-acbc-7c2346753274 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:45:30.393220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-06d9bd18-ff73-46c0-8d95-70dd8ee44b45 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1967 microversion: 2.25 time: 0.523867 Jul 19 19:45:30.394079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 709/1431] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:29 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1967 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:30.398974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f2b09bcb-906a-4ca5-ad76-0415c84d2eb2 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef4250d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.449562 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f2b09bcb-906a-4ca5-ad76-0415c84d2eb2 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4" status: 200 len: 662 microversion: 2.1 time: 0.054193 Jul 19 19:45:30.450117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 710/1432] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:30.455574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.457101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:30.467616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.468318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.469523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.470822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.699926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:30.712154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:30.714343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:30.715799 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bccccf0-ec7c-4292-9bac-4359ccc896ea tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1707 microversion: 2.42 time: 0.399888 Jul 19 19:45:30.720043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 723/1433] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1707 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:30.728414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3dfa664-8ae6-4b65-9bd8-bff122467e9b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Action: 'update', calling method: .version_select at 0x7f23ef6721f0>, body: {"security_group": {"name": "tempest-sg-hth-122172658", "description": "tempest-description-hth-435069370"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:30.848448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:30.859213 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7db02b31-b647-4a01-aba0-cc0e1797f8af tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1306 microversion: 2.1 time: 0.407648 Jul 19 19:45:30.860169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 711/1434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1306 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:30.865398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-16cc724e-578d-4b47-b257-8e3aaf1c7c7e req-298a5d00-2569-4d2c-a363-a26f796fecfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2", "name": "network-vif-deleted", "tag": "f8430797-91ea-45c3-9097-9ebc5a3a9040"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:30.874878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-16cc724e-578d-4b47-b257-8e3aaf1c7c7e req-298a5d00-2569-4d2c-a363-a26f796fecfc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.876119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-16cc724e-578d-4b47-b257-8e3aaf1c7c7e req-298a5d00-2569-4d2c-a363-a26f796fecfc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.892388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-16cc724e-578d-4b47-b257-8e3aaf1c7c7e req-298a5d00-2569-4d2c-a363-a26f796fecfc service nova] Creating event network-vif-deleted:f8430797-91ea-45c3-9097-9ebc5a3a9040 for instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 on n-h2-843834-3 Jul 19 19:45:30.898750 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-16cc724e-578d-4b47-b257-8e3aaf1c7c7e req-298a5d00-2569-4d2c-a363-a26f796fecfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Jul 19 19:45:30.901289 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 712/1435] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:30.911742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:30.913158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:30.923609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.924263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:30.925206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:30.925830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.233836 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3dfa664-8ae6-4b65-9bd8-bff122467e9b tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2" status: 200 len: 216 microversion: 2.1 time: 0.512067 Jul 19 19:45:31.241741 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 724/1436] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Jul 19 19:45:30 2022] PUT /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2 => generated 216 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.247679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.249296 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:31.249296 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:45:31.251990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.253206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.254346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.255027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.256934 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a69d7ad3-62b8-4565-be98-e49bd3cf7add tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1644 microversion: 2.1 time: 0.351349 Jul 19 19:45:31.257585 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 713/1437] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:30 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1644 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:31.273751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eaf65f42-d3d5-4e25-ae52-66984d1b087c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef425dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.307380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a611bdcc-973f-43b3-a716-96eb888566a7 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060614 Jul 19 19:45:31.308079 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 725/1438] 10.222.0.23 () {60 vars in 1216 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:45:31.345819 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eaf65f42-d3d5-4e25-ae52-66984d1b087c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4" status: 200 len: 662 microversion: 2.1 time: 0.076433 Jul 19 19:45:31.346962 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 714/1439] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4 => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.352604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.353352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:31.360304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.361005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.362444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.363158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.386223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 HTTP/1.1 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:31.388421 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. Jul 19 19:45:31.390160 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2'} Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:31.391146 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. Jul 19 19:45:31.392641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:31.395328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:31.396448 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c124a4f-33fc-46c8-8697-da038e2761ff tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2" status: 404 len: 111 microversion: 2.1 time: 0.048247 Jul 19 19:45:31.397194 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 715/1440] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/servers/30cfaf4a-2d1c-4a3c-bdb5-b85ef79ac5d2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:31.403147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e9e9fe9f-8b6a-41e6-a3b9-8c900396f4ea tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef4b5a60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.481589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-766971478", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.536646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:31.568470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e9e9fe9f-8b6a-41e6-a3b9-8c900396f4ea tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2" status: 200 len: 216 microversion: 2.1 time: 0.169828 Jul 19 19:45:31.569030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 716/1441] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2 => generated 216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.575321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:31.576993 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:45:31.576993 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:45:31.578518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.578993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.579947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.580981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.606022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7962a3c6-e522-4d2f-99c1-2f50efe870e6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035651 Jul 19 19:45:31.606962 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 717/1442] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:45:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:31.611908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843834-3", "block_migration": "auto"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:31.613373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:31.619898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.620195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.621047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.621405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.650437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'flavor' on Instance uuid 77e26a50-74b8-4607-acbc-7c2346753274 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:45:31.663310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Going to try to live migrate instance to n-h1-843834-3 {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:45:31.673764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:31.699036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:31.877363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:31.878037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:31.878751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:31.880781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:31.881924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:31.899527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.900180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.901538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:31.902227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:31.928646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Getting quotas for project 598a1556a04442e18329c13ed170d14e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:31.934231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Getting quotas for user 30f61b6b68a248d3bd700bf34dff3399 and project 598a1556a04442e18329c13ed170d14e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:31.964448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:31.967909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:32.037785 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e1e4720f-c86e-4f8b-850a-95944e90c755 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727637 Jul 19 19:45:32.039195 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 726/1443] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:32.046758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:32.047788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 45858a67-214b-4577-961a-c19ddf20e202] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:32.057019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.057839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:32.059105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.059717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:32.108542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 45858a67-214b-4577-961a-c19ddf20e202] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:32.266818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d144cac-165e-476b-9520-33ac6bab6fd6 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202" status: 204 len: 0 microversion: 2.1 time: 0.225376 Jul 19 19:45:32.269080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 727/1444] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:32 2022] DELETE /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:32.285154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-408498643", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:32.375326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:32.756878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:32.757359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:32.767342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:32.768091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:32.768661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:32.785917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.786624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:32.787461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:32.788108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:32.808043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Getting quotas for project e35827fb886b4c3980b7c7999163f0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:32.813479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Getting quotas for user 8601b797c397479fbb09f2e3da659145 and project e35827fb886b4c3980b7c7999163f0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:32.816237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:32.828766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:32.831260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:32.879707 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9093a35-41dd-4849-ba93-b286f363fc38 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605519 Jul 19 19:45:32.881380 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 728/1445] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:32.895685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca5c7172-6102-4fa4-88bd-cebbbfb23fde tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef5ce3a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:33.385297 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca5c7172-6102-4fa4-88bd-cebbbfb23fde tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2" status: 202 len: 0 microversion: 2.1 time: 0.502446 Jul 19 19:45:33.390748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 729/1446] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:32 2022] DELETE /compute/v2.1/os-security-groups/1fb6c8df-46f0-45d6-b8fe-05b5cb438cf2 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:33.398663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:33.405229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:33.440016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:33.442829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:33.443821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:33.444285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:33.624716 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-982c0c49-d872-4123-a3ad-b300cd606869 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1/action" status: 202 len: 0 microversion: 2.1 time: 0.232142 Jul 19 19:45:33.625548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 730/1447] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:33 2022] POST /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:33.636933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:33.642539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:33.666457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:33.666956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:33.669417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:33.679292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.104121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85dc47bf-c693-4e7e-ac6a-2b3dc0d3d7af tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274/action" status: 202 len: 0 microversion: 2.25 time: 2.495550 Jul 19 19:45:34.104960 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 718/1448] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:45:31 2022] POST /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274/action => generated 0 bytes in 2497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:34.111551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:34.112263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:34.128325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.130195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.131190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.131691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.711421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:34.723396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:34.725213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:34.726494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64d05fc0-88d6-4b96-90e6-fc6f65df143a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1848 microversion: 2.42 time: 1.099587 Jul 19 19:45:34.727085 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 731/1449] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:33 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1848 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:34.743027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:34.743685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:34.762807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.763287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.764332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.764925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.872356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:34.880907 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f1daf51-6bf8-4981-9f97-34e7fab026ae tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1487 microversion: 2.1 time: 0.774665 Jul 19 19:45:34.881581 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 719/1450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:34 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1487 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:34.886682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:34.887430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:34.894785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.896022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.897024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:34.897717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:34.928027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:34.948707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:34.964228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7dac47a1-34b0-4add-ac66-a2d51477f23b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1280 microversion: 2.1 time: 0.235951 Jul 19 19:45:34.982478 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 732/1451] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:34 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:34.999059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-303438529", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:35.029192 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-518d8450-39c9-4ca7-b6f3-4d5d2ac9551c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 204 len: 0 microversion: 2.1 time: 0.145592 Jul 19 19:45:35.030225 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 720/1452] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:34 2022] DELETE /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:35.044370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.046573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:35.054710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.056006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.057141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.057771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.075339 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 HTTP/1.1 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:35.079845 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:35.081546 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1958f0f5-2790-4617-a12c-d82b0ee0c066'} Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:35.082537 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:35.085848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:35.089427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:35.090569 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cca5b54-e456-463f-8bfb-16935eeb6cd1 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 404 len: 111 microversion: 2.1 time: 0.054239 Jul 19 19:45:35.091394 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 721/1453] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:35 2022] DELETE /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:35.099720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.101290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:35.108078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.109789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.110867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.111516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.135862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:45:35.768679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a6af37d-6bbd-4918-81f8-895388ea894e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1629 microversion: 2.1 time: 0.675821 Jul 19 19:45:35.771214 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 722/1454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:35 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1629 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:35.798958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:35.801186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:35.837059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.838860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:35.839966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:35.842904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.105417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:45:36.106232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:45:36.107042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:45:36.107721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:45:36.108341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:45:36.140569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.141365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.143442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.144144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.175544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Getting quotas for project e35827fb886b4c3980b7c7999163f0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:36.190986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Getting quotas for user 8601b797c397479fbb09f2e3da659145 and project e35827fb886b4c3980b7c7999163f0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:36.242078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:45:36.256260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:45:36.430103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ad426e8-65b4-4776-953a-62e444cba973 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445833 Jul 19 19:45:36.431058 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 733/1455] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:45:36.476610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-287453986"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:36.482792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:36.500431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.501468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.503070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.504005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.848132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:36.867956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:36.870072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:36.874734 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36fc678e-a7d6-4ea5-a45d-d311b8d5f3d9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 1.100434 Jul 19 19:45:36.877524 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 723/1456] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:35 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:36.883177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:36.897375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 45858a67-214b-4577-961a-c19ddf20e202] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:36.923859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.925066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.927787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:36.928451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:36.980973 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202 HTTP/1.1 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:36.982718 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. Jul 19 19:45:36.984507 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '45858a67-214b-4577-961a-c19ddf20e202'} Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:36.985834 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. Jul 19 19:45:36.988234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:36.990450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 45858a67-214b-4577-961a-c19ddf20e202 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:36.990450 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9605395-06be-4a3d-8824-434bb9e80133 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202" status: 404 len: 111 microversion: 2.1 time: 0.104761 Jul 19 19:45:36.995463 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 724/1457] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:36 2022] GET /compute/v2.1/servers/45858a67-214b-4577-961a-c19ddf20e202 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:37.012395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:37.017315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: 1958f0f5-2790-4617-a12c-d82b0ee0c066] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:37.030071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.031889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.039174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.039843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.075441 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 HTTP/1.1 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:37.086845 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:37.088746 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1958f0f5-2790-4617-a12c-d82b0ee0c066'} Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:37.089706 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. Jul 19 19:45:37.091315 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:37.096138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Instance 1958f0f5-2790-4617-a12c-d82b0ee0c066 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:37.097743 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99841667-c497-4a0c-bbfe-38ad752e9d4c tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066" status: 404 len: 111 microversion: 2.1 time: 0.099356 Jul 19 19:45:37.099063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 725/1458] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:36 2022] GET /compute/v2.1/servers/1958f0f5-2790-4617-a12c-d82b0ee0c066 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:37.104852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:37.105798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:37.112942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.113814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.114904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.116193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.389560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c60cf20-4104-4f18-b81c-211cb5377f5c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "POST /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4/action" status: 202 len: 0 microversion: 2.1 time: 0.951943 Jul 19 19:45:37.390622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 734/1459] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:36 2022] POST /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4/action => generated 0 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:45:37.397457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843834-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:37.399453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:37.417366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.423010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.424260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:37.425035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:37.472773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:37.496338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lazy-loading 'flavor' on Instance uuid b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:45:37.526814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Going to try to live migrate instance to n-h2-843834-3 {{(pid=131229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:45:38.665832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.679038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.680684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.696388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d89eba37-cd5b-4ebc-abca-bacaa232be9b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1848 microversion: 2.42 time: 1.594204 Jul 19 19:45:38.711043 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 726/1460] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:37 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1848 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:38.725425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:38.728619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:38.748420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.749143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.750111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.750729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.923596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:38.932267 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3fac6d56-91fd-437f-ba05-f2b1a53f64f0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1280 microversion: 2.1 time: 0.219503 Jul 19 19:45:38.943417 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 727/1461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:38 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:38.948248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-48c321c0-94bf-4e48-8c20-cc67a71b6953 req-81e9541f-fc71-4ce6-b8b1-027f90c57617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45858a67-214b-4577-961a-c19ddf20e202", "name": "network-vif-deleted", "tag": "20b8b6d1-3bae-4d5e-bc13-55a9d4779f14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:38.968539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-48c321c0-94bf-4e48-8c20-cc67a71b6953 req-81e9541f-fc71-4ce6-b8b1-027f90c57617 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:38.969277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-48c321c0-94bf-4e48-8c20-cc67a71b6953 req-81e9541f-fc71-4ce6-b8b1-027f90c57617 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:38.998507 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-48c321c0-94bf-4e48-8c20-cc67a71b6953 req-81e9541f-fc71-4ce6-b8b1-027f90c57617 service nova] Creating event network-vif-deleted:20b8b6d1-3bae-4d5e-bc13-55a9d4779f14 for instance 45858a67-214b-4577-961a-c19ddf20e202 on n-h2-843834-3 Jul 19 19:45:39.013423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-48c321c0-94bf-4e48-8c20-cc67a71b6953 req-81e9541f-fc71-4ce6-b8b1-027f90c57617 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068265 Jul 19 19:45:39.019807 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 728/1462] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:39.037274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.038084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:39.045419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.047149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.051980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.056838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.483236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:39.496121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb795930-67df-4e93-9371-50a218df2c3f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1287 microversion: 2.1 time: 0.474346 Jul 19 19:45:39.497006 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 729/1463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:39 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1287 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:39.506419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.507603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 9bf820e6-82c6-49a6-aa97-29add51e1081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:39.517082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.519680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.521137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.522452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.543903 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 HTTP/1.1 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:39.546236 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. Jul 19 19:45:39.548038 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '9bf820e6-82c6-49a6-aa97-29add51e1081'} Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:39.549033 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. Jul 19 19:45:39.550640 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.556459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 9bf820e6-82c6-49a6-aa97-29add51e1081 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:39.558137 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf13d1b4-4400-4022-9624-0a90395ef485 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081" status: 404 len: 111 microversion: 2.1 time: 0.059825 Jul 19 19:45:39.559250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 730/1464] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:39 2022] GET /compute/v2.1/servers/9bf820e6-82c6-49a6-aa97-29add51e1081 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:39.568142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef43a5e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.717606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:39.718236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:39.718687 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.718687 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680 HTTP/1.1 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:39.721884 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.723472 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b1772ab0-1a11-4c3e-9a12-29bf25bf2680'} Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:39.724337 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:39.727350 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.730620 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group b1772ab0-1a11-4c3e-9a12-29bf25bf2680 does not exist Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-c2a53839-b826-4517-aade-98caf4fab2e9'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28dc074f-2a0e-4e62-8ebf-cd72f31106a8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680" status: 404 len: 194 microversion: 2.1 time: 0.162728 Jul 19 19:45:39.733573 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 731/1465] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:39 2022] DELETE /compute/v2.1/os-security-groups/b1772ab0-1a11-4c3e-9a12-29bf25bf2680 => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:39.736114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43a95f04-2f8d-4f9a-ae10-cf674dc0543c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef4939d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.789679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43a95f04-2f8d-4f9a-ae10-cf674dc0543c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a" status: 200 len: 1411 microversion: 2.1 time: 0.063694 Jul 19 19:45:39.790616 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 732/1466] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:39 2022] GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:39.795612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-17366c81-4424-4c25-a493-b05d6c5fd64f req-7ca6d8bf-877c-4b84-9a8b-9813e1583040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf820e6-82c6-49a6-aa97-29add51e1081", "name": "network-vif-deleted", "tag": "3f9bc735-6bbd-4f57-8d70-d813c34ca46e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:39.807203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17366c81-4424-4c25-a493-b05d6c5fd64f req-7ca6d8bf-877c-4b84-9a8b-9813e1583040 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.808247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17366c81-4424-4c25-a493-b05d6c5fd64f req-7ca6d8bf-877c-4b84-9a8b-9813e1583040 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.825368 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-17366c81-4424-4c25-a493-b05d6c5fd64f req-7ca6d8bf-877c-4b84-9a8b-9813e1583040 service nova] Creating event network-vif-deleted:3f9bc735-6bbd-4f57-8d70-d813c34ca46e for instance 9bf820e6-82c6-49a6-aa97-29add51e1081 on n-h1-843834-3 Jul 19 19:45:39.831973 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-17366c81-4424-4c25-a493-b05d6c5fd64f req-7ca6d8bf-877c-4b84-9a8b-9813e1583040 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039880 Jul 19 19:45:39.832624 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 733/1467] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:39.840516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:39.841800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:39.851669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.852408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:39.853601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:39.854234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:40.278743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:40.296215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:40.297819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:40.299060 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-351d8314-7ef6-4591-a87e-220041f4ffc7 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.465143 Jul 19 19:45:40.299648 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 734/1468] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:39 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:40.310187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7e5698b-ebf3-46c4-98bb-1edba45dcc1c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.368412 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7e5698b-ebf3-46c4-98bb-1edba45dcc1c tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/b3b39ec4-35db-4382-98c7-b7ea0b76c543" status: 204 len: 0 microversion: 2.1 time: 0.067673 Jul 19 19:45:40.369023 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 735/1469] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 19:45:40 2022] DELETE /compute/v2.1/os-server-groups/b3b39ec4-35db-4382-98c7-b7ea0b76c543 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:40.376940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:40.377803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:40.385485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:40.386122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:40.387135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:40.387628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:40.977373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:41.001547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:41.003296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:41.004581 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ea90c87f-e9e1-4510-98d4-7b031d8cb54a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1869 microversion: 2.42 time: 0.631739 Jul 19 19:45:41.005166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 736/1470] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:40 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1869 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:41.019926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef406d30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.078611 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-73cfc468-316a-4a0a-83c8-04f0ea8d135a tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1/action" status: 202 len: 0 microversion: 2.1 time: 3.685708 Jul 19 19:45:41.079519 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 735/1471] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:45:37 2022] POST /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1/action => generated 0 bytes in 3688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:45:41.085863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0cbe5a6f-3959-40da-b4cd-54d9af8a07fb tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef77a790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.163406 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0cbe5a6f-3959-40da-b4cd-54d9af8a07fb tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a" status: 200 len: 1411 microversion: 2.1 time: 0.081305 Jul 19 19:45:41.165177 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 736/1472] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:41.178273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.188766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:41.214486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.214941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.221832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.222603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.244748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:41.245398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group 83fb6162-7a93-4d44-89c2-5084a189a463 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:41.245864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.245864 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463 HTTP/1.1 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:41.247962 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.249791 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '83fb6162-7a93-4d44-89c2-5084a189a463'} Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:41.250699 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:41.252884 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.254531 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group 83fb6162-7a93-4d44-89c2-5084a189a463 does not exist Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-d401ecba-228b-4a26-8899-a348e4d62d50'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4788419-8bd8-4a66-8e1e-0215a6c4f207 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463" status: 404 len: 194 microversion: 2.1 time: 0.243404 Jul 19 19:45:41.256717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 737/1473] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:41 2022] DELETE /compute/v2.1/os-security-groups/83fb6162-7a93-4d44-89c2-5084a189a463 => generated 194 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:41.264258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.264798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:41.275031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.275523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.276238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.276700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.354407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:41.528675 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71cb2ca5-ec08-4ee4-9209-6b2c63335683 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d" status: 204 len: 0 microversion: 2.1 time: 0.277287 Jul 19 19:45:41.530349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 738/1474] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:41 2022] DELETE /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:41.536669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.538257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:41.546583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.547124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.547954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.548934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.555222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:41.576993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:41.593352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:41.595819 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b74fac1-d1f7-4472-82f2-15064228f3ce tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 0.427686 Jul 19 19:45:41.601367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 737/1475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:41.606824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:41.610829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:41.621230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.625751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.626726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:41.631653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:41.748296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:41.759845 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef33b9c2-5861-4020-9072-e31c79bfa877 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1275 microversion: 2.1 time: 0.227422 Jul 19 19:45:41.761160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 739/1476] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:41.766139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8be0b9bc-960b-4313-9a2c-003c94c32192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef425d30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.052539 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8be0b9bc-960b-4313-9a2c-003c94c32192 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a" status: 204 len: 0 microversion: 2.1 time: 0.290101 Jul 19 19:45:42.053295 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 740/1477] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:41 2022] DELETE /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:42.058578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef4251f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.179760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:42.192217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8a236d4-a3c3-4023-9707-217315ac15a7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1503 microversion: 2.1 time: 0.589105 Jul 19 19:45:42.201408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:42.202166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:42.202791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.202791 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686 HTTP/1.1 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:42.204978 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.206727 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'e8ec84cc-36fd-47f7-b83c-6fda36ed6686'} Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:42.207887 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:42.209394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.210809 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group e8ec84cc-36fd-47f7-b83c-6fda36ed6686 does not exist Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-6144385f-2189-4127-8a4a-ec020cb42837'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:42.212501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7c0b6da-6537-464f-919a-12886a4a1b21 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686" status: 404 len: 194 microversion: 2.1 time: 0.155607 Jul 19 19:45:42.214125 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 741/1479] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:42 2022] DELETE /compute/v2.1/os-security-groups/e8ec84cc-36fd-47f7-b83c-6fda36ed6686 => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:42.217631 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 738/1479] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:41 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1503 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:42.222637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-88bed90e-139d-4ec0-9937-9911836c3f77 req-edd0ff96-0b06-4d81-8386-7187fa10100d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "5911f022-61d0-4f7e-b597-1a2a6e26d952"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:42.223609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.239497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:42.239956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-88bed90e-139d-4ec0-9937-9911836c3f77 req-edd0ff96-0b06-4d81-8386-7187fa10100d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.240410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-88bed90e-139d-4ec0-9937-9911836c3f77 req-edd0ff96-0b06-4d81-8386-7187fa10100d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.246404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.247108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.248011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.248875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.273899 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-88bed90e-139d-4ec0-9937-9911836c3f77 req-edd0ff96-0b06-4d81-8386-7187fa10100d service nova] Creating event network-changed:5911f022-61d0-4f7e-b597-1a2a6e26d952 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:45:42.296221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-88bed90e-139d-4ec0-9937-9911836c3f77 req-edd0ff96-0b06-4d81-8386-7187fa10100d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071104 Jul 19 19:45:42.296990 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 739/1480] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:42.304395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.313984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:42.329741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.330448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.331388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.334432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.392337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:42.578475 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac6edd42-6636-4802-aa80-c08bc65a8dc2 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 204 len: 0 microversion: 2.1 time: 0.279650 Jul 19 19:45:42.579472 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 740/1481] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:42 2022] DELETE /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:42.586734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-88573054-1018-40b9-acf9-2afdb738d0fe req-6f246d0a-a8d1-4a6f-98ef-10b0172ec8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:42.601153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-88573054-1018-40b9-acf9-2afdb738d0fe req-6f246d0a-a8d1-4a6f-98ef-10b0172ec8c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.602051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-88573054-1018-40b9-acf9-2afdb738d0fe req-6f246d0a-a8d1-4a6f-98ef-10b0172ec8c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.633424 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-88573054-1018-40b9-acf9-2afdb738d0fe req-6f246d0a-a8d1-4a6f-98ef-10b0172ec8c4 service nova] Creating event network-changed:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:45:42.641223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-88573054-1018-40b9-acf9-2afdb738d0fe req-6f246d0a-a8d1-4a6f-98ef-10b0172ec8c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060102 Jul 19 19:45:42.642538 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 741/1482] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:42.650194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:42.652433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:42.660176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.660842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:42.662186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:42.663777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:43.097930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:43.111101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:43.112837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:43.114050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3d90bb1-f7cd-4bb8-a26c-2abb19b988cc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.899059 Jul 19 19:45:43.114619 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 742/1483] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:43.144077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-653c16f4-c558-4916-86ef-bb0b8d7100ea tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23efce0310>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:43.215830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-653c16f4-c558-4916-86ef-bb0b8d7100ea tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Image not found. Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-653c16f4-c558-4916-86ef-bb0b8d7100ea tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a HTTP/1.1 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:43.219081 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '34d992e5-2efe-4421-b22d-5c754d3e555a'} Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:43.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 34d992e5-2efe-4421-b22d-5c754d3e555a Jul 19 19:45:43.222013 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:45:43.223488 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34d992e5-2efe-4421-b22d-5c754d3e555a could not be found. Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:43.226075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-653c16f4-c558-4916-86ef-bb0b8d7100ea tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:43.228682 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-653c16f4-c558-4916-86ef-bb0b8d7100ea tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a" status: 404 len: 62 microversion: 2.1 time: 0.080850 Jul 19 19:45:43.229932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 743/1484] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:45:43 2022] GET /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:45:43.238223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef436dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.005735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:44.006929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group d327718c-4a56-422c-a37e-a3c373ba4cea not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:44.007662 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.007662 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea HTTP/1.1 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:44.010276 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.012259 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd327718c-4a56-422c-a37e-a3c373ba4cea'} Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:44.013546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:44.015517 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.018155 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group d327718c-4a56-422c-a37e-a3c373ba4cea does not exist Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f90d92bf-71f7-4334-a22b-f16bea7ff6a9'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:44.023266 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16d1a5df-ec64-4bba-8f40-cb921aaab578 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea" status: 404 len: 194 microversion: 2.1 time: 0.792915 Jul 19 19:45:44.024980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 744/1485] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:43 2022] DELETE /compute/v2.1/os-security-groups/d327718c-4a56-422c-a37e-a3c373ba4cea => generated 194 bytes in 797 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:44.034318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:44.039341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:44.060269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:44.075448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:44.076962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:44.082422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:44.996899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:45.016118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:45.020522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:45.030019 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-350ad5cd-4672-4f5a-8f1f-beec7b71d901 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1869 microversion: 2.42 time: 2.385977 Jul 19 19:45:45.042012 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 742/1486] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:42 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1869 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:45.047527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:45.052811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:45.068978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.069840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:45.070859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:45.073691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:46.158120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:46.219125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=18 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:46.376802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:46.392375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b1527741-0cf1-49a9-9be8-946cc9c5f9f7 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d" status: 200 len: 1475 microversion: 2.1 time: 2.365934 Jul 19 19:45:46.395612 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 745/1487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:44 2022] GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d => generated 1475 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:46.409207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:46.410523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:46.429799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:46.431436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:46.433641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:46.434948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.742475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:47.753041 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76c30c9b-04da-4ac9-9946-aaa8132103f9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1317 microversion: 2.1 time: 1.353640 Jul 19 19:45:47.753974 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 746/1488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:46 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1317 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:47.778878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:47.780047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:47.800163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.800919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.801886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.802473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.830854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:47.840279 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5719583-7849-4e24-8c09-264bad9f87e0 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 2.796590 Jul 19 19:45:47.847686 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 743/1489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:45 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 2805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:47.864378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:47.865081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:47.882472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.883219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:47.884190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:47.884982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.563414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:48.581511 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d23b40a1-0314-4e3a-b99e-2eb5282a08ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1503 microversion: 2.1 time: 0.806947 Jul 19 19:45:48.582774 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 747/1490] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:47 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1503 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:48.586331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:48.588516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e20e2c48-9f8a-4248-b506-4d23cb97df7f req-d3828a7b-87e3-47e1-8990-a91c8bb8d0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717007ee-8203-4588-ba1e-0ecee45479b4", "name": "network-vif-plugged", "status": "completed", "tag": "e54f6190-4815-4ddf-a7a3-bf84caee46d5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:48.615712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e20e2c48-9f8a-4248-b506-4d23cb97df7f req-d3828a7b-87e3-47e1-8990-a91c8bb8d0b1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.617083 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95fdf12c-444d-417d-b09c-9b58267422a5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1500 microversion: 2.1 time: 0.768262 Jul 19 19:45:48.617505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e20e2c48-9f8a-4248-b506-4d23cb97df7f req-d3828a7b-87e3-47e1-8990-a91c8bb8d0b1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.628171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 744/1491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:47 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1500 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:48.636320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef63f280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.648426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e20e2c48-9f8a-4248-b506-4d23cb97df7f req-d3828a7b-87e3-47e1-8990-a91c8bb8d0b1 service nova] Creating event network-vif-plugged:e54f6190-4815-4ddf-a7a3-bf84caee46d5 for instance 717007ee-8203-4588-ba1e-0ecee45479b4 on n-h2-843834-3 Jul 19 19:45:48.655480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e20e2c48-9f8a-4248-b506-4d23cb97df7f req-d3828a7b-87e3-47e1-8990-a91c8bb8d0b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071132 Jul 19 19:45:48.665893 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 748/1492] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:48.675203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.677583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:48.686433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.690128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.692292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.693562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.737430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:48.739371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.security_group_api [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b not found {{(pid=131229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:48.740893 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.740893 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b HTTP/1.1 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:45:48.743400 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.745369 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '79ab64d4-3a0a-4813-a1b4-5044dedd241b'} Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:48.746662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:48.748377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.749898 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] Jul 19 19:45:48.752321 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:45:48.755321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group 79ab64d4-3a0a-4813-a1b4-5044dedd241b does not exist Jul 19 19:45:48.755321 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-1df3dbd2-8e69-4c55-87ce-10e33d10f893'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:48.756535 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0ffe8551-5753-4f89-94e8-c6142a466da0 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b" status: 404 len: 194 microversion: 2.1 time: 0.127011 Jul 19 19:45:48.757352 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 745/1493] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:48 2022] DELETE /compute/v2.1/os-security-groups/79ab64d4-3a0a-4813-a1b4-5044dedd241b => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:48.772148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c5ff1495-a0dc-4af6-9fb5-100fe0fd79b5 req-105001ac-b22d-4c82-8d1d-a70bbfdf4457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "7168f45a-88d6-4b33-8b84-0152aeee34d0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:48.797193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c5ff1495-a0dc-4af6-9fb5-100fe0fd79b5 req-105001ac-b22d-4c82-8d1d-a70bbfdf4457 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.807647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c5ff1495-a0dc-4af6-9fb5-100fe0fd79b5 req-105001ac-b22d-4c82-8d1d-a70bbfdf4457 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.843732 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c5ff1495-a0dc-4af6-9fb5-100fe0fd79b5 req-105001ac-b22d-4c82-8d1d-a70bbfdf4457 service nova] Creating event network-changed:7168f45a-88d6-4b33-8b84-0152aeee34d0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:45:48.856096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c5ff1495-a0dc-4af6-9fb5-100fe0fd79b5 req-105001ac-b22d-4c82-8d1d-a70bbfdf4457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094825 Jul 19 19:45:48.856835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 746/1494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:48.871632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3e60e906-a7a0-41a5-bf23-9672d898af4e req-5cdbc251-2778-4720-9047-9208371e1a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:48.894075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3e60e906-a7a0-41a5-bf23-9672d898af4e req-5cdbc251-2778-4720-9047-9208371e1a1b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.897298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3e60e906-a7a0-41a5-bf23-9672d898af4e req-5cdbc251-2778-4720-9047-9208371e1a1b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.950689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3e60e906-a7a0-41a5-bf23-9672d898af4e req-5cdbc251-2778-4720-9047-9208371e1a1b service nova] Creating event network-vif-unplugged:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h1-843834-3 Jul 19 19:45:48.958045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3e60e906-a7a0-41a5-bf23-9672d898af4e req-5cdbc251-2778-4720-9047-9208371e1a1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098972 Jul 19 19:45:48.960056 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 747/1495] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:48.970038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:48.971260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:48.980797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.981624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:48.982752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:48.983399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:49.545869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:49.613702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:49.631425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:49.634184 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e7b1311-6f0c-49f2-9fb6-12ddd9e0cb36 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.965771 Jul 19 19:45:49.634780 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 749/1496] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:48 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:49.647581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:49.648204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: bbf90241-8ceb-4472-97d5-0b605582780d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:49.664723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:49.665198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:49.670762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:49.671461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:49.716310 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d HTTP/1.1 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:49.720425 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. Jul 19 19:45:49.722293 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bbf90241-8ceb-4472-97d5-0b605582780d'} Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:49.723519 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. Jul 19 19:45:49.725234 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:49.726966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance bbf90241-8ceb-4472-97d5-0b605582780d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:49.726966 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1288a525-cd7b-433f-9ec6-39e384e954da tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d" status: 404 len: 111 microversion: 2.1 time: 0.085168 Jul 19 19:45:49.728277 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 750/1497] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:49 2022] GET /compute/v2.1/servers/bbf90241-8ceb-4472-97d5-0b605582780d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:49.759280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23ef38e940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:50.053170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:45:50.053953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Neutron security group 5aeda715-6a97-4578-bf8e-5103834d13a8 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:45:50.054548 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.054548 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 HTTP/1.1 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:50.056672 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.058996 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '5aeda715-6a97-4578-bf8e-5103834d13a8'} Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:50.063478 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:45:50.066006 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.068511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Security group 5aeda715-6a97-4578-bf8e-5103834d13a8 does not exist Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-f82d5508-0384-41b5-aef0-7299212d96c1'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3833c976-e287-435e-9873-1cf582f86c23 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8" status: 404 len: 194 microversion: 2.1 time: 0.327020 Jul 19 19:45:50.075206 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 751/1498] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:45:49 2022] DELETE /compute/v2.1/os-security-groups/5aeda715-6a97-4578-bf8e-5103834d13a8 => generated 194 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:50.078603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:50.080062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:50.091018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.091930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.093009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.093685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.592386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:50.609377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:50.614524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:50.617072 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d26d5cb3-16f5-4e72-a7ae-4fc218ed6336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1890 microversion: 2.42 time: 1.651954 Jul 19 19:45:50.618470 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 748/1499] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:48 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1890 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:50.625095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:50.625752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:50.633959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.635784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.636960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.637576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.638126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:50.649916 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ca2dd22-82b4-4986-b95b-e46490ad8871 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1317 microversion: 2.1 time: 0.585569 Jul 19 19:45:50.651504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 752/1500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:50 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:50.659423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:50.660881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:50.678075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.678992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:50.680233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:50.681438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.498569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:51.534692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-11349b8b-5ecc-4676-bc61-2893a6ace66a tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 0.906435 Jul 19 19:45:51.552799 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 749/1501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:50 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:51.563884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:51.583828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:51.628267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.629764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.630904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.632480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.644583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:51.659025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30cc0847-c6b0-4747-ac30-281d9f9c4820 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1503 microversion: 2.1 time: 1.006091 Jul 19 19:45:51.660170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 753/1502] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:50 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1503 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:51.685335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:51.688406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: 146b6dab-a464-4744-9d7e-4eed338ba2e2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:51.703051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.703527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.706012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.706392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.738714 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 HTTP/1.1 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:51.740917 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. Jul 19 19:45:51.742648 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '146b6dab-a464-4744-9d7e-4eed338ba2e2'} Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:51.743686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. Jul 19 19:45:51.745413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:51.748581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:51.750424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7822551c-14f5-4109-9f06-744977526b0b tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2" status: 404 len: 111 microversion: 2.1 time: 0.082806 Jul 19 19:45:51.754761 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 754/1503] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:51 2022] GET /compute/v2.1/servers/146b6dab-a464-4744-9d7e-4eed338ba2e2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:51.760736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:51.761477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:51.770190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.771579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.772663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:51.773333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:51.807090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:52.016283 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e88cf212-2b11-4795-8c9b-1f012e75c5fa tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 204 len: 0 microversion: 2.1 time: 0.258981 Jul 19 19:45:52.017490 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 755/1504] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:51 2022] DELETE /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:52.026482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:52.027317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:52.036740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.037220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.038064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.040086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.606895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:52.634032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8adf1602-3fb7-4561-bbd5-1df32e019f90 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1500 microversion: 2.1 time: 1.079555 Jul 19 19:45:52.635184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 750/1505] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:51 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1500 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:52.658120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-plugged", "status": "completed", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}, {"server_uuid": "146b6dab-a464-4744-9d7e-4eed338ba2e2", "name": "network-vif-unplugged", "status": "completed", "tag": "8e3e0c9c-6db6-441f-8e3c-56129a756b4a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:52.682107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.682576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.709278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] Creating event network-vif-plugged:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:45:52.712223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] Creating event network-vif-unplugged:8e3e0c9c-6db6-441f-8e3c-56129a756b4a for instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 on n-h1-843834-3 Jul 19 19:45:52.721495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-adce63fa-c026-4b5d-a8de-302c876e56bd req-ba17d633-1ce0-4ae6-adfe-327f668d6b83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.080765 Jul 19 19:45:52.722488 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 751/1506] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:52.731195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413c7eb7-9816-4b39-9f25-5aa03c840dcd", "tag": "f6cfedbc-f19d-4629-9bff-92adad3e0d65"}, {"name": "network-changed", "server_uuid": "c1c47c23-7b6a-423c-af6f-b3c5a82d424d", "tag": "db322cb0-6c7e-42d2-9a76-de9677d46fe0"}, {"server_uuid": "146b6dab-a464-4744-9d7e-4eed338ba2e2", "name": "network-vif-deleted", "tag": "8e3e0c9c-6db6-441f-8e3c-56129a756b4a"}, {"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "b2de3852-6a7d-42da-8fb1-52ee4948ff67"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:52.738931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:52.750359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:52.752705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:52.759384 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a137e1d-eeab-4cfe-8916-c48d8bf6a9ff tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.737360 Jul 19 19:45:52.760552 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 756/1507] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:52 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:52.777419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}, {"server_uuid": "bbf90241-8ceb-4472-97d5-0b605582780d", "name": "network-vif-deleted", "tag": "80663c6c-369f-48b4-ae24-634a32cc3364"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:52.789788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.793087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.793824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.795725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.846421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] Creating event network-changed:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h1-843834-3 Jul 19 19:45:52.846974 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] Creating event network-vif-deleted:80663c6c-369f-48b4-ae24-634a32cc3364 for instance bbf90241-8ceb-4472-97d5-0b605582780d on n-h1-843834-3 Jul 19 19:45:52.855778 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Creating event network-changed:f6cfedbc-f19d-4629-9bff-92adad3e0d65 for instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd on n-h2-843834-3 Jul 19 19:45:52.856383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Creating event network-changed:db322cb0-6c7e-42d2-9a76-de9677d46fe0 for instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d on n-h1-843834-3 Jul 19 19:45:52.856982 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Creating event network-vif-deleted:8e3e0c9c-6db6-441f-8e3c-56129a756b4a for instance 146b6dab-a464-4744-9d7e-4eed338ba2e2 on n-h1-843834-3 Jul 19 19:45:52.857548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] Creating event network-changed:b2de3852-6a7d-42da-8fb1-52ee4948ff67 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:45:52.866592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1f818c4b-ee77-4689-9225-f09cc6fe567c req-b47c2c90-36f8-4720-9bb3-cb99d4f87297 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.104095 Jul 19 19:45:52.868141 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 757/1508] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:52.877514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:52.878816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:52.890545 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7c1852dc-aa5e-42a8-b5b5-67dcaf4819c7 req-9b27813c-3bfa-4042-8f32-0f8f44fa9457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.166446 Jul 19 19:45:52.891366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 752/1509] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:52.898250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.899141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.900468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.901200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.911918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:52.925738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:52.951186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.951674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:52.952554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:52.952990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.250113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:54.261886 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b7d2108-b713-4064-9551-022250a3b8bc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1317 microversion: 2.1 time: 1.354401 Jul 19 19:45:54.263131 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 753/1510] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:52 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1317 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:54.268379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba94148c-4369-4f45-b26f-432ad18a6843 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.391925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:54.397090 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba94148c-4369-4f45-b26f-432ad18a6843 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9741dc1c-5fcb-4b4a-a275-f4c64cd89589" status: 204 len: 0 microversion: 2.1 time: 0.132498 Jul 19 19:45:54.406728 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 754/1511] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 19:45:54 2022] DELETE /compute/v2.1/os-server-groups/9741dc1c-5fcb-4b4a-a275-f4c64cd89589 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:54.412922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:54.420561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.422693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:54.431680 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd0827cb-e332-4f6a-bafe-4e4d9bbe3f64 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.559602 Jul 19 19:45:54.435897 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 758/1512] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:52 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:54.438684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:54.465431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:54.469431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:54.471403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.474686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.479339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.481713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.494634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.495233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.496057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:54.496589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:54.568947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:55.812096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:55.824799 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-384bf92c-a596-4f9f-aa9a-68c8e5b36e2a tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1645 microversion: 2.1 time: 1.415839 Jul 19 19:45:55.838146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 755/1513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1645 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:55.847271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.847977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:55.863154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.863447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:55.870212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.871770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.873027 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d18d69c-06ca-4b84-81dc-bb0148048afd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 1.435571 Jul 19 19:45:55.873770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.875285 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 759/1514] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:54 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:55.880277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:55.889927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:55.908658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.909119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:55.909913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:55.910357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.587350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:56.596560 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83167f7e-99cb-477e-9201-22de3f4c394c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1500 microversion: 2.1 time: 0.719809 Jul 19 19:45:56.607851 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 760/1515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1500 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:56.613070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.613906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:56.623633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:56.628042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.628718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.631022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.631702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.632096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b8b877d-7879-4c62-82db-796aa813b85e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1478 microversion: 2.1 time: 0.792747 Jul 19 19:45:56.645735 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 756/1516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:55 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1478 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:56.651465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.655351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:56.672320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.673205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.674180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.674622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.709949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:45:56.832210 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4b4cb401-8eb5-452b-9a99-e3a14aa25d97 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 204 len: 0 microversion: 2.1 time: 0.191397 Jul 19 19:45:56.838166 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 757/1517] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:45:56 2022] DELETE /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:45:56.847248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-13e71806-d762-4308-a3ac-d33504f45b27 req-dfee914e-8373-4d7a-a165-675b672223b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c47c23-7b6a-423c-af6f-b3c5a82d424d", "name": "network-vif-plugged", "status": "completed", "tag": "db322cb0-6c7e-42d2-9a76-de9677d46fe0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:56.865541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-13e71806-d762-4308-a3ac-d33504f45b27 req-dfee914e-8373-4d7a-a165-675b672223b9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.866000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-13e71806-d762-4308-a3ac-d33504f45b27 req-dfee914e-8373-4d7a-a165-675b672223b9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.885903 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-13e71806-d762-4308-a3ac-d33504f45b27 req-dfee914e-8373-4d7a-a165-675b672223b9 service nova] Creating event network-vif-plugged:db322cb0-6c7e-42d2-9a76-de9677d46fe0 for instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d on n-h1-843834-3 Jul 19 19:45:56.891506 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-13e71806-d762-4308-a3ac-d33504f45b27 req-dfee914e-8373-4d7a-a165-675b672223b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054441 Jul 19 19:45:56.892774 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 758/1518] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:56.900727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}, {"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "f3487fb2-62f8-4a73-8c6a-542f7178db5a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:56.912867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.915195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.932605 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] Creating event network-vif-unplugged:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h2-843834-3 Jul 19 19:45:56.933430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] Creating event network-changed:f3487fb2-62f8-4a73-8c6a-542f7178db5a for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:45:56.949023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4371614c-f59c-43a7-a05c-4256e9c50fcf req-005a7ab3-b942-4456-8669-444c7f3c85fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052591 Jul 19 19:45:56.950283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 759/1519] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:56.959449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:56.961355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:56.974333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.975493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.976983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:56.977610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:56.994656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:56.997185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:57.016768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.020544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.021872 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5286c012-36f4-444e-a486-8df44a5294e5 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.412784 Jul 19 19:45:57.035723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 761/1520] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:56 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:57.041190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.042109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:57.056618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.057428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.058493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.059000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.454800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.467731 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2b6212c-5a7f-427d-a9ed-24be11d30e50 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1317 microversion: 2.1 time: 0.514801 Jul 19 19:45:57.478584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 760/1521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:56 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:57.483876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ffb83f9d-f156-4fb8-a177-2cc88b0b9deb tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '.version_select at 0x7f23ef672040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.486159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffb83f9d-f156-4fb8-a177-2cc88b0b9deb tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.486638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffb83f9d-f156-4fb8-a177-2cc88b0b9deb tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.502126 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ffb83f9d-f156-4fb8-a177-2cc88b0b9deb tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.022149 Jul 19 19:45:57.514701 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 761/1522] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:57.515114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.522867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.525429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:57.530313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:57.533383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.538535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.539144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.540217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.541050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.541563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.547164 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-672d4286-8b8d-421f-a7ca-ac71833243c2 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.505877 Jul 19 19:45:57.557273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 762/1523] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:57.562322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.567029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:57.576103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.576970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.578055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.578718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.708090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc87c2c9ed45c883b44a3c14c3a1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db24051a3a4840f3a4e77d476d6caff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.717445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-69028800-7953-4a19-bd27-40a64c9b34c8 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 200 len: 1466 microversion: 2.1 time: 0.158875 Jul 19 19:45:57.728154 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 763/1524] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:57.734673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.736016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:57.743296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:45:57.745561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.746403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.747484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.748495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.878818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:57.906368 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c1c0054-a728-4255-8218-18a30ab49531 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1473 microversion: 2.1 time: 0.384150 Jul 19 19:45:57.907082 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 762/1525] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1473 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:57.929047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:57.930472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:57.956274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.959096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:57.962392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:57.964048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.218558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:58.251954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28b63616-4fea-497c-a008-be4546120471 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 0.516250 Jul 19 19:45:58.254260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 764/1526] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:58.270869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:58.271579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:58.277836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.278284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.279740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.280180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.859248 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0d8a8ca-520d-4d44-bd1d-5489bedf3e98 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1629 microversion: 2.1 time: 0.945995 Jul 19 19:45:58.863422 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 763/1527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:57 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1629 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:58.869325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:58.870189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:58.883048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.884337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:58.885316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:58.886769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.083830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:59.099569 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5bcd36c5-73c4-4530-9398-b4dfe4639196 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1500 microversion: 2.1 time: 0.844038 Jul 19 19:45:59.101434 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 765/1528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:58 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1500 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:59.107707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:59.109027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:59.125219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.126469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.127351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.128004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.680415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:59.688086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:59.697533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:59.697533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:45:59.697533 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d471f797-6548-4d55-a21d-d0346ac8a980 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.826900 Jul 19 19:45:59.698080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 764/1529] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:58 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:45:59.703360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:59.707417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:59.713052 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de84a4b8-7fee-46c2-9489-551b972eb7d4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1317 microversion: 2.1 time: 0.610046 Jul 19 19:45:59.721635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 766/1530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:59 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:45:59.727172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.731166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.731404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:59.732263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] [instance: b0878399-e196-44f3-9c32-1be87e6b03de] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:59.732393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.732888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.742085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.742582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.743373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.743810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.776842 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] HTTP exception thrown: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Request method failure captured: Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de HTTP/1.1 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlV6iu57gd0TehM1EYMEIl5SsuR05RUrbrnJ5ryIMfmraYLFMXTPmUEJVDj2FDSt6910D4EXLXRpJnIHkZr3RO81AOHvflgspMS_2F74TbWqYHE0j1MvGS7qyjLXSJrBriwrZ9WswRyt8raleIzVH7q6QZtNYySJat0fx71R7oynb0 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:45:59.779541 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db24051a3a4840f3a4e77d476d6caff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: db24051a3a4840f3a4e77d476d6caff2 Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1660920374 Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 31cc87c2c9ed45c883b44a3c14c3a1a2 Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsTestJSON-1660920374-project Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. Jul 19 19:45:59.781348 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b0878399-e196-44f3-9c32-1be87e6b03de'} Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:45:59.782364 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. Jul 19 19:45:59.784007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:45:59.789109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Returning 404 to user: Instance b0878399-e196-44f3-9c32-1be87e6b03de could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:45:59.791864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ed58cbaa-4511-4b84-b013-24e536373347 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de" status: 404 len: 111 microversion: 2.1 time: 0.067837 Jul 19 19:45:59.795594 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 767/1531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:59 2022] GET /compute/v2.1/servers/b0878399-e196-44f3-9c32-1be87e6b03de => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:45:59.800788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b2dfc7e-9189-4d8c-b08b-d63af3078f2f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: .version_select at 0x7f23efcbab80>, body: {"keypair": {"name": "tempest-keypair-18681195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOV1eeB1Wj7js7WN236ybju7MVwuhyLaUm5LlVqoN97oljVhzIIHNWjLRXqhGlnKjNN5J2YOBX8O1lQ2w9Gf71LYj2+g2nqm6vTt11y2nxbP6KZxF8aLNO2WWu/kibFiw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:59.821250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9b2dfc7e-9189-4d8c-b08b-d63af3078f2f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:45:59.829623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9b2dfc7e-9189-4d8c-b08b-d63af3078f2f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for user a15f9dbf22624cb49d4d817fed35e3b5 and project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:45:59.868738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b2dfc7e-9189-4d8c-b08b-d63af3078f2f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.071577 Jul 19 19:45:59.869369 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 768/1532] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:45:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:59.878349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4ac26da6-cc73-4b43-a8fb-30044000982b req-6e885149-b0cd-4f9f-8d69-2e10f87b894f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413c7eb7-9816-4b39-9f25-5aa03c840dcd", "name": "network-vif-plugged", "status": "completed", "tag": "f6cfedbc-f19d-4629-9bff-92adad3e0d65"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:45:59.890965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4ac26da6-cc73-4b43-a8fb-30044000982b req-6e885149-b0cd-4f9f-8d69-2e10f87b894f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.892434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4ac26da6-cc73-4b43-a8fb-30044000982b req-6e885149-b0cd-4f9f-8d69-2e10f87b894f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.910248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4ac26da6-cc73-4b43-a8fb-30044000982b req-6e885149-b0cd-4f9f-8d69-2e10f87b894f service nova] Creating event network-vif-plugged:f6cfedbc-f19d-4629-9bff-92adad3e0d65 for instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd on n-h2-843834-3 Jul 19 19:45:59.918374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4ac26da6-cc73-4b43-a8fb-30044000982b req-6e885149-b0cd-4f9f-8d69-2e10f87b894f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047065 Jul 19 19:45:59.919667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 769/1533] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:45:59.931815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:45:59.933285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:45:59.971049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.973603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:45:59.976902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:45:59.978528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.189384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:00.215631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:00.219094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:00.222517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-406b6fa8-1f1d-4c4b-b714-9684eac4825e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.523014 Jul 19 19:46:00.223687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 765/1534] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:45:59 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:00.234326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0878399-e196-44f3-9c32-1be87e6b03de", "name": "network-vif-deleted", "tag": "e9b54df8-8756-41a6-9e1a-059541193fe8"}, {"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "38d23398-5706-4a45-866a-d09a387294c0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:00.265913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:00.268180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.318398 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] Creating event network-vif-deleted:e9b54df8-8756-41a6-9e1a-059541193fe8 for instance b0878399-e196-44f3-9c32-1be87e6b03de on n-h1-843834-3 Jul 19 19:46:00.318826 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] Creating event network-changed:38d23398-5706-4a45-866a-d09a387294c0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:00.346181 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b87520bd-3382-4857-98f5-3c5d7ed036af req-224fc1c1-9e44-4c68-8f02-d2777f7f39f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.120909 Jul 19 19:46:00.347954 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 766/1535] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:00.356835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:00.358349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:00.370592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:00.371539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.372751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:00.375334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:00.653024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739f00235d7f4f81a47e2c3b31720c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c5bd5d33e486598f6b0ffdd504282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:00.667783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01b9fa92-e85d-45e0-a8c7-795851a1c896 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 200 len: 1473 microversion: 2.1 time: 0.746137 Jul 19 19:46:00.668696 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 770/1536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:45:59 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 1473 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:00.683817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc9935d0-71e5-413d-9f42-227f95904c02 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23efd1f940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:01.331341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:01.339358 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28880371-a9f0-484d-9f6c-ea278007b0ae tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1322 microversion: 2.1 time: 0.989913 Jul 19 19:46:01.350291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 767/1537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:00 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1322 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:01.356301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:01.357754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:01.366070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:01.367061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:01.368411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:01.369078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:01.991502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:02.002132 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6937970-d3a0-4c9d-ae93-900fbe697e97 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1500 microversion: 2.1 time: 0.649841 Jul 19 19:46:02.002644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 768/1538] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:01 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1500 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:02.025124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:02.025839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:02.053126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.055523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.056857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.057813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.162412 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc9935d0-71e5-413d-9f42-227f95904c02 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ee854909-67db-4a91-9325-839e1ed29094" status: 202 len: 0 microversion: 2.1 time: 1.477892 Jul 19 19:46:02.165914 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 771/1539] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:00 2022] DELETE /compute/v2.1/os-security-groups/ee854909-67db-4a91-9325-839e1ed29094 => generated 0 bytes in 1487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:02.174062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:02.174776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:02.195910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.196508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.197719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.198264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.552035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:02.562520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:02.563081 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af410ce1-af62-470c-8d7c-214bf26e97de tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1467 microversion: 2.1 time: 0.395206 Jul 19 19:46:02.564273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 772/1540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:02 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:02.570132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:02.571619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:02.579687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.580638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.581660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.582357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.587778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:02.593700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:02.596199 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fe878f37-d862-4edf-874a-7c02d88f689c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.585640 Jul 19 19:46:02.598003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 769/1541] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:02 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:02.606740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:02.609350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] [instance: f65301ea-31b5-4e24-a345-ad9c73259006] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:02.640406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.641130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.642121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.642846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.661215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] HTTP exception thrown: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Request method failure captured: Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 HTTP/1.1 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wj1DpUSDhR5RzGCOeUABfLMgrVX-LEqeRwwQMutGartQJXGTnH3ZSTkbg0Y4HiAyBp5SqEe2XCLUKYCbpMC49Ip2sYWpGYBVPsEzORYoc7k3duqm6_OzFbgRN44dNsqoEfKHCjGaOpAYBsQTYaTk8mn_0DBygowJpi9ZioYXdaqhFg Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:02.663514 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a78c5bd5d33e486598f6b0ffdd504282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a78c5bd5d33e486598f6b0ffdd504282 Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-572678144 Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 739f00235d7f4f81a47e2c3b31720c45 Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersOnMultiNodesTest-572678144-project Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. Jul 19 19:46:02.665349 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f65301ea-31b5-4e24-a345-ad9c73259006'} Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:02.666377 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. Jul 19 19:46:02.669832 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:02.673531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] Returning 404 to user: Instance f65301ea-31b5-4e24-a345-ad9c73259006 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:02.675378 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72b00c27-ce66-4aeb-a3c4-419d01b41e94 tempest-ServersOnMultiNodesTest-572678144 tempest-ServersOnMultiNodesTest-572678144-project] 10.222.0.23 "GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006" status: 404 len: 111 microversion: 2.1 time: 0.075482 Jul 19 19:46:02.676843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 770/1542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:02 2022] GET /compute/v2.1/servers/f65301ea-31b5-4e24-a345-ad9c73259006 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:02.707962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3bf918ae-215b-4b99-9ee4-7403be9c2fdb req-4a605220-325e-4a0a-ba0e-609e7aac6917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "name": "network-vif-unplugged", "status": "completed", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:02.729934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bf918ae-215b-4b99-9ee4-7403be9c2fdb req-4a605220-325e-4a0a-ba0e-609e7aac6917 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:02.730770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bf918ae-215b-4b99-9ee4-7403be9c2fdb req-4a605220-325e-4a0a-ba0e-609e7aac6917 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:02.759624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3bf918ae-215b-4b99-9ee4-7403be9c2fdb req-4a605220-325e-4a0a-ba0e-609e7aac6917 service nova] Creating event network-vif-unplugged:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h2-843834-3 Jul 19 19:46:02.773346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3bf918ae-215b-4b99-9ee4-7403be9c2fdb req-4a605220-325e-4a0a-ba0e-609e7aac6917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094377 Jul 19 19:46:02.777517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 771/1543] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:02.791808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-badbc965-2e11-422b-8ab5-aed450f309c9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] Calling method '.version_select at 0x7f23fc0c5820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:03.025111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:03.046234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:03.047865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:03.053776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4401c5be-3688-4a91-80a4-e164b2fba828 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.488550 Jul 19 19:46:03.055234 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 773/1544] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:02 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:03.072323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:03.073348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:03.082753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.083536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.084509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.085116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.635527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-badbc965-2e11-422b-8ab5-aed450f309c9 tempest-SecurityGroupsTestJSON-1660920374 tempest-SecurityGroupsTestJSON-1660920374-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c60b8331-db4e-4bf3-884d-1525daedebf8" status: 202 len: 0 microversion: 2.1 time: 0.848496 Jul 19 19:46:03.636765 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 772/1545] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:02 2022] DELETE /compute/v2.1/os-security-groups/c60b8331-db4e-4bf3-884d-1525daedebf8 => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:46:03.640758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:03.644837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65301ea-31b5-4e24-a345-ad9c73259006", "name": "network-vif-deleted", "tag": "5d4562a7-1248-49bc-93a4-e4639838a290"}, {"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "e7f8c7bc-de24-488d-9351-3eb0517f2947"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:03.649399 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c98355f-f2cd-4100-8ba2-8c39dfac98b9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1471 microversion: 2.1 time: 0.580954 Jul 19 19:46:03.661283 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 774/1546] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:03 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1471 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:03.667112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:03.668579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:03.675870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.676622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.677086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.677646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.678009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.678607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.708776 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] Creating event network-vif-deleted:5d4562a7-1248-49bc-93a4-e4639838a290 for instance f65301ea-31b5-4e24-a345-ad9c73259006 on n-h1-843834-3 Jul 19 19:46:03.710898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] Creating event network-changed:e7f8c7bc-de24-488d-9351-3eb0517f2947 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:03.722408 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d06f19b7-2c1f-44e3-b288-fd43d0862e7a req-75421d77-0e86-4062-89a0-c5fad5dbe9dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084187 Jul 19 19:46:03.723626 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 773/1547] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:03.748440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:03.749978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:03.761513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.761757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:03.762660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:03.763598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.069083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.093398 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e491f977-5898-4576-b93c-3cfc2f38eb4a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1466 microversion: 2.1 time: 0.430611 Jul 19 19:46:04.095886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 775/1548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:03 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:04.105631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:04.106734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:04.131708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.131708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.132303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.135430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.166670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.178659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bfd0981-b75a-4a2f-a386-3856ec02a00b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1487 microversion: 2.1 time: 0.453030 Jul 19 19:46:04.179299 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 774/1549] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:03 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1487 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:04.197189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:04.198952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:04.211355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.213564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.214332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.216418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.257368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Request method failure captured: Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd/diagnostics HTTP/1.1 Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wnZRXPj0SK-UtA8jH4_f8hhdk2uLrfv4l1ykdPnNnKcqERkxXWpobZKDeZUBDcwRquIKz0-MvIY12SHHftyrXz5pi1tDZDGXXDb8DGDJ_p9igwnaegC6jhj79P0C0ZSODQUeB_UdhRuvvTwAcOdVMBLsbilRcnD4E70oKohxbbV_VQ Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 598a1556a04442e18329c13ed170d14e Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:04.268943 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/598a1556a04442e18329c13ed170d14e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/598a1556a04442e18329c13ed170d14e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_598a1556a04442e18329c13ed170d14e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/598a1556a04442e18329c13ed170d14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 598a1556a04442e18329c13ed170d14e Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerDiagnosticsNegativeTest-626243811-project Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 30f61b6b68a248d3bd700bf34dff3399 Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-626243811-project Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:04.270446 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '413c7eb7-9816-4b39-9f25-5aa03c840dcd'} Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:04.271373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:04.272837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:04.273997 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-646edaac-0f2a-4e8b-82b2-b2df78fd0510 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.089196 Jul 19 19:46:04.275219 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 775/1550] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:46:04 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd/diagnostics => generated 117 bytes in 95 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:04.281258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-236815945", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "fb087bda-9d04-4001-99de-3fb667d5f62c"}], "security_groups": [{"name": "tempest-securitygroup--978702693"}], "key_name": "tempest-keypair-18681195", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:04.395691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.411739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.413895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.415335 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4a4889a-a2a3-43fb-b5bf-445c85af62b8 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.315291 Jul 19 19:46:04.416249 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 776/1551] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:04 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:04.422290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:04.423229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:04.430742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.431783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.433053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.433838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.556632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] validate_networks() for [('fb087bda-9d04-4001-99de-3fb667d5f62c', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:04.892316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.903936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.906133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:04.907568 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23aaceaa-319b-4e13-8682-b37091ee7eed tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.490035 Jul 19 19:46:04.932667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 777/1552] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:04 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:04.945636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-790790998"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:04.949818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:04.956192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.956645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:04.957428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:04.958505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.360070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7df29544-7e3a-4022-9738-01acfb66fe24 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "POST /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302/action" status: 202 len: 0 microversion: 2.1 time: 0.421604 Jul 19 19:46:05.362038 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 778/1553] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:46:04 2022] POST /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:46:05.371437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.377780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:05.393391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.394260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.395920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.396482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.429630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:05.462820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:05.530334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec1d0c52-c6a2-4ed5-b479-5ac71da5c07c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 204 len: 0 microversion: 2.1 time: 0.164042 Jul 19 19:46:05.531734 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 779/1554] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:05 2022] DELETE /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:05.540252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.541309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:05.553193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.553193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.554645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.555249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.584046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:05.693979 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-78b4456e-671b-4c42-a02d-185b447fe469 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "DELETE /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 204 len: 0 microversion: 2.1 time: 0.159475 Jul 19 19:46:05.695196 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 780/1555] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:05 2022] DELETE /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:05.703266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c0f85c78-8fe8-4fb9-b861-5adad55d0446 req-9e7270fc-fd5f-4e24-8c71-393909b79784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:05.715192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c0f85c78-8fe8-4fb9-b861-5adad55d0446 req-9e7270fc-fd5f-4e24-8c71-393909b79784 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.716036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c0f85c78-8fe8-4fb9-b861-5adad55d0446 req-9e7270fc-fd5f-4e24-8c71-393909b79784 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.733720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c0f85c78-8fe8-4fb9-b861-5adad55d0446 req-9e7270fc-fd5f-4e24-8c71-393909b79784 service nova] Creating event network-changed:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h2-843834-3 Jul 19 19:46:05.741457 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c0f85c78-8fe8-4fb9-b861-5adad55d0446 req-9e7270fc-fd5f-4e24-8c71-393909b79784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Jul 19 19:46:05.742630 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 781/1556] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:05.753976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8c8952af-411d-4a3b-b44a-16fe6cb6f267 req-b29c01f8-95d5-4088-87b0-40056ace1ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717007ee-8203-4588-ba1e-0ecee45479b4", "name": "network-vif-unplugged", "status": "completed", "tag": "e54f6190-4815-4ddf-a7a3-bf84caee46d5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:05.763035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c8952af-411d-4a3b-b44a-16fe6cb6f267 req-b29c01f8-95d5-4088-87b0-40056ace1ca2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.763965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c8952af-411d-4a3b-b44a-16fe6cb6f267 req-b29c01f8-95d5-4088-87b0-40056ace1ca2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.779209 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8c8952af-411d-4a3b-b44a-16fe6cb6f267 req-b29c01f8-95d5-4088-87b0-40056ace1ca2 service nova] Creating event network-vif-unplugged:e54f6190-4815-4ddf-a7a3-bf84caee46d5 for instance 717007ee-8203-4588-ba1e-0ecee45479b4 on n-h2-843834-3 Jul 19 19:46:05.784679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8c8952af-411d-4a3b-b44a-16fe6cb6f267 req-b29c01f8-95d5-4088-87b0-40056ace1ca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039858 Jul 19 19:46:05.785930 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 782/1557] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:05.793005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a90655d6-4b30-4ffe-ba6e-e52f3bf26572 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef38eca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.848249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a90655d6-4b30-4ffe-ba6e-e52f3bf26572 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.060832 Jul 19 19:46:05.852641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:05.854767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:05.855512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:05.856259 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 783/1558] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:05 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:05.862983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:05.863976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:05.864319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:05.864878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:05.872558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.873089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.875401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.875943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.881313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.881899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.884308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:05.884952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:05.913953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:05.919970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for user a15f9dbf22624cb49d4d817fed35e3b5 and project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:05.936054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:05.938377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:05.991818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b924a784-96c0-42d4-95ac-e97cf1a26368 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.715207 Jul 19 19:46:05.998415 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 776/1559] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:06.003908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea37b408-c86b-483d-92a8-82b5a2f40b52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef805820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.030833 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ea37b408-c86b-483d-92a8-82b5a2f40b52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Image not found. Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea37b408-c86b-483d-92a8-82b5a2f40b52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a HTTP/1.1 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:06.033060 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '34d992e5-2efe-4421-b22d-5c754d3e555a'} Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:06.034865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34d992e5-2efe-4421-b22d-5c754d3e555a to delete Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.035846 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34d992e5-2efe-4421-b22d-5c754d3e555a could not be found. Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:06.037758 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:46:06.039897 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:06.044420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea37b408-c86b-483d-92a8-82b5a2f40b52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:06.044420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ea37b408-c86b-483d-92a8-82b5a2f40b52 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a" status: 404 len: 62 microversion: 2.1 time: 0.044422 Jul 19 19:46:06.045369 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 777/1560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:05 2022] DELETE /compute/v2.1/images/34d992e5-2efe-4421-b22d-5c754d3e555a => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:06.053943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.054997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:06.062242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.062816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.063750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.064273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.069449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:06.371077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.386193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.389425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.390630 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f898d1b-8e0c-467a-85fa-ee9528fb1baa tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.532963 Jul 19 19:46:06.391243 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 784/1561] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:05 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:06.398556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c7a7b29f-fa7e-4abc-9495-6eae25468b33 req-806df0e0-cc83-4bc9-97a2-6cba65e49997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "eb5c3e1a-e4db-4ce9-b757-7d758d2f333c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:06.400874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.419782 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3d10fbe-9dc3-4d51-b5da-3fd7460d578b tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1477 microversion: 2.1 time: 0.368213 Jul 19 19:46:06.422738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 778/1562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1477 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:06.424132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c7a7b29f-fa7e-4abc-9495-6eae25468b33 req-806df0e0-cc83-4bc9-97a2-6cba65e49997 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.424588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c7a7b29f-fa7e-4abc-9495-6eae25468b33 req-806df0e0-cc83-4bc9-97a2-6cba65e49997 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.437284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c7a7b29f-fa7e-4abc-9495-6eae25468b33 req-806df0e0-cc83-4bc9-97a2-6cba65e49997 service nova] Creating event network-changed:eb5c3e1a-e4db-4ce9-b757-7d758d2f333c for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:06.442661 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c7a7b29f-fa7e-4abc-9495-6eae25468b33 req-806df0e0-cc83-4bc9-97a2-6cba65e49997 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048076 Jul 19 19:46:06.443519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.443803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 785/1563] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:06.447975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:06.449264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3463e781-a4b6-4243-b968-b10d7b6b64cc tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.450806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3463e781-a4b6-4243-b968-b10d7b6b64cc tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:06.462336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.463238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.468659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.469124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.930442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3463e781-a4b6-4243-b968-b10d7b6b64cc tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:06.938570 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3463e781-a4b6-4243-b968-b10d7b6b64cc tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1232 microversion: 2.1 time: 0.493459 Jul 19 19:46:06.939835 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 786/1564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1232 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:06.960012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:06.961485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:06.971973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.972759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:06.973749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:06.974283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.009125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:07.084338 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Instance is already in deleting state, ignoring this request Jul 19 19:46:07.085295 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29d436ef-31f5-49ad-8b3d-9d9eddc8908c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 204 len: 0 microversion: 2.1 time: 0.144140 Jul 19 19:46:07.086462 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 787/1565] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:06 2022] DELETE /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:46:07.093281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ae4ec0d-ced6-4866-ac98-f2cb8b7c3c73 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23efcbab80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.147404 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ae4ec0d-ced6-4866-ac98-f2cb8b7c3c73 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.059484 Jul 19 19:46:07.147964 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 788/1566] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:07.153567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.154465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:07.159070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.169061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.170664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.172045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ea0d920b-ccc6-4907-bdef-11c10d5dcf22 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.739776 Jul 19 19:46:07.172630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 779/1567] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:06 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.177486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.178051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.179060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.179595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.327502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef672160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.328988 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.328988 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:07.330357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.330821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.338875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.339602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.348620 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] HTTP exception thrown: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Request method failure captured: Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b HTTP/1.1 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 56 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wn-N2tVeuwM5hCmT_lAE2iNMRmyUHi9VTBBnpehztFv2-yBPX19wFV7oxmhqTOkmicWHrk1-Q0R2el0ua7U8FEhPMn2UpY91cwK0GIoubiZnG_LH9ZxsnKlgZD9Q6MDqVdwZITvNrxsKNsoUBdmuuX958jDNPixeJC_TX-1D4jxc38 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:46:07.356012 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 076d102886534da3a7a0d22a83ca270a Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:46:07.357736 n-d-843834-3 devstack@n-api.service[131229]: exception: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8088b54b-9288-4c81-97a0-308ef2845d3b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.358647 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.365101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Returning 404 to user: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d943695-7213-40b8-92c3-baae05229a77 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b" status: 404 len: 110 microversion: 2.53 time: 0.184379 Jul 19 19:46:07.368180 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 780/1568] 10.222.0.23 () {62 vars in 1308 bytes} [Tue Jul 19 19:46:07 2022] PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b => generated 110 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:07.384963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef672e50>, body: {"status": "disabled"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.389690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.391173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.400832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.401455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.402229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.409019 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] HTTP exception thrown: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Request method failure captured: Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b HTTP/1.1 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 22 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wn-N2tVeuwM5hCmT_lAE2iNMRmyUHi9VTBBnpehztFv2-yBPX19wFV7oxmhqTOkmicWHrk1-Q0R2el0ua7U8FEhPMn2UpY91cwK0GIoubiZnG_LH9ZxsnKlgZD9Q6MDqVdwZITvNrxsKNsoUBdmuuX958jDNPixeJC_TX-1D4jxc38 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:46:07.411299 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 076d102886534da3a7a0d22a83ca270a Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: {"status": "disabled"} Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: exception: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.413087 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8088b54b-9288-4c81-97a0-308ef2845d3b', 'body': {'status': 'disabled'}} Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.414332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:07.416369 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:07.418801 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.418801 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.419549 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f4d6fd8-86ee-4b03-9cf9-da706cbfcf51 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1493 microversion: 2.1 time: 0.270143 Jul 19 19:46:07.420283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Returning 404 to user: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:07.420616 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 789/1569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1493 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:07.421678 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7cc5763-4363-48a1-8ee0-ed9142d143a5 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b" status: 404 len: 110 microversion: 2.53 time: 0.040652 Jul 19 19:46:07.422827 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 781/1570] 10.222.0.23 () {62 vars in 1308 bytes} [Tue Jul 19 19:46:07 2022] PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:07.434750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.435512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:07.436600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef7bca60>, body: {"status": "enabled"} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:07.439354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.440187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.444554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.445118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.446389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.446943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.449150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.450122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.456939 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] HTTP exception thrown: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Request method failure captured: Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b HTTP/1.1 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 21 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wn-N2tVeuwM5hCmT_lAE2iNMRmyUHi9VTBBnpehztFv2-yBPX19wFV7oxmhqTOkmicWHrk1-Q0R2el0ua7U8FEhPMn2UpY91cwK0GIoubiZnG_LH9ZxsnKlgZD9Q6MDqVdwZITvNrxsKNsoUBdmuuX958jDNPixeJC_TX-1D4jxc38 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:46:07.461957 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f5e578fd72347668d88d0c2cbe15875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f5e578fd72347668d88d0c2cbe15875 Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126 Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 076d102886534da3a7a0d22a83ca270a Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: {"status": "enabled"} Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: exception: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.463618 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8088b54b-9288-4c81-97a0-308ef2845d3b', 'body': {'status': 'enabled'}} Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.464544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:07.466464 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:07.468041 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. Jul 19 19:46:07.468041 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:07.468041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Returning 404 to user: Service 8088b54b-9288-4c81-97a0-308ef2845d3b could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:07.468041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac2bbc3a-7920-4368-b867-33287d21555a tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b" status: 404 len: 110 microversion: 2.53 time: 0.036072 Jul 19 19:46:07.471652 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 782/1571] 10.222.0.23 () {62 vars in 1308 bytes} [Tue Jul 19 19:46:07 2022] PUT /compute/v2.1/os-services/8088b54b-9288-4c81-97a0-308ef2845d3b => generated 110 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:07.477832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.478458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:07.485195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.485869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.488080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.488711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.707190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.719226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.720420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2e8d5f7-1730-4b33-8bc7-8a8f9a09ddbd tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1477 microversion: 2.1 time: 0.246013 Jul 19 19:46:07.728908 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 783/1572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:07.734362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.734751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.736116 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.736116 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:07.736453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:07.738047 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08ccd9de-3d6c-4fe4-b1da-e655dc283f25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.315665 Jul 19 19:46:07.738347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.748641 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 790/1573] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.749047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.749047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.749047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.766512 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2b4adb6-fe0b-44e6-b7e5-4e872b3040a3 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036155 Jul 19 19:46:07.767304 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 784/1574] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.783592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.785242 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.785242 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:46:07.786671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.792169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.793344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.793857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.821587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c05ca8c3-7af5-4da9-ba56-3470b98faf3e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044312 Jul 19 19:46:07.822702 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 791/1575] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.834313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.835774 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.835774 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:07.837242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.837485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.838333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.838769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.865026 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-768708c8-e53c-4647-af48-586797bca11e tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034349 Jul 19 19:46:07.867554 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 785/1576] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:07.880361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.883005 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.883005 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:46:07.885621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.886525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.888107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.889181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.941181 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9407be6e-74cc-442b-8a6c-28aa9d0c91a2 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-843834-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.067632 Jul 19 19:46:07.941971 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 792/1577] 10.222.0.23 () {60 vars in 1234 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services?host=n-d-843834-3&binary=xxx => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:07.952702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.956332 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:07.956332 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:07.958289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:07.958819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.959060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:07.959854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.961965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.962683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.969879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.970373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.971549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:07.971998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:07.990054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-745accf5-3729-4383-9d2a-9c318417c9c1 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041227 Jul 19 19:46:07.991397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 786/1578] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:08.004472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.006597 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:08.006597 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:08.008412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.009161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.010223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.010899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.048292 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6edd6854-365e-445e-a1c3-f9b560915979 tempest-ServicesAdminNegativeV253TestJSON-207166126 tempest-ServicesAdminNegativeV253TestJSON-207166126-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049617 Jul 19 19:46:08.049622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 787/1579] 10.222.0.23 () {60 vars in 1238 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:08.064393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.074259 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16b0d7fe-c4f1-48f7-9e67-c9a795b03684 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1236 microversion: 2.1 time: 0.121194 Jul 19 19:46:08.075506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 793/1580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:07 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:08.162045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5a3c603-7ed4-4893-9bab-ecc08fccb73b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef43a820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.231540 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5a3c603-7ed4-4893-9bab-ecc08fccb73b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.075609 Jul 19 19:46:08.231862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-619614ab-4ec9-4ff0-a23d-29ef9e806bb9 tempest-ServicesAdminNegativeV253TestJSON-423446201 tempest-ServicesAdminNegativeV253TestJSON-423446201-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.233175 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:46:08.233175 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:46:08.234290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-619614ab-4ec9-4ff0-a23d-29ef9e806bb9 tempest-ServicesAdminNegativeV253TestJSON-423446201 tempest-ServicesAdminNegativeV253TestJSON-423446201-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1cd49b573b374e7a911ddef05faee106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefd37b53a834d08a9d3bf8c6419d40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-619614ab-4ec9-4ff0-a23d-29ef9e806bb9 tempest-ServicesAdminNegativeV253TestJSON-423446201 tempest-ServicesAdminNegativeV253TestJSON-423446201-project] Request method failure captured: Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wn-Uk4r9yC_e5velOnrEa9nycrBp-_IZNUWQstvdqCv7Ww99C_4i8wbv9IsgFXUrgQSERRvSo4pC-Hd_HMp8yQZ0wxbrnHfrZ43Qhly_1K24mfz62FfVIGNH9dg7yLHJXPGrj4j5ARn5sZ0O_jqyKLPc39tS7YWCCxbI0OyU4g8Eok Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: cefd37b53a834d08a9d3bf8c6419d40a Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-423446201 Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:08.236149 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cefd37b53a834d08a9d3bf8c6419d40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cefd37b53a834d08a9d3bf8c6419d40a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cefd37b53a834d08a9d3bf8c6419d40a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cefd37b53a834d08a9d3bf8c6419d40a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-423446201 Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: cefd37b53a834d08a9d3bf8c6419d40a Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-423446201 Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-423446201-project Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1cd49b573b374e7a911ddef05faee106 Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-423446201-project Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:46:08.237662 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:46:08.238478 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:46:08.241003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:08.243753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-619614ab-4ec9-4ff0-a23d-29ef9e806bb9 tempest-ServicesAdminNegativeV253TestJSON-423446201 tempest-ServicesAdminNegativeV253TestJSON-423446201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:08.243860 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 794/1581] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:08.243971 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-619614ab-4ec9-4ff0-a23d-29ef9e806bb9 tempest-ServicesAdminNegativeV253TestJSON-423446201 tempest-ServicesAdminNegativeV253TestJSON-423446201-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.180528 Jul 19 19:46:08.245501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.246054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:08.249657 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 788/1582] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/os-services => generated 112 bytes in 193 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:46:08.259101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.260069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.261541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.262359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.438726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.439368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:08.454377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.455249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.456449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.457056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.538109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.555979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.557553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.558778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c5af409-cacd-4028-9444-15807a2222aa tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.320350 Jul 19 19:46:08.559697 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 795/1583] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:08.702777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:08.713651 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bec100d4-3210-4b20-901c-71aa92804b1b tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1493 microversion: 2.1 time: 0.279089 Jul 19 19:46:08.715200 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 789/1584] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1493 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:08.738802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.740116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:08.751202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.752207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.755257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.756646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:08.756895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.757312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:08.769193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.769673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:08.771208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:08.771808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.104790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:09.115571 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f752ffd7-73a1-44e4-817b-cc51ea56e692 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1477 microversion: 2.1 time: 0.380852 Jul 19 19:46:09.131113 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 796/1585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1477 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:09.138849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:09.141290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:09.148322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.148774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.149607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.150893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.153304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:09.166255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:09.169247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:09.172800 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d094535-0ec6-4117-832b-cd2aa5b99221 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.420089 Jul 19 19:46:09.173904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 790/1586] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:08 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:09.248187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-568c67c7-0da1-47a7-9842-cf1bd718474d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef640f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:09.320439 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-568c67c7-0da1-47a7-9842-cf1bd718474d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.079260 Jul 19 19:46:09.321586 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 791/1587] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:09 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:09.338874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:09.364722 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5baa157-f160-40e9-857d-59224efe34ab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1228 microversion: 2.1 time: 0.232138 Jul 19 19:46:09.368149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 797/1588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:09 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1228 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:09.582093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:09.584080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:09.594402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.595232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.596226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.596843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.736211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:09.737678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:09.751660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.756240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:09.760124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:09.762512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.702304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.732005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.735489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.737171 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-176ade17-d8b3-4af9-bb99-4c3e97fe38b4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.160402 Jul 19 19:46:10.738855 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 792/1589] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:09 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:10.747111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:10.748529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:10.766712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:10.768766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.769223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.772419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.772883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.774476 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd8ac2a2-616e-4551-aeeb-64dd3cb73a6a tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1493 microversion: 2.1 time: 1.045371 Jul 19 19:46:10.780763 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 798/1590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:09 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1493 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:10.793925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:10.794715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:10.806818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.807593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:10.808579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:10.819728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.432681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:11.452795 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5bb85961-ebef-4e10-be37-7518443acec5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1477 microversion: 2.1 time: 0.712665 Jul 19 19:46:11.453424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 793/1591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:10 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1477 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:11.466675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa01d88d-b7bd-4f0e-a342-797d43b18251 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef76f040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:11.552155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:11.565279 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa01d88d-b7bd-4f0e-a342-797d43b18251 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.110703 Jul 19 19:46:11.567652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:11.574629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 794/1592] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:11.579069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:11.588245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:11.590615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:11.598518 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d0caacd-6601-4bbc-a6f2-e0b3e4ddff62 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.816158 Jul 19 19:46:11.599776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:11.603849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 799/1593] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:10 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:11.611709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.615530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.617793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.618443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.757550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:11.758900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:11.777360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.778296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.779160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.779757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.813929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:11.825846 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-546002df-e7dc-4319-93f2-ed67e5ec621d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1290 microversion: 2.1 time: 0.239878 Jul 19 19:46:11.826511 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 795/1594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1290 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:11.849410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:11.851517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:11.869730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.871085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:11.872319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:11.872921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.135256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf462f1353f342b395e856a1f3cbafb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8830f9585045faa9bf80f94604f7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:12.160056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5aa93acc-634e-4127-8ab1-f210a9eb641f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 200 len: 1451 microversion: 2.1 time: 0.322149 Jul 19 19:46:12.161981 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 796/1595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 1451 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:12.173377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c953b59a-a45a-4819-94b4-7ad96ce8067b req-faad28c5-9887-4819-b42c-c58315a6a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "name": "network-vif-unplugged", "status": "completed", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:12.202004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c953b59a-a45a-4819-94b4-7ad96ce8067b req-faad28c5-9887-4819-b42c-c58315a6a0fe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.203015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c953b59a-a45a-4819-94b4-7ad96ce8067b req-faad28c5-9887-4819-b42c-c58315a6a0fe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.229678 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c953b59a-a45a-4819-94b4-7ad96ce8067b req-faad28c5-9887-4819-b42c-c58315a6a0fe service nova] Creating event network-vif-unplugged:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h2-843834-3 Jul 19 19:46:12.239544 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c953b59a-a45a-4819-94b4-7ad96ce8067b req-faad28c5-9887-4819-b42c-c58315a6a0fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075042 Jul 19 19:46:12.241261 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 797/1596] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:12.340319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5e2fc60b-7462-4e1c-ac50-729d95a8525b req-70dd8ec1-5032-4f96-a83b-c203925f17ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717007ee-8203-4588-ba1e-0ecee45479b4", "name": "network-vif-deleted", "tag": "e54f6190-4815-4ddf-a7a3-bf84caee46d5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:12.354049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5e2fc60b-7462-4e1c-ac50-729d95a8525b req-70dd8ec1-5032-4f96-a83b-c203925f17ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.369144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5e2fc60b-7462-4e1c-ac50-729d95a8525b req-70dd8ec1-5032-4f96-a83b-c203925f17ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.451523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5e2fc60b-7462-4e1c-ac50-729d95a8525b req-70dd8ec1-5032-4f96-a83b-c203925f17ee service nova] Creating event network-vif-deleted:e54f6190-4815-4ddf-a7a3-bf84caee46d5 for instance 717007ee-8203-4588-ba1e-0ecee45479b4 on n-h2-843834-3 Jul 19 19:46:12.467709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5e2fc60b-7462-4e1c-ac50-729d95a8525b req-70dd8ec1-5032-4f96-a83b-c203925f17ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171571 Jul 19 19:46:12.469979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 798/1597] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:12.492960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:12.494213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:12.527250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.528203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.532537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:12.533439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:12.939920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f61b6b68a248d3bd700bf34dff3399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598a1556a04442e18329c13ed170d14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:12.953823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0cbf892b-c65f-4a94-9133-1ec929428ae5 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 200 len: 1435 microversion: 2.1 time: 0.469564 Jul 19 19:46:12.967477 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:12 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 1435 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:12.995385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-832350d7-526f-441e-afe8-32db2ac7ea08 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef8088b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.033057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.085045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.099067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:13.103993 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1bb84aac-152a-4065-a287-7cfd8b561d29 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.351492 Jul 19 19:46:13.106848 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-832350d7-526f-441e-afe8-32db2ac7ea08 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.137604 Jul 19 19:46:13.107819 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:12 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:13.112469 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 800/1600] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:11 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:13.120482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.126650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:13.150632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.154180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.156007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.156654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:13.156852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.159838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:13.186181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.187691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:13.189507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:13.191567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.288803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.306361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.356261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.359759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-414ea1f9-0609-44f8-8765-c24d94f4130e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 1.242109 Jul 19 19:46:14.371266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 801/1601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:13 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:14.371634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:14.371634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fdb003d6-8792-45dd-96c0-10777dd104e0 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 1.258389 Jul 19 19:46:14.383748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 801/1602] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:13 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:14.394183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.394797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 717007ee-8203-4588-ba1e-0ecee45479b4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.404011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.405040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] [instance: 413c7eb7-9816-4b39-9f25-5aa03c840dcd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.415613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.420114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.422565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.426234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.440883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.445264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.447354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.449447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.478217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 HTTP/1.1 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:14.483211 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '717007ee-8203-4588-ba1e-0ecee45479b4'} Jul 19 19:46:14.484775 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.485656 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. Jul 19 19:46:14.487003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.491588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance 717007ee-8203-4588-ba1e-0ecee45479b4 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.495277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] HTTP exception thrown: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. Jul 19 19:46:14.495722 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fdfc9bb-e70d-4678-8f3b-11dce6594581 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4" status: 404 len: 111 microversion: 2.1 time: 0.128520 Jul 19 19:46:14.496853 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 802/1603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/servers/717007ee-8203-4588-ba1e-0ecee45479b4 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Request method failure captured: Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd HTTP/1.1 Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wnZRXPj0SK-UtA8jH4_f8hhdk2uLrfv4l1ykdPnNnKcqERkxXWpobZKDeZUBDcwRquIKz0-MvIY12SHHftyrXz5pi1tDZDGXXDb8DGDJ_p9igwnaegC6jhj79P0C0ZSODQUeB_UdhRuvvTwAcOdVMBLsbilRcnD4E70oKohxbbV_VQ Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 598a1556a04442e18329c13ed170d14e Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:14.500356 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/598a1556a04442e18329c13ed170d14e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/598a1556a04442e18329c13ed170d14e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_598a1556a04442e18329c13ed170d14e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/598a1556a04442e18329c13ed170d14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 598a1556a04442e18329c13ed170d14e Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-626243811 Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerDiagnosticsNegativeTest-626243811-project Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 30f61b6b68a248d3bd700bf34dff3399 Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-626243811-project Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. Jul 19 19:46:14.501908 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '413c7eb7-9816-4b39-9f25-5aa03c840dcd'} Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.502716 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. Jul 19 19:46:14.504164 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.510382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] Returning 404 to user: Instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.513314 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ddc9fed-4d71-4db3-b926-5b6591eafca9 tempest-ServerDiagnosticsNegativeTest-626243811 tempest-ServerDiagnosticsNegativeTest-626243811-project] 10.222.0.23 "GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd" status: 404 len: 111 microversion: 2.1 time: 0.127985 Jul 19 19:46:14.514145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3aa1b59-a16d-408e-8140-560700a0c872 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef344550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.518658 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 802/1604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/servers/413c7eb7-9816-4b39-9f25-5aa03c840dcd => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:14.532519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.533515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.541879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.542409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.543357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.544041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.605905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3aa1b59-a16d-408e-8140-560700a0c872 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.107039 Jul 19 19:46:14.611874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 803/1605] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:14.625963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb6497b5-b22c-411d-bc62-7fcbc6351c78 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef344ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.664336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-eb6497b5-b22c-411d-bc62-7fcbc6351c78 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Image not found. Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb6497b5-b22c-411d-bc62-7fcbc6351c78 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 HTTP/1.1 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:14.666199 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'cf0de368-e30b-4f7b-a040-6923755c7193'} Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.667791 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cf0de368-e30b-4f7b-a040-6923755c7193 to delete Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.668711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cf0de368-e30b-4f7b-a040-6923755c7193 could not be found. Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.670877 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:46:14.673425 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.676088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb6497b5-b22c-411d-bc62-7fcbc6351c78 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.677296 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb6497b5-b22c-411d-bc62-7fcbc6351c78 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193" status: 404 len: 62 microversion: 2.1 time: 0.064194 Jul 19 19:46:14.678895 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 804/1606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:14 2022] DELETE /compute/v2.1/images/cf0de368-e30b-4f7b-a040-6923755c7193 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:14.692364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.693898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.711175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.714512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.717065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.723362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.767912 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 HTTP/1.1 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:14.772215 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8c786080-abef-4e8c-8d7e-be521e836f20'} Jul 19 19:46:14.774785 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.775972 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.777276 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.783301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.787613 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47234a0f-a827-442f-8edf-6efb1e866c7e tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 404 len: 111 microversion: 2.1 time: 0.104384 Jul 19 19:46:14.790375 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 805/1607] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:14 2022] DELETE /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:14.802751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.803875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 8c786080-abef-4e8c-8d7e-be521e836f20] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:14.822026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:14.827919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.828580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.831092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:14.832090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:14.870386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 HTTP/1.1 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:14.886345 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8c786080-abef-4e8c-8d7e-be521e836f20'} Jul 19 19:46:14.887929 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.888853 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. Jul 19 19:46:14.890216 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.895107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance 8c786080-abef-4e8c-8d7e-be521e836f20 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.896270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71f8d3c4-4703-4d00-9829-f440326fa056 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20" status: 404 len: 111 microversion: 2.1 time: 0.103698 Jul 19 19:46:14.899380 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 806/1608] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/servers/8c786080-abef-4e8c-8d7e-be521e836f20 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:14.912881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c13aeb-8e9e-4e44-9987-97ac54cd52d5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef48d160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:14.978505 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b8c13aeb-8e9e-4e44-9987-97ac54cd52d5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Image not found. Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c13aeb-8e9e-4e44-9987-97ac54cd52d5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 HTTP/1.1 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:14.980573 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '5ae43477-5505-4501-a45e-92ea0d38f1d4'} Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:14.982007 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ae43477-5505-4501-a45e-92ea0d38f1d4 to delete Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.983170 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ae43477-5505-4501-a45e-92ea0d38f1d4 could not be found. Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:14.984669 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:46:14.986594 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:14.988782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c13aeb-8e9e-4e44-9987-97ac54cd52d5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:14.989792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8c13aeb-8e9e-4e44-9987-97ac54cd52d5 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4" status: 404 len: 62 microversion: 2.1 time: 0.086241 Jul 19 19:46:14.990559 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 807/1609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:14 2022] DELETE /compute/v2.1/images/5ae43477-5505-4501-a45e-92ea0d38f1d4 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:14.999779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.000618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:15.018670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.019882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.022231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.023461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.057106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd HTTP/1.1 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:15.059037 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd'} Jul 19 19:46:15.061011 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:15.062102 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.067546 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.069247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:15.069247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e92f9ee2-6b13-4e96-821b-c37f4735cb00 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 404 len: 111 microversion: 2.1 time: 0.065783 Jul 19 19:46:15.069247 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 808/1610] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:14 2022] DELETE /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:46:15.072723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d92abfdc-96e4-4937-bd3a-bcb68c9da1a7 req-762c8319-b5cb-4359-8745-b26c4983d7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413c7eb7-9816-4b39-9f25-5aa03c840dcd", "name": "network-vif-deleted", "tag": "f6cfedbc-f19d-4629-9bff-92adad3e0d65"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:15.095352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d92abfdc-96e4-4937-bd3a-bcb68c9da1a7 req-762c8319-b5cb-4359-8745-b26c4983d7cd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.095802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d92abfdc-96e4-4937-bd3a-bcb68c9da1a7 req-762c8319-b5cb-4359-8745-b26c4983d7cd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.107850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:15.122552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:15.129580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:15.132281 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-11ad3352-d831-4154-9ddf-f2261db975f5 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.611445 Jul 19 19:46:15.139793 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d92abfdc-96e4-4937-bd3a-bcb68c9da1a7 req-762c8319-b5cb-4359-8745-b26c4983d7cd service nova] Creating event network-vif-deleted:f6cfedbc-f19d-4629-9bff-92adad3e0d65 for instance 413c7eb7-9816-4b39-9f25-5aa03c840dcd on n-h2-843834-3 Jul 19 19:46:15.145146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 803/1611] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:14 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:15.166723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.168285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:15.177700 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d92abfdc-96e4-4937-bd3a-bcb68c9da1a7 req-762c8319-b5cb-4359-8745-b26c4983d7cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113476 Jul 19 19:46:15.181433 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 809/1612] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:15.184490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.188889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.194372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.195308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.251652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd HTTP/1.1 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:15.258244 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd'} Jul 19 19:46:15.262793 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:15.264648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. Jul 19 19:46:15.267399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.269893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:15.278735 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a57efa7f-5064-4d1c-9276-e99e8ab98e6c tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd" status: 404 len: 111 microversion: 2.1 time: 0.131829 Jul 19 19:46:15.285229 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 804/1613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:15 2022] GET /compute/v2.1/servers/c7cf8e52-fe8d-493b-b0db-b3fa2f2b0afd => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:15.301095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6f95cb4-6839-4b6a-a17c-9e9876b8fd4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '.version_select at 0x7f23ef808dc0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.344759 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f6f95cb4-6839-4b6a-a17c-9e9876b8fd4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Image not found. Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6f95cb4-6839-4b6a-a17c-9e9876b8fd4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 HTTP/1.1 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:15.347474 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0e8fa200-33d1-475b-8ad2-8ecb290f73d2'} Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:15.354885 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0e8fa200-33d1-475b-8ad2-8ecb290f73d2 to delete Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.356847 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e8fa200-33d1-475b-8ad2-8ecb290f73d2 could not be found. Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:15.359192 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6f95cb4-6839-4b6a-a17c-9e9876b8fd4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f6f95cb4-6839-4b6a-a17c-9e9876b8fd4f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2" status: 404 len: 62 microversion: 2.1 time: 0.062217 Jul 19 19:46:15.361693 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 805/1614] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:15 2022] DELETE /compute/v2.1/images/0e8fa200-33d1-475b-8ad2-8ecb290f73d2 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:15.369049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.369049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:15.385668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.386126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.395042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.395509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.449369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 HTTP/1.1 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:15.451871 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '3ff7eeea-caec-4195-bc05-20d03a396763'} Jul 19 19:46:15.453341 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:15.454264 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:15.457274 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:15.459750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:15.460984 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2b3c852-aa26-4766-a531-59484ab0142f tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 404 len: 111 microversion: 2.1 time: 0.105361 Jul 19 19:46:15.462169 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 806/1615] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:46:15 2022] DELETE /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:15.470571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.471701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:15.479620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.480455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.481651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.482623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.929577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:15.936428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Calling method '.version_select at 0x7f23ef35b0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:15.956255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.956718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.957515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:15.957942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:15.985861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:15.992634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:15.999969 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7838214a-c337-41ee-b586-79a67e1ffc27 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 0.536138 Jul 19 19:46:16.004706 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 807/1616] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:15 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:16.011541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.018786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:16.022652 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a5713f3-732c-46dc-a745-7c7ff2758db8 tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.839881 Jul 19 19:46:16.023315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 810/1617] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jul 19 19:46:15 2022] GET /compute/v2.1/limits => generated 511 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:16.032139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.034872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.037506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.038707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.536980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.557843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.563784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] [instance: 3ff7eeea-caec-4195-bc05-20d03a396763] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:16.576847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.577518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.578336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.578671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.579371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.586345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:16.588395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1eb57f35-f728-47e5-9248-6999514f5c9a tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1485 microversion: 2.25 time: 0.580719 Jul 19 19:46:16.597193 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 808/1618] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:16 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1485 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:16.616762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5dd0af5b-e1b5-457e-b471-bba4fe7f806d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef808430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.688576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] HTTP exception thrown: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Request method failure captured: Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 HTTP/1.1 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wjbQ81YuUWshA5dKuoYD546md_XuzN4RO-FbD7NF6UQXP8J2ktfkDZsFR2dicr0Kav0iSGz1hR07Qe8OrcgfvfNmAv0n-5cwFLrem-wjpcgblF3aJ7Ckpj9tPAh2rK0-IPyZZX3kRC_v_LGgi1nDsqCsu7eLQaLlG_s5Tj6KmcU0Rk Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:16.692765 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e8830f9585045faa9bf80f94604f7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesTestJSON-804661603 Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2e8830f9585045faa9bf80f94604f7d6 Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesTestJSON-804661603 Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: cf462f1353f342b395e856a1f3cbafb2 Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesTestJSON-804661603-project Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '3ff7eeea-caec-4195-bc05-20d03a396763'} Jul 19 19:46:16.694296 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:16.695206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. Jul 19 19:46:16.696522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:16.697636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] Returning 404 to user: Instance 3ff7eeea-caec-4195-bc05-20d03a396763 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:16.697636 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-714390e4-d59a-4833-a1b9-f0593b30b142 tempest-ImagesTestJSON-804661603 tempest-ImagesTestJSON-804661603-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763" status: 404 len: 111 microversion: 2.1 time: 0.667593 Jul 19 19:46:16.704808 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 811/1619] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:16 2022] GET /compute/v2.1/servers/3ff7eeea-caec-4195-bc05-20d03a396763 => generated 111 bytes in 681 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:46:16.725142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c067d9e2-96b6-4983-aa77-3908ecff79fa req-f35d165e-c1b1-4c74-9c5d-cbe7518a3fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-plugged", "status": "completed", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:16.769482 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5dd0af5b-e1b5-457e-b471-bba4fe7f806d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.168293 Jul 19 19:46:16.770086 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 809/1620] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:16 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:16.771582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c067d9e2-96b6-4983-aa77-3908ecff79fa req-f35d165e-c1b1-4c74-9c5d-cbe7518a3fa1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.775707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c067d9e2-96b6-4983-aa77-3908ecff79fa req-f35d165e-c1b1-4c74-9c5d-cbe7518a3fa1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.795162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:16.798386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:16.823899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.824361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.825166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:16.825608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:16.832395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c067d9e2-96b6-4983-aa77-3908ecff79fa req-f35d165e-c1b1-4c74-9c5d-cbe7518a3fa1 service nova] Creating event network-vif-plugged:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:46:16.850110 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c067d9e2-96b6-4983-aa77-3908ecff79fa req-f35d165e-c1b1-4c74-9c5d-cbe7518a3fa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142735 Jul 19 19:46:16.857932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 812/1621] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:16.882159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-241623499", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:17.013863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:17.599414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:17.617120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:17.618703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:17.619981 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d76e341-744e-4711-b6f7-d07d91b0ba28 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.848294 Jul 19 19:46:17.620767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 810/1622] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:16 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:17.636979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:17.637878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:17.640118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:17.661156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:17.662089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:17.663264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:17.663949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.019183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=16 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:18.054782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Getting quotas for project 19a68066c1834654bedcb591779e1517. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:18.063040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Getting quotas for user 954b6bf8575f484d8eb4926a009360c6 and project 19a68066c1834654bedcb591779e1517. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:18.127360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 19 19:46:18.144707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Request method failure captured: Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 1751 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1woGHgtrPJ4Ck_WuM3GD08kgsKjgPcSOJpQusaizWPKQyVeMYkZTTeL1LZe31VMYfFnVvg0ww58Ch3OAzgcqTlQpu8srS2QMs7qgjbcY3Jp9-qHrXDYCLkKso-8Ye0_93T6lxTLppiNRv_82sJdsyydcHAdXrIwyEVS5fypKwPAmTAw Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 19a68066c1834654bedcb591779e1517 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-942995583 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19a68066c1834654bedcb591779e1517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19a68066c1834654bedcb591779e1517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19a68066c1834654bedcb591779e1517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19a68066c1834654bedcb591779e1517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-942995583 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 19a68066c1834654bedcb591779e1517 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-942995583 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-942995583-project Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 954b6bf8575f484d8eb4926a009360c6 Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-942995583-project Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-241623499", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:18.150584 n-d-843834-3 devstack@n-api.service[131230]: exception: Maximum number of metadata items exceeds 128 Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-241623499', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:18.154099 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 19 19:46:18.157979 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:18.162572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:18.163791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d266e9ce-453a-4198-bd79-3a1063ba675d tempest-AbsoluteLimitsNegativeTestJSON-942995583 tempest-AbsoluteLimitsNegativeTestJSON-942995583-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.302502 Jul 19 19:46:18.166598 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 813/1623] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Jul 19 19:46:16 2022] POST /compute/v2.1/servers => generated 87 bytes in 1308 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:18.185430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f1f22a8-3970-4921-a801-d8f951d8a614 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 0.563741 Jul 19 19:46:18.188549 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 811/1624] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:17 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:18.197449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.198058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:18.200085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-63588a63-9d57-4156-85e9-faf6d8020a52 req-6f7c90a5-5fef-424e-be43-7f7616be4dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:18.215279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-63588a63-9d57-4156-85e9-faf6d8020a52 req-6f7c90a5-5fef-424e-be43-7f7616be4dd6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.225150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.225593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.226376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.231746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-63588a63-9d57-4156-85e9-faf6d8020a52 req-6f7c90a5-5fef-424e-be43-7f7616be4dd6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.236837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.268665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-63588a63-9d57-4156-85e9-faf6d8020a52 req-6f7c90a5-5fef-424e-be43-7f7616be4dd6 service nova] Creating event network-changed:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:46:18.276791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-63588a63-9d57-4156-85e9-faf6d8020a52 req-6f7c90a5-5fef-424e-be43-7f7616be4dd6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108649 Jul 19 19:46:18.278110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 814/1625] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:18.286284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcd68d39-6fa2-4fe1-b9f7-1fca93650878 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef43a0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.370473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcd68d39-6fa2-4fe1-b9f7-1fca93650878 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.090602 Jul 19 19:46:18.380584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 815/1626] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:18 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:18.589229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.598775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.605803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:18.612754 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be12fbf2-fe07-4210-8af1-31c44d5c299c tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1475 microversion: 2.25 time: 0.422505 Jul 19 19:46:18.621242 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 812/1627] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:18 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:18.652210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d1b08923-08c9-4110-bf35-26de8ab77ea1 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '.version_select at 0x7f23ef3151f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.663876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1b08923-08c9-4110-bf35-26de8ab77ea1 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.668039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1b08923-08c9-4110-bf35-26de8ab77ea1 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.686089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.687272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:18.704763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.705320 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d1b08923-08c9-4110-bf35-26de8ab77ea1 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2537 microversion: 2.25 time: 0.066248 Jul 19 19:46:18.717980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 816/1628] 10.222.0.23 () {60 vars in 1183 bytes} [Tue Jul 19 19:46:18 2022] GET /compute/v2.1/os-migrations => generated 2537 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:18.719082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.721432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.724699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.728700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:18.732882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:18.760817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.762564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:18.766583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:18.768745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:19.407516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:19.418333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:19.420958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:19.422584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d73d3fcd-eaa1-49f1-80ff-6f94496b869a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.759881 Jul 19 19:46:19.424032 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 813/1629] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:18 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:19.439652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:19.440660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:19.463458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:19.463936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:19.467201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:19.467668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:19.669622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] Lazy-loading 'services' on Instance uuid 77e26a50-74b8-4607-acbc-7c2346753274 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:19.709658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-adb71b9d-3734-4e67-870b-d40f132716b8 tempest-LiveAutoBlockMigrationV225Test-1292778616 tempest-LiveAutoBlockMigrationV225Test-1292778616-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1967 microversion: 2.25 time: 0.988909 Jul 19 19:46:19.724692 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 817/1630] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:18 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1967 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:19.734409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-930861a9-e8f0-430c-9454-41d2065c6057 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:19.787364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-930861a9-e8f0-430c-9454-41d2065c6057 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.061077 Jul 19 19:46:19.787965 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 818/1631] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:19 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:19.801028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:19.801549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:19.832170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:19.832677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:19.836640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:19.842203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:19.957834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:19.981165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:19.993684 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b9b9126-1d48-442f-9d1c-3977c7ce019b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 0.566271 Jul 19 19:46:19.996114 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 814/1632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:19 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:20.128331 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-472598a1-6315-4297-8db0-e7e362d4524b tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 204 len: 0 microversion: 2.25 time: 0.339089 Jul 19 19:46:20.135649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 819/1633] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:46:19 2022] DELETE /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:46:20.142887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:20.144018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:20.167046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:20.167861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:20.169183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:20.169884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:20.443302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:20.444668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:20.458836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:20.463583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:20.468683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:20.469481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.575358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:21.586729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:21.597460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:21.598719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2fa725d-35c9-4ca7-a495-48620a3c84dc tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1481 microversion: 2.25 time: 1.461836 Jul 19 19:46:21.609425 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 815/1634] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:20 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1481 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:21.614375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4413c700-18a6-436f-8ef5-0746908a3bee tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef849790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.691875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4413c700-18a6-436f-8ef5-0746908a3bee tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.081012 Jul 19 19:46:21.697906 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 816/1635] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:21.708178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:21.718391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:21.745114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.745843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:21.746953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:21.748014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:22.046089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.072544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.078863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.081877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d8e4969-0a0b-440e-9e1c-c64c4dca382d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.643815 Jul 19 19:46:22.085626 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 820/1636] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:20 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:22.439734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:22.452012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-def4dc7a-8e83-46d1-8b25-5a3cb3ad014b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 0.752530 Jul 19 19:46:22.458252 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 817/1637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:21 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:22.483969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-356697749", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:22.607814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:22.617276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:22.617876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:22.625266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:22.625722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:22.626514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:22.646616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:23.915221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:23.927767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:23.929305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:23.935922 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9dbd4011-2f45-4c3a-8d47-dfb2a8ca4e99 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1481 microversion: 2.25 time: 1.322664 Jul 19 19:46:23.937120 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 818/1638] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:22 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1481 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:23.953746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06fac1bf-b52a-4333-b742-6ce1d1c24d91 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef84d8b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:23.976246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:23.976846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:23.977334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:23.977745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:23.978161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:23.990344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=13 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:24.017110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.017566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.028559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.029260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.056762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06fac1bf-b52a-4333-b742-6ce1d1c24d91 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.116988 Jul 19 19:46:24.057642 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 819/1639] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:23 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:24.068123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:24.070475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:24.101497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:24.114101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.123119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.125216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.125832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.135362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for user 56b5e75a70bd48c392b0bede39f69e8c and project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:24.178238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:24.180608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:24.318940 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0883f2d7-163e-4a7b-b67f-eff551cc23a3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.231581 Jul 19 19:46:24.320968 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 821/1640] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:24.343301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9e0fd9e7-0276-4170-a35f-c0a86ac0183c req-53ab4768-65f1-4ce0-bd65-abf8c49427c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e26a50-74b8-4607-acbc-7c2346753274", "name": "network-vif-deleted", "tag": "3803d5fc-5918-4740-89a9-27f473b08c07"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:24.384184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9e0fd9e7-0276-4170-a35f-c0a86ac0183c req-53ab4768-65f1-4ce0-bd65-abf8c49427c9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.385035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9e0fd9e7-0276-4170-a35f-c0a86ac0183c req-53ab4768-65f1-4ce0-bd65-abf8c49427c9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.419386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9e0fd9e7-0276-4170-a35f-c0a86ac0183c req-53ab4768-65f1-4ce0-bd65-abf8c49427c9 service nova] Creating event network-vif-deleted:3803d5fc-5918-4740-89a9-27f473b08c07 for instance 77e26a50-74b8-4607-acbc-7c2346753274 on n-h1-843834-3 Jul 19 19:46:24.425947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9e0fd9e7-0276-4170-a35f-c0a86ac0183c req-53ab4768-65f1-4ce0-bd65-abf8c49427c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102785 Jul 19 19:46:24.429260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 822/1641] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:24.445639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:24.446363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:24.465671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.466137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:24.467024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:24.467449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:26.069818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.088291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.097675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.103031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.105583 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49f8c71e-b489-4135-8771-6ed177077705 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 2.046680 Jul 19 19:46:26.111799 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 820/1642] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:24 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:26.126852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-552884383", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:26.142033 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-38826257-c44d-486e-ab78-fd8b8d9c628d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 1.711358 Jul 19 19:46:26.143725 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 823/1643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:24 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:26.152177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.153715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:26.171576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:26.172741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:26.175329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:26.177239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:26.278362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:26.624939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.642721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.645277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:26.654249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e094dc51-a451-45b9-b0b3-3dff3c6ad5f4 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.503069 Jul 19 19:46:26.658187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 824/1644] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:26 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:26.667285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f0052bc8-0092-4b48-b89e-3536541c5b36 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef334160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:26.770687 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f0052bc8-0092-4b48-b89e-3536541c5b36 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.111172 Jul 19 19:46:26.771363 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 825/1645] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:26 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:27.138424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:27.139154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:27.160266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.163621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.164826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.170048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.889777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:27.890302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:27.890710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:27.891146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:27.891916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:27.913168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.915532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.918193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:27.919705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:27.979610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:27.993186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for user 56b5e75a70bd48c392b0bede39f69e8c and project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:28.028381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:28.039010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:28.100282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.123920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.128410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.135013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-503d2e38-58e6-45e6-b2db-b6610908f654 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.007876 Jul 19 19:46:28.155694 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fcceec96-7eaf-47d1-bc66-91903847c5d2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.041925 Jul 19 19:46:28.156353 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 821/1646] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:28.164874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 826/1647] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:27 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:28.169373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.178022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:28.180582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-14011c1e-3fb5-4f92-8469-f6cec52ddc2d req-91624897-47b8-4941-9e0c-cccf61d771a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "name": "network-vif-plugged", "status": "completed", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:28.203640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.204448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.208482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.209848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.217413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-14011c1e-3fb5-4f92-8469-f6cec52ddc2d req-91624897-47b8-4941-9e0c-cccf61d771a4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.219010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-14011c1e-3fb5-4f92-8469-f6cec52ddc2d req-91624897-47b8-4941-9e0c-cccf61d771a4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.267156 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-14011c1e-3fb5-4f92-8469-f6cec52ddc2d req-91624897-47b8-4941-9e0c-cccf61d771a4 service nova] Creating event network-vif-plugged:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:46:28.276469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-14011c1e-3fb5-4f92-8469-f6cec52ddc2d req-91624897-47b8-4941-9e0c-cccf61d771a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106329 Jul 19 19:46:28.282012 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 827/1648] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:28.312432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.313658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:28.347926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.348634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.349705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:28.353493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:28.625660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.646797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.648455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:28.660405 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8ea06e9-9421-4b3f-abbb-7352c14f89fd tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.376481 Jul 19 19:46:28.661501 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 828/1649] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:28.666698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d4bea78-8f10-4079-aee9-1ad9dc3d0028 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2c31f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:28.751758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d4bea78-8f10-4079-aee9-1ad9dc3d0028 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.089088 Jul 19 19:46:28.753238 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 829/1650] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:29.168185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8f1b29e-1f4a-4812-a530-7f2664c50da2 tempest-ListImageFiltersNegativeTestJSON-633370508 tempest-ListImageFiltersNegativeTestJSON-633370508-project] Calling method '.version_select at 0x7f23ef31a9d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.200530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:29.208707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e8f1b29e-1f4a-4812-a530-7f2664c50da2 tempest-ListImageFiltersNegativeTestJSON-633370508 tempest-ListImageFiltersNegativeTestJSON-633370508-project] HTTP exception thrown: Image not found. Jul 19 19:46:29.213521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48691784-d5bc-46bf-9b7e-98d139024a9d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 1.052622 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8f1b29e-1f4a-4812-a530-7f2664c50da2 tempest-ListImageFiltersNegativeTestJSON-633370508 tempest-ListImageFiltersNegativeTestJSON-633370508-project] Request method failure captured: Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/images/53176428-0108-4eea-b8ed-230c5822c9e7 HTTP/1.1 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1woTJ1V5i_wq0Pc0XIeSfkDqUxJDGSLhB1msj53bIb4X7Ze-qfBbpDt34MQN6Jlk0OvPaibD42FnDsghikqyaZo9U_ciqTcGbzc1hP8lTE-oMqgHVHApsbBQ0OSrUZyrQsH6cZzUr1Ri1KQWnSX8EgwEmZx0FKOfHNwNwvvBkoJxBlI Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b7fe153e97114678871ae4a273c36d20 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-633370508 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7fe153e97114678871ae4a273c36d20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7fe153e97114678871ae4a273c36d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7fe153e97114678871ae4a273c36d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7fe153e97114678871ae4a273c36d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-633370508 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b7fe153e97114678871ae4a273c36d20 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-633370508 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListImageFiltersNegativeTestJSON-633370508-project Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0b5041392fc34047b89bbeb0870d24a5 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-633370508-project Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '53176428-0108-4eea-b8ed-230c5822c9e7'} Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53176428-0108-4eea-b8ed-230c5822c9e7 Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:46:29.216127 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53176428-0108-4eea-b8ed-230c5822c9e7 could not be found. Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:46:29.220846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:29.229940 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 822/1651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:29.231007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8f1b29e-1f4a-4812-a530-7f2664c50da2 tempest-ListImageFiltersNegativeTestJSON-633370508 tempest-ListImageFiltersNegativeTestJSON-633370508-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:29.232097 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8f1b29e-1f4a-4812-a530-7f2664c50da2 tempest-ListImageFiltersNegativeTestJSON-633370508 tempest-ListImageFiltersNegativeTestJSON-633370508-project] 10.222.0.23 "GET /compute/v2.1/images/53176428-0108-4eea-b8ed-230c5822c9e7" status: 404 len: 62 microversion: 2.1 time: 0.477504 Jul 19 19:46:29.236630 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 830/1652] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:28 2022] GET /compute/v2.1/images/53176428-0108-4eea-b8ed-230c5822c9e7 => generated 62 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:46:29.254862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.255547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:29.267801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:29.268429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:29.288616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.289103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.289913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.290362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.316888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.317356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:29.324206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:29.328435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.110007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.129362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.146397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.147698 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe559a4b-dd4b-4ae6-9fde-00637b02d10e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.907242 Jul 19 19:46:30.148264 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 831/1653] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:30.166135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.167066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:30.175775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.177244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.178240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.178850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.186196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:30.192023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.200768 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03c9319d-815d-4abb-8732-42b4075435c9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1217 microversion: 2.1 time: 0.971304 Jul 19 19:46:30.211972 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 823/1654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:29 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1217 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:30.219722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-09ee8cee-1d3e-4611-bdab-edd8531c748f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef640310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.280642 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-09ee8cee-1d3e-4611-bdab-edd8531c748f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.066860 Jul 19 19:46:30.285600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 824/1655] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:30 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:30.299124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:30.302571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:30.345260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.346307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.347435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:30.349219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:30.468494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.481256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.504330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.510333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f26b907-5c17-4385-9cb8-b506a0b6e415 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.348670 Jul 19 19:46:30.514715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 832/1656] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:30 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:30.783313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:30.804571 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0697ca7f-d4da-4586-87b1-70fd2049a99f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1357 microversion: 2.1 time: 0.517457 Jul 19 19:46:30.808737 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 825/1657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:30 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1357 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:31.181284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.182615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:31.203023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.204234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.208798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.209715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.218972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.220894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:31.236604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.245898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.249584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.253945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.730324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:31.744880 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-24f955ec-231f-4bba-898b-b95a6a9fd8bd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1283 microversion: 2.1 time: 0.528047 Jul 19 19:46:31.749454 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 826/1658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1283 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:31.758027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d88a1e2d-e74a-4478-850f-1ff7d14cfe07 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef849ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.900469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d88a1e2d-e74a-4478-850f-1ff7d14cfe07 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.147101 Jul 19 19:46:31.903821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 827/1659] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:31.929528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:31.933434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:31.963040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.967917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:31.970213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:31.974905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:32.260117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.279949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.286499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.291868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fbf08167-8a67-477d-a4e8-6d8978aeac25 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.384956 Jul 19 19:46:32.298054 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 828/1660] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:32.312319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:32.316741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:32.336598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.340847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:32.342524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.344826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:32.578065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.598037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.599732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:32.600933 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ea9feeaa-dc4c-4646-9bea-e748474d272d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.433889 Jul 19 19:46:32.620559 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 833/1661] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:31 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:32.767894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:32.768620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:32.783551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.784165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:32.784991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:32.785462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.409085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.428042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d39c895c-1fa2-487a-b057-a8762fa5056b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1539 microversion: 2.1 time: 1.128268 Jul 19 19:46:33.442458 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 829/1662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:32 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1539 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:33.448345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0446041d-84a7-4551-8b08-e27ff32ea73c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef5ce9d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:33.454514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:33.475704 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-343967f6-2814-409c-85ed-5565343d2ce4 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1271 microversion: 2.1 time: 0.713777 Jul 19 19:46:33.476801 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 834/1663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:32 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1271 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:33.491483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:33.492071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:33.510308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.510798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.511720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.512210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.644888 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0446041d-84a7-4551-8b08-e27ff32ea73c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.200816 Jul 19 19:46:33.646835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 830/1664] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:33 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:33.669673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:33.679867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:33.768589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.769124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.788917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:33.794250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:33.882639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:34.081270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:34.166301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:34.264360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:34.281881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:34.285938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:34.292929 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-530ce0b8-8334-4895-a4d3-8a0300226e51 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.805431 Jul 19 19:46:34.297526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 835/1665] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:33 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:34.308268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:34.314195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:34.333243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.333911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:34.335068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:34.335687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:35.384130 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-691aed25-e357-452f-9f83-b10fc9f81e66 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.736105 Jul 19 19:46:35.385242 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 831/1666] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:46:33 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-interface => generated 284 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:35.391093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:35.391944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:35.421121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:35.425690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:35.426801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:35.433401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.246348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.268271 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ace37b24-7303-4e20-97c4-486a652d7748 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 1.881721 Jul 19 19:46:37.270596 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 832/1667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:35 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:37.289664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8c6a325-3431-43a8-b9f0-a2afb65804a9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef808430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:37.381247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8c6a325-3431-43a8-b9f0-a2afb65804a9 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.109180 Jul 19 19:46:37.381776 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 833/1668] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:37 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:37.392306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:37.392921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:37.446549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.447350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.448237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.448688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.759936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.774396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.776143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.779780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f681c1e3-fdac-4106-a780-bef0f5912579 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 200 len: 1265 microversion: 2.25 time: 0.396938 Jul 19 19:46:37.782601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 834/1669] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:37 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:37.791698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-af5276ad-6261-4bfb-8efd-c5b41b56b659 req-bf7cd205-2f24-48f3-b33c-eee97e951de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06951cb-806f-4404-aecb-382385611932", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:37.815476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-af5276ad-6261-4bfb-8efd-c5b41b56b659 req-bf7cd205-2f24-48f3-b33c-eee97e951de4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:37.815989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-af5276ad-6261-4bfb-8efd-c5b41b56b659 req-bf7cd205-2f24-48f3-b33c-eee97e951de4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:37.848980 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-af5276ad-6261-4bfb-8efd-c5b41b56b659 req-bf7cd205-2f24-48f3-b33c-eee97e951de4 service nova] Creating event network-changed:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:46:37.861042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-af5276ad-6261-4bfb-8efd-c5b41b56b659 req-bf7cd205-2f24-48f3-b33c-eee97e951de4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074941 Jul 19 19:46:37.863495 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 835/1670] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:37.882643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.901993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.911358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:37.916682 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ad1a430-d4ab-426a-91e4-54191de4256d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 3.616806 Jul 19 19:46:37.917967 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 836/1671] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:34 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 3619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:37.947948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:38.015210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:38.132239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1956467610", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:38.262947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:38.263654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:38.264075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:38.264544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:38.264970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:38.285610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:38.287600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:38.315106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.323125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.324177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.324642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.333720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.334190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.342289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.347008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.477618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Getting quotas for project fa4ac34a63f8439b9adde6c97175af48. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:38.531549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Getting quotas for user a6cd2ff93a6d435ca79dbc12d225069c and project fa4ac34a63f8439b9adde6c97175af48. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:38.569388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:38.573168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:38.665892 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e9603d3-82da-46ac-b58a-1923056ebe0b tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.800792 Jul 19 19:46:38.667468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 836/1672] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:46:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:46:38.677367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f50b576-9266-44b5-8a2e-8dcddaf07d15 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef84dca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:38.804767 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f50b576-9266-44b5-8a2e-8dcddaf07d15 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.135956 Jul 19 19:46:38.806424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 837/1673] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:38 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:38.819127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-638dafca-65a4-44f1-8446-b8b8937f5d7f req-85038df8-4104-4f0c-aed9-0682d17663c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:38.855945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-638dafca-65a4-44f1-8446-b8b8937f5d7f req-85038df8-4104-4f0c-aed9-0682d17663c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:38.861545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-638dafca-65a4-44f1-8446-b8b8937f5d7f req-85038df8-4104-4f0c-aed9-0682d17663c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:38.905485 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-638dafca-65a4-44f1-8446-b8b8937f5d7f req-85038df8-4104-4f0c-aed9-0682d17663c3 service nova] Creating event network-changed:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:46:38.944412 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-638dafca-65a4-44f1-8446-b8b8937f5d7f req-85038df8-4104-4f0c-aed9-0682d17663c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131309 Jul 19 19:46:38.951060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 838/1674] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:38.971366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:38.972051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:39.315312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:39.338506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:39.345107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:39.348401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8f32600-f8bb-438a-b6fc-8a560fe60196 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1281 microversion: 2.47 time: 0.396693 Jul 19 19:46:39.351103 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 839/1675] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:38 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1281 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:39.366473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:39.371816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 77e26a50-74b8-4607-acbc-7c2346753274] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:39.412588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.413401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.414413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.415074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.456275 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] HTTP exception thrown: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Request method failure captured: Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 HTTP/1.1 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiJJr-5PLgC9ZVBioQKT5i5Be7PBg-6CJ6JhruZWD8Bti99R40DleNLgWc9GTN10B6UseOBH-q6oaTJjetYqSk9f8PZvdoairUUU_UKt78s13wl-BCpCg0IGZOPxBAEQyE4zhu5Pq4ta6Vr5Rz-bKgBDFWuqtWgLs9s0Ho5A7CLgoo Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df971d67f21747f2afa56647d78a7fa5 Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '77e26a50-74b8-4607-acbc-7c2346753274'} Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. Jul 19 19:46:39.461059 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. Jul 19 19:46:39.466404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:46:39.477296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Returning 404 to user: Instance 77e26a50-74b8-4607-acbc-7c2346753274 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:39.481640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3274f54-87a4-424c-b75c-33efc9fe8ead tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274" status: 404 len: 111 microversion: 2.25 time: 0.129187 Jul 19 19:46:39.484171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 840/1676] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:39 2022] GET /compute/v2.1/servers/77e26a50-74b8-4607-acbc-7c2346753274 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:39.499492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:39.500539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:39.514932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.519871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.521347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:39.522005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:39.600088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:39.621815 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6056b53b-fe63-4688-91ef-be9669dd7587 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 1.339026 Jul 19 19:46:39.625701 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 837/1677] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:38 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:39.819972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a567400-26d2-4f39-bf2e-60a473d34a4c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2c3940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:39.985404 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a567400-26d2-4f39-bf2e-60a473d34a4c tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1452 microversion: 2.1 time: 0.171335 Jul 19 19:46:39.986280 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 838/1678] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:39 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:40.369179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:40.375867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:40.381684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:40.387122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:40.389064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:40.396700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8624da03-c5d5-4858-a6ec-c7ff3a0a0797 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.910973 Jul 19 19:46:40.397849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 841/1679] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:39 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:40.405163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.419574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.426618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.430354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.642378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:40.643220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:40.668881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.675292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.678245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:40.682595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:40.980188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:41.025940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:41.032126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:41.046519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-536d7d56-40d3-4ee3-ab7d-0097c47aa572 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1277 microversion: 2.47 time: 0.680361 Jul 19 19:46:41.049490 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 839/1680] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:40 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1277 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:41.076355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b22ad227-8773-42f5-8332-53bb19275958 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef31a040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.208616 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b22ad227-8773-42f5-8332-53bb19275958 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1461 microversion: 2.1 time: 0.146273 Jul 19 19:46:41.222469 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 840/1681] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1461 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:41.233821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4280ba2f-0b96-414e-80e4-f81a2afecf05 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef4064c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.345365 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4280ba2f-0b96-414e-80e4-f81a2afecf05 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 200 len: 1461 microversion: 2.1 time: 0.121209 Jul 19 19:46:41.346308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 841/1682] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 1461 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:41.360539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f0aadf0f-a6e6-498c-a786-ba50fcb024eb req-ba99ffe6-4e1b-4aec-854e-b0ef6ace468d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602ff957-ac05-42f0-9642-43ae5f9f01ce", "tag": "e14abde6-a20f-4e64-b446-f9681dcb0a1d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:41.399200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0aadf0f-a6e6-498c-a786-ba50fcb024eb req-ba99ffe6-4e1b-4aec-854e-b0ef6ace468d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.399650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0aadf0f-a6e6-498c-a786-ba50fcb024eb req-ba99ffe6-4e1b-4aec-854e-b0ef6ace468d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.437607 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f0aadf0f-a6e6-498c-a786-ba50fcb024eb req-ba99ffe6-4e1b-4aec-854e-b0ef6ace468d service nova] Creating event network-changed:e14abde6-a20f-4e64-b446-f9681dcb0a1d for instance 602ff957-ac05-42f0-9642-43ae5f9f01ce on n-h2-843834-3 Jul 19 19:46:41.450106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f0aadf0f-a6e6-498c-a786-ba50fcb024eb req-ba99ffe6-4e1b-4aec-854e-b0ef6ace468d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101947 Jul 19 19:46:41.460113 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 842/1683] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:41.473567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.474547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:41.500109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.500867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.502506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.503735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.688726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:41.704237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92e0dd4e-c031-416c-b3d6-09aeffbca2f8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 1.066121 Jul 19 19:46:41.713541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 842/1684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:40 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:41.718855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:41.719722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:41.730777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.733652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:41.736485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:41.737448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.727987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.750775 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5fdeb424-fe79-4a5c-90d4-9cc72791f9ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1479 microversion: 2.1 time: 1.286248 Jul 19 19:46:42.751532 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 843/1685] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1479 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:42.838436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5fbb7a0-d0c0-4c6a-960e-c6e8758dfc1a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Action: 'create', calling method: .version_select at 0x7f23ef3b3940>, body: {"keypair": {"name": "tempest-keypair-1156135663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLroec2XC++R6ayJ0q/x+/DNcKbS+RhuXPVwuslxniAfIxtd1LDYds4TIzjbsyfQnPJ/wbsg8CBaZwTckfdRl+P0I6Gspl8zGqjAKc+WnICjCJL0eBr6+UxA1dCamKqISw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:42.856831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a5fbb7a0-d0c0-4c6a-960e-c6e8758dfc1a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for project f39d6bb03fa345c3932aa6a424d3bea8. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:42.863504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a5fbb7a0-d0c0-4c6a-960e-c6e8758dfc1a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for user b4c97c21fd434d93a40ec91931e45dfe and project f39d6bb03fa345c3932aa6a424d3bea8. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:42.893662 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5fbb7a0-d0c0-4c6a-960e-c6e8758dfc1a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138749 Jul 19 19:46:42.895019 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 844/1686] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:46:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:42.901336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:42.902722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:42.909991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:42.915413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:42.916308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.917692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:42.918619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:42.930081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.948842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.955773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:42.961988 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58bc6edc-6944-47d8-99ad-53e86037b399 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.247046 Jul 19 19:46:42.963898 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 843/1687] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:41 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:42.974770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-61db9368-f952-48a9-8323-79e759ea0bb4 req-38f06232-d03f-465b-9c15-59ca7ac2c509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "5911f022-61d0-4f7e-b597-1a2a6e26d952"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:42.999548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61db9368-f952-48a9-8323-79e759ea0bb4 req-38f06232-d03f-465b-9c15-59ca7ac2c509 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.000391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61db9368-f952-48a9-8323-79e759ea0bb4 req-38f06232-d03f-465b-9c15-59ca7ac2c509 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.050046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-61db9368-f952-48a9-8323-79e759ea0bb4 req-38f06232-d03f-465b-9c15-59ca7ac2c509 service nova] Creating event network-vif-plugged:5911f022-61d0-4f7e-b597-1a2a6e26d952 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:43.064896 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-61db9368-f952-48a9-8323-79e759ea0bb4 req-38f06232-d03f-465b-9c15-59ca7ac2c509 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099053 Jul 19 19:46:43.069390 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 844/1688] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:43.078217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.083164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:43.109739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.110509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.112881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.113721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.218517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.228717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.234630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.235908 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba04ec32-ecd2-4cbb-a680-20a22d2e6f80 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1339 microversion: 2.47 time: 0.339682 Jul 19 19:46:43.236508 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 845/1689] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:42 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1339 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:43.760724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:43.771239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.771898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:43.772787 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d429a772-e384-4c44-889a-3f6b77f3f862 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.700765 Jul 19 19:46:43.782820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 845/1690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:43.785267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.785963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.787337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:43.787933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:43.992822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:43.994802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.016502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.019863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.024605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.026984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.126330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.139419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-314c106e-c263-4ec0-9c45-801374064030 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1466 microversion: 2.1 time: 0.374119 Jul 19 19:46:44.146439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 846/1691] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1466 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:46:44.284857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8929bc5-12b6-41ab-aab7-b4a05aa8a345 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Action: 'create', calling method: .version_select at 0x7f23ef2dec10>, body: {"keypair": {"name": "tempest-keypair-236683161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd46Chqa9i9+PwCU6QOqF77Sz+IIU60iv163KKXW4SSb3SKi8dFiTzOZGuVZg3KPSnW9Dv0norEW44pVfHb4/A1pg8C462PYK0F0V8B1mVdV2+WMlZTfsww6y4BknuF/A=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:44.398491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d8929bc5-12b6-41ab-aab7-b4a05aa8a345 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Getting quotas for project c72a75cc5e534c1fb9e5f553509ccdba. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:44.430679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d8929bc5-12b6-41ab-aab7-b4a05aa8a345 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Getting quotas for user de77e9b9c0784bd2a8e886fa7f0ebab1 and project c72a75cc5e534c1fb9e5f553509ccdba. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:44.549549 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8929bc5-12b6-41ab-aab7-b4a05aa8a345 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.395515 Jul 19 19:46:44.552987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 847/1692] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:46:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:44.565320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1002634735"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:44.575498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.592811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.594405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.602675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.603549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.769213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.781603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.804227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:44.807497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a912b433-4021-4753-add6-a1edfae3a66f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.825722 Jul 19 19:46:44.813810 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 846/1693] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:43 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:44.823594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:44.851797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:44.872106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.875612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:44.876380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:44.879787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.085856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.095799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.104840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.106577 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d499a5b4-eb5b-4522-bf24-2742742e5947 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1360 microversion: 2.47 time: 0.291554 Jul 19 19:46:45.107797 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 847/1694] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:44 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:45.127199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:45.127741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:45.164299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.165348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.166356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.166994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.587570 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c9bf214-a350-4c22-bd3e-3b563c7fee48 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "POST /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d/action" status: 202 len: 0 microversion: 2.1 time: 1.032648 Jul 19 19:46:45.593470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 848/1695] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:46:44 2022] POST /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d/action => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:46:45.630941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-131615336"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:45.632687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:45.684366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.695758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.701592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:45.705084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:45.973496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:45.991999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-37c0167b-1096-4df4-a4c3-8e76fd9023ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.878600 Jul 19 19:46:45.992926 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 848/1696] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:45 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:46.018784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-10f9fd7d-6001-4300-8b1c-8ab67e812437 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef84dca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.157578 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-10f9fd7d-6001-4300-8b1c-8ab67e812437 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.160240 Jul 19 19:46:46.164160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 849/1697] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:45 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:46.178237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.180140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:46.211187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.224950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.227002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.227663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.556831 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f542c6fa-d61f-4eac-ae3a-0373386f31d0 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "POST /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6/action" status: 202 len: 52 microversion: 2.47 time: 0.952673 Jul 19 19:46:46.563880 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 849/1698] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:46:45 2022] POST /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6/action => generated 52 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:46:46.586465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-07bb7cba-3350-4b2f-83e4-17dc1b5150ca req-c79c2323-8338-44c0-b013-98b1cfc75695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-unplugged", "status": "completed", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:46.615470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07bb7cba-3350-4b2f-83e4-17dc1b5150ca req-c79c2323-8338-44c0-b013-98b1cfc75695 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.616946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07bb7cba-3350-4b2f-83e4-17dc1b5150ca req-c79c2323-8338-44c0-b013-98b1cfc75695 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.653043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07bb7cba-3350-4b2f-83e4-17dc1b5150ca req-c79c2323-8338-44c0-b013-98b1cfc75695 service nova] Creating event network-vif-unplugged:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:46:46.670930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-07bb7cba-3350-4b2f-83e4-17dc1b5150ca req-c79c2323-8338-44c0-b013-98b1cfc75695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103757 Jul 19 19:46:46.678774 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 850/1699] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:46.689998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:46.696795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:46.747725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.750437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.751723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:46.758315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:46.864491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:46.931592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:47.058887 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4087a83d-7097-412b-aeef-59ac1588db01 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 204 len: 0 microversion: 2.47 time: 0.377261 Jul 19 19:46:47.062667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 851/1700] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:46:46 2022] DELETE /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:46:47.073430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.077068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:47.096168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.097433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.098522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.099301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.356803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.384516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.392914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.400128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55972139-bf2b-45ba-8c02-d5c8604f89b7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.233283 Jul 19 19:46:47.400760 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 850/1701] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:46 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:47.416334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.426424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:47.455282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.469770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.471203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.486821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.651383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.669149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.681277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.682274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44751c7d-1c89-492b-a7a4-602372c2b1bb tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1366 microversion: 2.47 time: 0.273377 Jul 19 19:46:47.684108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 851/1702] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:47.689420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d296235-0a78-40ae-83e8-25bb56e923fe tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef865e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.787185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d296235-0a78-40ae-83e8-25bb56e923fe tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.101597 Jul 19 19:46:47.787904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 852/1703] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:47.797585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1291770391", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1eec50ab-c0b7-4cfc-ba86-9ee80d840f46"}], "security_groups": [{"name": "tempest-securitygroup--2080138056"}], "key_name": "tempest-keypair-1156135663", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:47.837229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:47.840423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:47.853995 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ebc8c222-8887-4964-a41b-f1c3ed195328 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.792547 Jul 19 19:46:47.866566 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 852/1704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:47 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:47.906750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:47.907930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:47.932447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.932844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:47.940083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:47.941565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.011889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:48.115623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] validate_networks() for [('1eec50ab-c0b7-4cfc-ba86-9ee80d840f46', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:48.195746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99b8458d-6f01-4e2e-bba4-1e52bfa91c14 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 204 len: 0 microversion: 2.25 time: 0.293143 Jul 19 19:46:48.210340 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 853/1705] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:46:47 2022] DELETE /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:46:48.227007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:48.235539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:48.265796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.266636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.267712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.268379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.429334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:48.578307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.590254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.592688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:48.594652 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6109fe62-41aa-4a7f-822e-77a48a6ffb41 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1731 microversion: 2.25 time: 0.372746 Jul 19 19:46:48.595585 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 854/1706] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:48.623807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:48.624810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:48.632113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.632935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:48.633981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:48.634630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.156578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for project f39d6bb03fa345c3932aa6a424d3bea8. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:49.171581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for user b4c97c21fd434d93a40ec91931e45dfe and project f39d6bb03fa345c3932aa6a424d3bea8. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:49.201984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:49.202413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:49.203913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:49.204325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:49.204739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:49.230640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.231118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.250788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.251829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.288699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for project f39d6bb03fa345c3932aa6a424d3bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:49.300075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Getting quotas for user b4c97c21fd434d93a40ec91931e45dfe and project f39d6bb03fa345c3932aa6a424d3bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:49.322959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:49.326925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:49.387681 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1a3fc7e-c6d6-44fc-bff1-0cee4a35fc1b tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.598694 Jul 19 19:46:49.388732 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 853/1707] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:49.394632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.395539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.402833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.403334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.404969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.405686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.668901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.678444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.679982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.681241 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3340bee4-e899-4e1c-bfec-0feca17c4864 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1366 microversion: 2.47 time: 0.291488 Jul 19 19:46:49.702748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 854/1708] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:49.718976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f47ca9f9-af4f-424a-bc08-c761748920d1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef76f670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.831100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f47ca9f9-af4f-424a-bc08-c761748920d1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.115956 Jul 19 19:46:49.832484 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 855/1709] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:49.840230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "38d23398-5706-4a45-866a-d09a387294c0"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "7168f45a-88d6-4b33-8b84-0152aeee34d0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:49.865771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.866465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.894302 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] Creating event network-vif-plugged:38d23398-5706-4a45-866a-d09a387294c0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:49.895091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] Creating event network-vif-plugged:7168f45a-88d6-4b33-8b84-0152aeee34d0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:49.901406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.909628 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d27b237f-9b3e-49fa-9ad1-6bef55c2ced1 req-e97530b3-e2d7-43c6-9def-cc03143bdaeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075287 Jul 19 19:46:49.910619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 856/1710] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:49.929949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.930867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:49.931589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:49.941407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.942491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.943467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:49.944066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:49.953107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:49.963086 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d27da3bc-4d64-4497-a5d3-7e66dea2e07c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.350995 Jul 19 19:46:49.965512 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 855/1711] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:48 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:50.012309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49b6a392-83aa-4079-94f4-4541969598d3 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.018844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49b6a392-83aa-4079-94f4-4541969598d3 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:50.201640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49b6a392-83aa-4079-94f4-4541969598d3 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.209736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49b6a392-83aa-4079-94f4-4541969598d3 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1278 microversion: 2.1 time: 0.224488 Jul 19 19:46:50.210342 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 856/1712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:50.222444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.230659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8907d289-d8cc-457a-8da4-41c0b22f9c42 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.307848 Jul 19 19:46:50.236875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.237531 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 857/1713] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:49 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:50.237667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:50.249694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b7e86426-88eb-4ee7-901c-7cbd79df336f"}], "security_groups": [{"name": "tempest-securitygroup--1094519563"}], "key_name": "tempest-keypair-236683161", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:50.251115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.251631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.252430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.252871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.660208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] validate_networks() for [('b7e86426-88eb-4ee7-901c-7cbd79df336f', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:46:50.725781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.741318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.745398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.748548 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ff401a4-f29b-479c-99b8-b2129c411881 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1731 microversion: 2.25 time: 0.537133 Jul 19 19:46:50.751252 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 857/1714] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:50 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1731 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:50.765194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:50.766966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:50.778825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.781238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.783417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.783852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.871741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:50.872793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:50.873477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lazy-loading 'fault' on Instance uuid a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:50.969581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.979694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.985720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6cd2ff93a6d435ca79dbc12d225069c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4ac34a63f8439b9adde6c97175af48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:50.988061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd471118-69f6-4e54-b20b-e02344e39d21 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 200 len: 1371 microversion: 2.47 time: 0.234832 Jul 19 19:46:51.001066 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 858/1715] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:50 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:51.010324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fca77431-3b18-40a5-98fb-941dac179979 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:51.121885 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fca77431-3b18-40a5-98fb-941dac179979 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.116869 Jul 19 19:46:51.121885 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 859/1716] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:51 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:51.132114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:51.132833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:51.158613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.174901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:51.180491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:51.182784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.032989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:46:52.033667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:46:52.034165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:46:52.034581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:46:52.035518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:46:52.078287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.081563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.085448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.087612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.143865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Getting quotas for project c72a75cc5e534c1fb9e5f553509ccdba. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:46:52.150052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Getting quotas for user de77e9b9c0784bd2a8e886fa7f0ebab1 and project c72a75cc5e534c1fb9e5f553509ccdba. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:46:52.188053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:46:52.193347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.196267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:46:52.211958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.214734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.216859 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bac0a9fe-7895-4dfb-959e-c861e2251c92 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.095715 Jul 19 19:46:52.217667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 860/1717] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:51 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:52.223247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.224169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.244255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.245888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.246959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.247500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.339548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86204193-f7ee-4bfe-a7f1-d8141632dc85 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.100445 Jul 19 19:46:52.351266 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 858/1718] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:46:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:46:52.362724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.363706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.376854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.382051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.382785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.383901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.384465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.385092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29320d02-731b-4f37-a62a-2103476fb957 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1336 microversion: 2.1 time: 0.165650 Jul 19 19:46:52.392233 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 861/1719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:52.408942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.413188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.431585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.433046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:52.443312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.444154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.444605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.524314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.525048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.525914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lazy-loading 'fault' on Instance uuid b9a4442c-6871-400e-9654-315913202748 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:46:52.632502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.655389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.659242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.663420 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e9f327cb-144c-4b88-92b7-57fea3c27de9 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 200 len: 1374 microversion: 2.25 time: 0.268071 Jul 19 19:46:52.669200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 862/1720] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:52.679926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.682793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] [instance: a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:52.697131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.697680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.698771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.709169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.740311 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] HTTP exception thrown: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Request method failure captured: Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 HTTP/1.1 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wob18HJaxc7P-xpB8Itp1hLph3EwpGoc3gOvMx_8uRVWNgYt83zQdopOxpJJT-hCh9ttVDLM0QGvTXzZtsjxgzMClrCeKRuB48wZ_jYTCsGRh15uLIYeHWLlEEDqF82j0FhU-EPy45e7Vpf27LGwTuOn1z8t_mEMXCAzj5-pXii35A Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: fa4ac34a63f8439b9adde6c97175af48 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAaction247Test-1619390814 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4ac34a63f8439b9adde6c97175af48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4ac34a63f8439b9adde6c97175af48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4ac34a63f8439b9adde6c97175af48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4ac34a63f8439b9adde6c97175af48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAaction247Test-1619390814 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: fa4ac34a63f8439b9adde6c97175af48 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAaction247Test-1619390814 Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAaction247Test-1619390814-project Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a6cd2ff93a6d435ca79dbc12d225069c Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAaction247Test-1619390814-project Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6'} Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:52.742223 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. Jul 19 19:46:52.747522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:52.750103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] Returning 404 to user: Instance a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:52.751316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c61f0f5-2530-4308-b032-827b85f86e43 tempest-ServersAaction247Test-1619390814 tempest-ServersAaction247Test-1619390814-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6" status: 404 len: 111 microversion: 2.47 time: 0.080513 Jul 19 19:46:52.752457 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 863/1721] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/a3d58a91-9e3b-4d86-9b1f-ba56c2e1d3a6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:52.760267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8ebe5b31-ac77-45a4-aaa1-99bfedce5c53 req-d6b1daf0-ee03-41d5-8bea-25f12c0b70ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "b2de3852-6a7d-42da-8fb1-52ee4948ff67"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:52.808687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8ebe5b31-ac77-45a4-aaa1-99bfedce5c53 req-d6b1daf0-ee03-41d5-8bea-25f12c0b70ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.809261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8ebe5b31-ac77-45a4-aaa1-99bfedce5c53 req-d6b1daf0-ee03-41d5-8bea-25f12c0b70ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.840538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:52.853571 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9c892cb4-da2e-4f8e-ae42-0876b2b86871 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.500633 Jul 19 19:46:52.866800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 859/1722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:52.871865 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8ebe5b31-ac77-45a4-aaa1-99bfedce5c53 req-d6b1daf0-ee03-41d5-8bea-25f12c0b70ee service nova] Creating event network-vif-plugged:b2de3852-6a7d-42da-8fb1-52ee4948ff67 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:52.879402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e2c8438d-de78-41ed-8094-6f137d4e44bf req-2ef93c10-2489-48e1-a446-23b63ec24d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4442c-6871-400e-9654-315913202748", "name": "network-vif-deleted", "tag": "611a95b5-efb2-4975-bd8b-ac84329a6c08"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:52.888772 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8ebe5b31-ac77-45a4-aaa1-99bfedce5c53 req-d6b1daf0-ee03-41d5-8bea-25f12c0b70ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130890 Jul 19 19:46:52.890132 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 864/1723] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:52.916505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cfded81a-3248-40e2-8d27-271cf41cdc5e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef6f6820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:52.929732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e2c8438d-de78-41ed-8094-6f137d4e44bf req-2ef93c10-2489-48e1-a446-23b63ec24d8e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:52.930454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e2c8438d-de78-41ed-8094-6f137d4e44bf req-2ef93c10-2489-48e1-a446-23b63ec24d8e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:52.976873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e2c8438d-de78-41ed-8094-6f137d4e44bf req-2ef93c10-2489-48e1-a446-23b63ec24d8e service nova] Creating event network-vif-deleted:611a95b5-efb2-4975-bd8b-ac84329a6c08 for instance b9a4442c-6871-400e-9654-315913202748 on n-h2-843834-3 Jul 19 19:46:52.992084 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e2c8438d-de78-41ed-8094-6f137d4e44bf req-2ef93c10-2489-48e1-a446-23b63ec24d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123741 Jul 19 19:46:52.995819 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 860/1724] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:53.007116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de08c596-3bc5-429f-aa96-e0a679127da4 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.009898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de08c596-3bc5-429f-aa96-e0a679127da4 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.083764 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cfded81a-3248-40e2-8d27-271cf41cdc5e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.192279 Jul 19 19:46:53.087110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 865/1725] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:53.188308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de08c596-3bc5-429f-aa96-e0a679127da4 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:53.197718 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de08c596-3bc5-429f-aa96-e0a679127da4 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1225 microversion: 2.1 time: 0.199522 Jul 19 19:46:53.200753 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 861/1726] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:52 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:53.240838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.242751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.263688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.265639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.266667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.270299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.409648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:53.410699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:53.427210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.429661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:53.431097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:53.432854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.020810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.054466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.062705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.070817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71d7676f-7430-4b7c-b566-5f7553444e84 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 0.832679 Jul 19 19:46:54.081008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 866/1727] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:53 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:54.105477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.111392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: b9a4442c-6871-400e-9654-315913202748] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:54.160131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.161471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.168534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.169809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.213065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.225455 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-028d12fb-00fe-422f-ae9b-e50d9fb321a2 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.819582 Jul 19 19:46:54.236551 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 862/1728] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:53 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:54.241816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] HTTP exception thrown: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Request method failure captured: Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 HTTP/1.1 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wiJJr-5PLgC9ZVBioQKT5i5Be7PBg-6CJ6JhruZWD8Bti99R40DleNLgWc9GTN10B6UseOBH-q6oaTJjetYqSk9f8PZvdoairUUU_UKt78s13wl-BCpCg0IGZOPxBAEQyE4zhu5Pq4ta6Vr5Rz-bKgBDFWuqtWgLs9s0Ho5A7CLgoo Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: df971d67f21747f2afa56647d78a7fa5 Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b9a4442c-6871-400e-9654-315913202748'} Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. Jul 19 19:46:54.251686 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. Jul 19 19:46:54.257349 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:46:54.266291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.267433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Returning 404 to user: Instance b9a4442c-6871-400e-9654-315913202748 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:46:54.268296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:54.277734 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8954db9-1dae-4ec6-99f2-10f4dbd983db tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748" status: 404 len: 111 microversion: 2.25 time: 0.194203 Jul 19 19:46:54.282079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 867/1729] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/servers/b9a4442c-6871-400e-9654-315913202748 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:46:54.289021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9a5c9da-9ddd-4117-822a-d4ac0673ae49 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313f70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.298479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.302315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.305738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.306410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.400688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9a5c9da-9ddd-4117-822a-d4ac0673ae49 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.117178 Jul 19 19:46:54.411625 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 868/1730] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:54.425105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.429793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:54.445708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.448387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.449628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:54.451501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:54.703342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.712848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3c6de5e-0ce8-4fef-b962-d3e979c4eb12 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1285 microversion: 2.1 time: 0.299715 Jul 19 19:46:54.723487 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 869/1731] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1285 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:54.729031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17124e71-0a39-4dce-81ee-3fa57a77bacf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '.version_select at 0x7f23ef2deb80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:54.768652 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17124e71-0a39-4dce-81ee-3fa57a77bacf tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448706897" status: 204 len: 0 microversion: 2.25 time: 0.043393 Jul 19 19:46:54.773918 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 870/1732] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jul 19 19:46:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448706897 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:46:54.800669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:54.810269 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6612764-dc99-4a94-993a-71f128982d0b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.571936 Jul 19 19:46:54.823267 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 863/1733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:54 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:55.005225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "eb5c3e1a-e4db-4ce9-b757-7d758d2f333c"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "f3487fb2-62f8-4a73-8c6a-542f7178db5a"}, {"server_uuid": "602ff957-ac05-42f0-9642-43ae5f9f01ce", "name": "network-vif-plugged", "status": "completed", "tag": "e14abde6-a20f-4e64-b446-f9681dcb0a1d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:55.029967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.030893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.089500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:55.089794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Creating event network-vif-plugged:eb5c3e1a-e4db-4ce9-b757-7d758d2f333c for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:55.090314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:55.097131 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Creating event network-vif-plugged:f3487fb2-62f8-4a73-8c6a-542f7178db5a for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:55.097805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] Creating event network-vif-plugged:e14abde6-a20f-4e64-b446-f9681dcb0a1d for instance 602ff957-ac05-42f0-9642-43ae5f9f01ce on n-h2-843834-3 Jul 19 19:46:55.111769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.112569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.113522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.123437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-07f00723-43ba-4dd2-a624-b823b5f4d0ff req-6b2862ab-eb9c-4ec0-a4f5-2aa636488187 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.121401 Jul 19 19:46:55.124032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.124854 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 871/1734] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:55.258181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:55.259623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:55.284454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.284921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:55.289519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:55.296333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.451868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.461701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.473925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.480671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-729d6506-b3ed-46cb-a050-48fb6e1eb28a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.393488 Jul 19 19:46:56.482756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 864/1735] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:55 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:46:56.495535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-15592af1-578f-4864-9b27-b6d44d4ba8ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef924c10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.600157 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15592af1-578f-4864-9b27-b6d44d4ba8ec tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.114932 Jul 19 19:46:56.603072 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 865/1736] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.618279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.620762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:46:56.624894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.625647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:56.633764 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab9b8dc9-57e4-4e15-be41-f0aa7916c24a tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 1.384557 Jul 19 19:46:56.634404 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 872/1737] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:55 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.651903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:56.652717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:56.659834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.660068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.660685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.661739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.662481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.663337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.664387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:56.664868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:56.951486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:56.965895 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1727f046-5714-4e3b-9671-abe9293d6be8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1283 microversion: 2.1 time: 0.360798 Jul 19 19:46:56.970036 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 866/1738] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1283 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:56.986857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3187991a-7f29-4a72-a2b3-2958dc8fe22a req-3c3b1adb-b6ad-4638-8b38-c1e179c9d8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43911b4-f882-4619-b398-71c3d4f3569a", "tag": "253db289-756a-4d65-bac8-ef499993f038"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:57.018392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3187991a-7f29-4a72-a2b3-2958dc8fe22a req-3c3b1adb-b6ad-4638-8b38-c1e179c9d8d8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.020336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3187991a-7f29-4a72-a2b3-2958dc8fe22a req-3c3b1adb-b6ad-4638-8b38-c1e179c9d8d8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.066783 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3187991a-7f29-4a72-a2b3-2958dc8fe22a req-3c3b1adb-b6ad-4638-8b38-c1e179c9d8d8 service nova] Creating event network-changed:253db289-756a-4d65-bac8-ef499993f038 for instance c43911b4-f882-4619-b398-71c3d4f3569a on n-h2-843834-3 Jul 19 19:46:57.085697 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3187991a-7f29-4a72-a2b3-2958dc8fe22a req-3c3b1adb-b6ad-4638-8b38-c1e179c9d8d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113929 Jul 19 19:46:57.097840 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 867/1739] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:57.154303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:57.165210 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84216da8-669a-449a-8ec5-3f3c6da5f160 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1313 microversion: 2.1 time: 0.520463 Jul 19 19:46:57.166871 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 873/1740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:56 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:57.196771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-plugged", "status": "completed", "tag": "e7f8c7bc-de24-488d-9351-3eb0517f2947"}, {"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-plugged", "status": "completed", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:57.246232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.250639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.284054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] Creating event network-vif-plugged:e7f8c7bc-de24-488d-9351-3eb0517f2947 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:46:57.284841 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] Creating event network-vif-plugged:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:46:57.319836 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5c228cc8-29b5-439d-9a44-8382ce773aa3 req-90da71ca-bde1-42e6-b9e7-764a7286943f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119967 Jul 19 19:46:57.322819 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 868/1741] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:57.501579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.502563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:57.515532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.517710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.518814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.521392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.617868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-032a20a7-07d9-4c9e-8ca3-2b2dac00836b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef849310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.729034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-032a20a7-07d9-4c9e-8ca3-2b2dac00836b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.116076 Jul 19 19:46:57.734471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 869/1742] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:57.743790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:57.744765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:57.776402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.776878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:57.777701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:57.778142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.412156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.425974 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70ccf820-6ea2-4bb5-a49f-cc0d636e3696 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.694845 Jul 19 19:46:58.435806 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 870/1743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:58.440858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.441479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.468054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.468835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.475315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.476186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.630472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.646065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.651394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.653808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-862bd465-1731-44aa-bd0c-dbfb02e77d7d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1878 microversion: 2.42 time: 1.156799 Jul 19 19:46:58.660020 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 874/1744] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:57 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1878 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:46:58.672747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.673477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:58.688328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.688786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.689590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:58.690032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:58.856646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:58.881932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df05edf3-0024-4466-b11b-479cb1bda285 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.444831 Jul 19 19:46:58.884034 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 871/1745] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:58.890126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4f6d9b86-23ee-429c-8876-be4e43fd9003 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef91fee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:58.999067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4f6d9b86-23ee-429c-8876-be4e43fd9003 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.111521 Jul 19 19:46:59.002199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 872/1746] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:59.186968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.209176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.209743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.214704 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28e08bac-a322-45fa-8d22-1466b73494df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1462 microversion: 2.1 time: 0.554082 Jul 19 19:46:59.216077 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 875/1747] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:58 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1462 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:59.220173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.222155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.223066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.226194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.251522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.258431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.274763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.275507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.276747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.280592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.293657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:46:59.486637 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-048b43e8-c41b-4013-baca-b8c37e92e628 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 204 len: 0 microversion: 2.25 time: 0.281822 Jul 19 19:46:59.490456 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 873/1748] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:46:59 2022] DELETE /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 19:46:59.496647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-381c4d9b-03b9-479c-a241-09632251deea req-48ff1208-5715-48e0-9dc9-8f98ccbe1408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c47c23-7b6a-423c-af6f-b3c5a82d424d", "name": "network-vif-plugged", "status": "completed", "tag": "db322cb0-6c7e-42d2-9a76-de9677d46fe0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:59.515222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-381c4d9b-03b9-479c-a241-09632251deea req-48ff1208-5715-48e0-9dc9-8f98ccbe1408 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.515674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-381c4d9b-03b9-479c-a241-09632251deea req-48ff1208-5715-48e0-9dc9-8f98ccbe1408 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.551629 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-381c4d9b-03b9-479c-a241-09632251deea req-48ff1208-5715-48e0-9dc9-8f98ccbe1408 service nova] Creating event network-vif-plugged:db322cb0-6c7e-42d2-9a76-de9677d46fe0 for instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d on n-h1-843834-3 Jul 19 19:46:59.557069 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-381c4d9b-03b9-479c-a241-09632251deea req-48ff1208-5715-48e0-9dc9-8f98ccbe1408 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067807 Jul 19 19:46:59.557943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 874/1749] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:59.569974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1aa764d4-e2cc-441c-935c-6d03d13262bb req-94c74ac7-6526-4b56-a43b-6165bba03d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ea3420-b4a6-4caf-b686-a048f762affb", "tag": "4bce019e-2c4f-4ab8-81c0-1311f81a65fe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:46:59.580890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1aa764d4-e2cc-441c-935c-6d03d13262bb req-94c74ac7-6526-4b56-a43b-6165bba03d1a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.581551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1aa764d4-e2cc-441c-935c-6d03d13262bb req-94c74ac7-6526-4b56-a43b-6165bba03d1a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.609012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1aa764d4-e2cc-441c-935c-6d03d13262bb req-94c74ac7-6526-4b56-a43b-6165bba03d1a service nova] Creating event network-changed:4bce019e-2c4f-4ab8-81c0-1311f81a65fe for instance 53ea3420-b4a6-4caf-b686-a048f762affb on n-h1-843834-3 Jul 19 19:46:59.616624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1aa764d4-e2cc-441c-935c-6d03d13262bb req-94c74ac7-6526-4b56-a43b-6165bba03d1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057153 Jul 19 19:46:59.621489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 875/1750] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:46:59.638117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.639222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.647902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.649243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.650309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.651022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.854972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:46:59.868746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-329c4820-983a-489f-bd87-bfa9ac086999 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1313 microversion: 2.1 time: 0.634094 Jul 19 19:46:59.879408 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 876/1751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:46:59.885052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:46:59.886203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:46:59.892544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.893255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:46:59.895997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:46:59.896611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.206448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:00.370666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.398625 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6370dfe2-8092-4810-add5-ef402e260c6d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.775682 Jul 19 19:47:00.402428 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 876/1752] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:00.419465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:00.425412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:00.442507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.448370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.450460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.454815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.623413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.637358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.643965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:00.649460 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4acefe5-ce9b-4007-be66-544794c78844 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1549 microversion: 2.25 time: 0.768510 Jul 19 19:47:00.650262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 877/1753] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:46:59 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1549 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:00.654890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:00.655529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:00.677494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.677955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:00.678756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:00.681997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.263808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:01.277731 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cce42603-4cda-49f9-82af-38e379047126 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.626563 Jul 19 19:47:01.279530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 878/1754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:00 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:01.289182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9baa8f70-32f4-4d90-a27b-725ab9b80e61 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2a5040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.307215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:01.326748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:01.330158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:01.332820 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee565e5a-6b60-40cc-96a4-c9fd00ab2ce7 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2835 microversion: 2.42 time: 0.925243 Jul 19 19:47:01.351562 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 877/1755] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:00 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2835 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:01.368446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.369439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:01.381381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.383539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.385389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.386417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.395345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9baa8f70-32f4-4d90-a27b-725ab9b80e61 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.109522 Jul 19 19:47:01.396200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 879/1756] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:01.405979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.407001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:01.421466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.423596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.427089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.428103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.717884 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f657b1c8-0453-4ed1-88b9-7e40a04713c0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.319618 Jul 19 19:47:01.726964 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 880/1757] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c/os-interface => generated 1831 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:01.737432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:01.738353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:01.748698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.749496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:01.750525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:01.751240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.028035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.055063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4e217a2-4f3c-46d0-9bd5-a3461dcc8ee5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1463 microversion: 2.1 time: 0.701711 Jul 19 19:47:02.056015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 878/1758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1463 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:02.060911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:02.061549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:02.100456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.100936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.101737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.102182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.115704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:02.189755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.202905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01803206-23f7-4d62-8643-1595681a4e93 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.467098 Jul 19 19:47:02.204663 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 881/1759] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:01 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:02.218617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3e9ad241-ae39-4e0f-b476-b87e9dd49432 req-923f6b5a-5214-4dc6-91ad-944accb48af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ca356-1a3a-4e44-b72f-59efa620c174", "name": "network-vif-deleted", "tag": "36c51b9e-e354-47fe-9a2a-ef23441b0458"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:02.258219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3e9ad241-ae39-4e0f-b476-b87e9dd49432 req-923f6b5a-5214-4dc6-91ad-944accb48af6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.262518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3e9ad241-ae39-4e0f-b476-b87e9dd49432 req-923f6b5a-5214-4dc6-91ad-944accb48af6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.296762 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3e9ad241-ae39-4e0f-b476-b87e9dd49432 req-923f6b5a-5214-4dc6-91ad-944accb48af6 service nova] Creating event network-vif-deleted:36c51b9e-e354-47fe-9a2a-ef23441b0458 for instance fc6ca356-1a3a-4e44-b72f-59efa620c174 on n-h1-843834-3 Jul 19 19:47:02.320619 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3e9ad241-ae39-4e0f-b476-b87e9dd49432 req-923f6b5a-5214-4dc6-91ad-944accb48af6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111804 Jul 19 19:47:02.323073 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 882/1760] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:02.334574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-257533072", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f06951cb-806f-4404-aecb-382385611932"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:02.432758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.463633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.469808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:02.476498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0e8bc35-b533-4bc8-974b-8585a867f879 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 200 len: 1507 microversion: 2.25 time: 0.419310 Jul 19 19:47:02.479564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:02.480162 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 879/1761] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:02 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:02.494289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:02.499127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:02.515066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.516249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:02.517302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:02.522226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.197444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=26 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:03.367602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:03.382025 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62ddb262-a921-4c9f-96e1-3af6bb8ceac6 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.899272 Jul 19 19:47:03.398201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 880/1762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:02 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:03.405487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a511ca9-3027-4f75-9199-f5a3a2ad7066 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef924670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.488908 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a511ca9-3027-4f75-9199-f5a3a2ad7066 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.088978 Jul 19 19:47:03.492696 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 881/1763] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:03.503140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.507050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:03.524188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:03.525174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:03.525812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:03.526378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.526575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:03.527085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.527428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:03.528124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.528813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.532619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:03.548141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.548879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.551753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.552682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.621386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:03.634971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Getting quotas for user 56b5e75a70bd48c392b0bede39f69e8c and project da4a326f8bda43bb8a2d351bbe1d7127. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:03.662332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:03.665647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:03.747573 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d7583e5-28ef-455d-ae7a-734ee47ee8bb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421088 Jul 19 19:47:03.756096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 883/1764] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:03.762697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.764186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: fc6ca356-1a3a-4e44-b72f-59efa620c174] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:03.773670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.774642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.776996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.795554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:03.800794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:03.803550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.821498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46746479-5da8-4d14-9247-6744fedfe040 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.326972 Jul 19 19:47:03.826043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 882/1765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:03.846284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c10e961b-4721-4123-9ae9-1b693d5ccd54 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:03.848585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c10e961b-4721-4123-9ae9-1b693d5ccd54 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:03.870423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] HTTP exception thrown: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Request method failure captured: Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 HTTP/1.1 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wiJJr-5PLgC9ZVBioQKT5i5Be7PBg-6CJ6JhruZWD8Bti99R40DleNLgWc9GTN10B6UseOBH-q6oaTJjetYqSk9f8PZvdoairUUU_UKt78s13wl-BCpCg0IGZOPxBAEQyE4zhu5Pq4ta6Vr5Rz-bKgBDFWuqtWgLs9s0Ho5A7CLgoo Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: df971d67f21747f2afa56647d78a7fa5 Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'fc6ca356-1a3a-4e44-b72f-59efa620c174'} Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. Jul 19 19:47:03.876137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. Jul 19 19:47:03.881742 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:03.882536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Returning 404 to user: Instance fc6ca356-1a3a-4e44-b72f-59efa620c174 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:03.883903 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf49e873-635f-48f2-922e-385620637660 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174" status: 404 len: 111 microversion: 2.25 time: 0.125726 Jul 19 19:47:03.887622 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 884/1766] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/servers/fc6ca356-1a3a-4e44-b72f-59efa620c174 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:47:03.904449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:03.905343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-bc070cbd-5237-4ca5-8a08-9c45b23775f4 req-a11f0f31-5629-424e-9984-4bcfbfc90325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43911b4-f882-4619-b398-71c3d4f3569a", "name": "network-vif-plugged", "status": "completed", "tag": "253db289-756a-4d65-bac8-ef499993f038"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:03.946235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bc070cbd-5237-4ca5-8a08-9c45b23775f4 req-a11f0f31-5629-424e-9984-4bcfbfc90325 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:03.946684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bc070cbd-5237-4ca5-8a08-9c45b23775f4 req-a11f0f31-5629-424e-9984-4bcfbfc90325 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:03.995732 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bc070cbd-5237-4ca5-8a08-9c45b23775f4 req-a11f0f31-5629-424e-9984-4bcfbfc90325 service nova] Creating event network-vif-plugged:253db289-756a-4d65-bac8-ef499993f038 for instance c43911b4-f882-4619-b398-71c3d4f3569a on n-h2-843834-3 Jul 19 19:47:04.009119 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-bc070cbd-5237-4ca5-8a08-9c45b23775f4 req-a11f0f31-5629-424e-9984-4bcfbfc90325 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112899 Jul 19 19:47:04.012245 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 885/1767] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:04.027162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.028154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.034626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c10e961b-4721-4123-9ae9-1b693d5ccd54 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:04.050274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c10e961b-4721-4123-9ae9-1b693d5ccd54 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1213 microversion: 2.1 time: 0.217438 Jul 19 19:47:04.051547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 883/1768] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:03 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:04.055857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.056795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.058036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.058864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.130323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:04.360230 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-746aa17b-84e7-4d6c-89b6-c9d331678773 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 204 len: 0 microversion: 2.25 time: 0.344496 Jul 19 19:47:04.361400 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 886/1769] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:47:04 2022] DELETE /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:47:04.374517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.375712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.403888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:04.405432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.405952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.408072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.408422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:04.410425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.425957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.426963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.428198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:04.428984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:04.914712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:04.951332 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a40ce44-5bf4-430a-a6e3-226217be5050 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.555415 Jul 19 19:47:04.954357 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 887/1770] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:04.984962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-45c23f56-a545-4aed-9609-8bc184e7131b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2e1700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.076763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.096783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.101897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.117870 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-45c23f56-a545-4aed-9609-8bc184e7131b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.160446 Jul 19 19:47:05.119956 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 888/1771] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:05.123947 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f9ab18e-a28d-4fc5-9cfd-cae3db42e613 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1563 microversion: 2.25 time: 0.739604 Jul 19 19:47:05.130027 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 884/1772] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:04 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1563 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:05.150131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.152730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.153888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.156324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.178444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.181681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.186744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.187652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.188103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.191597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.192748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:05.193212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:05.366349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.379291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-deccc52b-aab1-406d-a7f7-b93c54cc8377 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1265 microversion: 2.1 time: 0.247259 Jul 19 19:47:05.384645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 885/1773] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:05 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:05.864727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:05.885612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4520597-8d83-4ffe-886a-e5d0c6c46759 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1404 microversion: 2.1 time: 0.757752 Jul 19 19:47:05.887197 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 889/1774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:05 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1404 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:05.971538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:05.972580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:05.998371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.000147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.001269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.001983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.132640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-89dde973-b46d-4b6d-a524-adf4293429ba tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2a28b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.222017 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-89dde973-b46d-4b6d-a524-adf4293429ba tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.094288 Jul 19 19:47:06.222645 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 890/1775] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:06.252141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.253107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.282643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.287522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.288541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.289011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.603766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:06.619675 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91afaa7b-3884-42b9-a44b-26b75e4d771b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.651917 Jul 19 19:47:06.621787 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 886/1776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:05 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:06.651329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:06.653172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:06.664827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.665972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:06.669167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:06.670025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.276434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.299324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-213b383d-c010-41c3-8d89-68d5580278cc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1271 microversion: 2.1 time: 0.655394 Jul 19 19:47:07.300996 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 887/1777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1271 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:07.308265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-90380178-27f7-4061-aa1d-5aa54086442a req-9b9db9b1-7e90-464a-a0a6-82436054e95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "tag": "5911f022-61d0-4f7e-b597-1a2a6e26d952"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:07.320973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-90380178-27f7-4061-aa1d-5aa54086442a req-9b9db9b1-7e90-464a-a0a6-82436054e95b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.324740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-90380178-27f7-4061-aa1d-5aa54086442a req-9b9db9b1-7e90-464a-a0a6-82436054e95b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.353677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-90380178-27f7-4061-aa1d-5aa54086442a req-9b9db9b1-7e90-464a-a0a6-82436054e95b service nova] Creating event network-changed:5911f022-61d0-4f7e-b597-1a2a6e26d952 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:47:07.361748 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-90380178-27f7-4061-aa1d-5aa54086442a req-9b9db9b1-7e90-464a-a0a6-82436054e95b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059062 Jul 19 19:47:07.363190 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 888/1778] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:07.371574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:07.373822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:07.383381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.384288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.385643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.386945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.460278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.480277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.483649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:07.485750 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d07d8f2-c065-4fca-b19f-33b4fbeb3d12 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1563 microversion: 2.25 time: 1.262081 Jul 19 19:47:07.486896 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 891/1779] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:06 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1563 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:07.491847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d57c691f-edd1-49fe-b6dd-021e925fa3ac tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef319670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:07.580602 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d57c691f-edd1-49fe-b6dd-021e925fa3ac tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.092382 Jul 19 19:47:07.590784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 892/1780] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:07 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:07.642513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:07.643426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:07.669279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.669749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:07.670613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:07.671093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.287399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.299008 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d5da8ba-71a0-406d-8a7b-f1114288c664 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1592 microversion: 2.1 time: 0.931778 Jul 19 19:47:08.300691 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 889/1781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:07 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1592 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.317013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.331160 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35ca4918-48ca-414e-bf3f-23c66e88be30 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 0.692389 Jul 19 19:47:08.332888 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 893/1782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:07 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.335029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d366e683-d124-4cb2-a98b-5549c3b5653b req-acc6e8cd-77d8-4e03-bc0d-676ad9d36d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c02c0cd-21e3-4168-a62c-ee9954f13126", "name": "network-vif-deleted", "tag": "bf6efde6-0501-4394-961d-78a75a3f2e22"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:08.357156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.359002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:08.363191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d366e683-d124-4cb2-a98b-5549c3b5653b req-acc6e8cd-77d8-4e03-bc0d-676ad9d36d2a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.367022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d366e683-d124-4cb2-a98b-5549c3b5653b req-acc6e8cd-77d8-4e03-bc0d-676ad9d36d2a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.381220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.381731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.385789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.386459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.398776 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d366e683-d124-4cb2-a98b-5549c3b5653b req-acc6e8cd-77d8-4e03-bc0d-676ad9d36d2a service nova] Creating event network-vif-deleted:bf6efde6-0501-4394-961d-78a75a3f2e22 for instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 on n-h2-843834-3 Jul 19 19:47:08.416910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d366e683-d124-4cb2-a98b-5549c3b5653b req-acc6e8cd-77d8-4e03-bc0d-676ad9d36d2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114665 Jul 19 19:47:08.419771 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 890/1783] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:08.433276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.437995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:08.452265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.456759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.459926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.461590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.589302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.597482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:08.602996 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57638b7f-41b4-41c4-8b51-8a6cd3b2607e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1271 microversion: 2.1 time: 0.268621 Jul 19 19:47:08.607164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 894/1784] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.624179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.625953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:08.654445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.656690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.659132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.660731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.726650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.727519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.728152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lazy-loading 'fault' on Instance uuid 8c02c0cd-21e3-4168-a62c-ee9954f13126 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:08.761149 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70f494ab-74a2-4dbd-8cef-8eb177a377f6 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.339596 Jul 19 19:47:08.762191 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 891/1785] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a/os-interface => generated 285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:08.769435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e07f353b-6b86-44bb-8478-eea995e25ab8 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef907e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.897391 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e07f353b-6b86-44bb-8478-eea995e25ab8 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.133491 Jul 19 19:47:08.900365 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 892/1786] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:08.914277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7343d80c-bccd-4f56-875e-e4164f73fcac req-21e60681-95ba-4779-b64f-a705efa509a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea3420-b4a6-4caf-b686-a048f762affb", "name": "network-vif-plugged", "status": "completed", "tag": "4bce019e-2c4f-4ab8-81c0-1311f81a65fe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:08.931177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7343d80c-bccd-4f56-875e-e4164f73fcac req-21e60681-95ba-4779-b64f-a705efa509a5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:08.931873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7343d80c-bccd-4f56-875e-e4164f73fcac req-21e60681-95ba-4779-b64f-a705efa509a5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:08.945047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.959515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.964503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df971d67f21747f2afa56647d78a7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8cdd547c7641ce9ad5fe49e15eb6d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:08.970638 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-226221d7-db36-4e1d-ad41-668d6dede133 tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 200 len: 1352 microversion: 2.25 time: 0.359945 Jul 19 19:47:08.983574 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 895/1787] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 1352 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:08.990815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:08.992937 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7343d80c-bccd-4f56-875e-e4164f73fcac req-21e60681-95ba-4779-b64f-a705efa509a5 service nova] Creating event network-vif-plugged:4bce019e-2c4f-4ab8-81c0-1311f81a65fe for instance 53ea3420-b4a6-4caf-b686-a048f762affb on n-h1-843834-3 Jul 19 19:47:08.999190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7343d80c-bccd-4f56-875e-e4164f73fcac req-21e60681-95ba-4779-b64f-a705efa509a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092224 Jul 19 19:47:09.000107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:09.000327 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 893/1788] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:09.028722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.029377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.030297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.030826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.352153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:09.354282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:09.376932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.377665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.379511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.380143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.632923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6edbdb5-1d16-4f35-94ad-ed6dbff15aa5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1809 microversion: 2.1 time: 0.647599 Jul 19 19:47:09.638380 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 896/1789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:08 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1809 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:09.653445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:09.654585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:09.668929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.671726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:09.673632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:09.675652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.364950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:10.375319 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35ff37d5-9b34-40aa-9b20-c6809eec581c tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1351 microversion: 2.1 time: 1.027954 Jul 19 19:47:10.387100 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 894/1790] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:09 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1351 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:10.398015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.400738 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:47:10.400738 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:47:10.403914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.406113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.407765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.417975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.433983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:10.450414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb2c7345-6ab4-4a32-9f4b-cc277ceeac96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.810298 Jul 19 19:47:10.454291 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 897/1791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:09 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:10.459602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f7b92a9-3871-4bcd-a8c4-6b81c49780cd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2a5280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.483037 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fe4f5fd4-fb40-4ba0-804f-bbb954150865 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087420 Jul 19 19:47:10.486595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 895/1792] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:10.497259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:10.501452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] [instance: 8c02c0cd-21e3-4168-a62c-ee9954f13126] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:10.520263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.521191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.524820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:10.527520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:10.558888 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f7b92a9-3871-4bcd-a8c4-6b81c49780cd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.102981 Jul 19 19:47:10.565250 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] HTTP exception thrown: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. Jul 19 19:47:10.570518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 898/1793] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Request method failure captured: Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 HTTP/1.1 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wiJJr-5PLgC9ZVBioQKT5i5Be7PBg-6CJ6JhruZWD8Bti99R40DleNLgWc9GTN10B6UseOBH-q6oaTJjetYqSk9f8PZvdoairUUU_UKt78s13wl-BCpCg0IGZOPxBAEQyE4zhu5Pq4ta6Vr5Rz-bKgBDFWuqtWgLs9s0Ho5A7CLgoo Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8cdd547c7641ce9ad5fe49e15eb6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4c8cdd547c7641ce9ad5fe49e15eb6d7 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-328381847 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df971d67f21747f2afa56647d78a7fa5 Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-328381847-project Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8c02c0cd-21e3-4168-a62c-ee9954f13126'} Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. Jul 19 19:47:10.571427 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] Returning 404 to user: Instance 8c02c0cd-21e3-4168-a62c-ee9954f13126 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:10.577536 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d712d3f6-8165-45bb-96db-8c98ec022fca tempest-LiveAutoBlockMigrationV225Test-328381847 tempest-LiveAutoBlockMigrationV225Test-328381847-project] 10.222.0.23 "GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126" status: 404 len: 111 microversion: 2.25 time: 0.088716 Jul 19 19:47:10.585222 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 896/1794] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:10 2022] GET /compute/v2.1/servers/8c02c0cd-21e3-4168-a62c-ee9954f13126 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:47:11.406015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:11.407367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:11.422362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.423274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.424383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.424930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.471832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:11.473073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:11.488911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.493327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:11.496848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:11.499272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.184587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:12.209803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a44b1a39-351f-4112-b8fe-04dd5f8b0c2b tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1542 microversion: 2.1 time: 0.802971 Jul 19 19:47:12.211821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 899/1795] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:11 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1542 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:12.222382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6a4bcea-1840-4927-95e2-02163b6cbc2f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef34c0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:12.324825 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6a4bcea-1840-4927-95e2-02163b6cbc2f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.111412 Jul 19 19:47:12.339298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 900/1796] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:12 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:12.356047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:12.357080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:12.375201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.377683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.378975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:12.388806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:12.922471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:12.939486 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-788c7cb8-f1c5-454e-ad7c-cd5bb229f6b8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 1.474801 Jul 19 19:47:12.940086 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 897/1797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:11 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:12.964680 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec6e7364-a5fc-4eaf-b316-6caea29058e0 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.623736 Jul 19 19:47:12.971497 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 901/1798] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:47:12 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb/os-interface => generated 285 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:13.341588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a47cc0b4-a1d5-42d8-9f7f-b57bff440cdd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef99a670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:13.412858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3fceaed-17fa-4fd7-8711-73befc928235", "device": "/dev/xvdb"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:13.420935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:13.432290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.433615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.434542 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a47cc0b4-a1d5-42d8-9f7f-b57bff440cdd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.097049 Jul 19 19:47:13.434775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.435346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 898/1799] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:13 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:13.436223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.592352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:13.652582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:13.936724 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-469acc30-cb95-4871-894c-5fc2ee478d85 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546462 Jul 19 19:47:13.945976 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 902/1800] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 19:47:13 2022] POST /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:13.957924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:13.960143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:13.989311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.992083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:13.996076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:13.997768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:14.099541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:14.460691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d283b40f-4c0a-4b39-8d0e-c4f4a5e67663 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2b28b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:14.578475 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d283b40f-4c0a-4b39-8d0e-c4f4a5e67663 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.133178 Jul 19 19:47:14.589899 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 903/1801] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:14 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:14.896829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:14.897953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:14.912022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:14.919481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:14.920933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:14.921571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.286794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:15.311927 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e5561d2-b0d8-4e8a-bf2d-9ad6cd1c519d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 1.358822 Jul 19 19:47:15.320251 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 899/1802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:13 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:15.339289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e2f2c393-ce2a-45fd-9948-dcd6363be514 req-6e4e3a69-cee9-4f00-99f3-4dfe31cc307f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43911b4-f882-4619-b398-71c3d4f3569a", "tag": "253db289-756a-4d65-bac8-ef499993f038"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:15.390572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e2f2c393-ce2a-45fd-9948-dcd6363be514 req-6e4e3a69-cee9-4f00-99f3-4dfe31cc307f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:15.392836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e2f2c393-ce2a-45fd-9948-dcd6363be514 req-6e4e3a69-cee9-4f00-99f3-4dfe31cc307f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:15.445016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e2f2c393-ce2a-45fd-9948-dcd6363be514 req-6e4e3a69-cee9-4f00-99f3-4dfe31cc307f service nova] Creating event network-changed:253db289-756a-4d65-bac8-ef499993f038 for instance c43911b4-f882-4619-b398-71c3d4f3569a on n-h2-843834-3 Jul 19 19:47:15.460292 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e2f2c393-ce2a-45fd-9948-dcd6363be514 req-6e4e3a69-cee9-4f00-99f3-4dfe31cc307f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136201 Jul 19 19:47:15.465117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 900/1803] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:15.841505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1670981607", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0354476e-8c98-4402-bda8-5f72349af6d6"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:15.905795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:15.920650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85493834-a72d-481a-b828-095dcb6666eb tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1592 microversion: 2.1 time: 1.028991 Jul 19 19:47:15.921521 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 904/1804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:14 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1592 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:15.942224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d01b60b-8b0a-4a58-85d5-033887634fd1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2444c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.063125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] validate_networks() for [('0354476e-8c98-4402-bda8-5f72349af6d6', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:16.102605 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d01b60b-8b0a-4a58-85d5-033887634fd1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1453 microversion: 2.1 time: 0.176937 Jul 19 19:47:16.103287 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 905/1805] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:15 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:16.331622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:16.333283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:16.343827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.349865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:16.353421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:16.356865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.556685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:17.577132 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f48b5f9-9a0c-4263-ae34-6b9c995f2cab tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 1.249284 Jul 19 19:47:17.583666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 906/1806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:16 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.592259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a36afb39-fd32-4ded-8adb-347518b13ead tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef244430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:17.702937 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a36afb39-fd32-4ded-8adb-347518b13ead tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1462 microversion: 2.1 time: 0.117220 Jul 19 19:47:17.703864 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 907/1807] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:17 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.710392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-70a7275f-dd0e-4915-ae3e-63b4f8f01b53 req-239e758b-7a84-480a-87d7-273380da4b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316b88da-4255-4d00-a46a-5e853820f529", "tag": "234c4074-29a5-4379-a013-b7d22774c044"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:17.723632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-70a7275f-dd0e-4915-ae3e-63b4f8f01b53 req-239e758b-7a84-480a-87d7-273380da4b52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.727855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-70a7275f-dd0e-4915-ae3e-63b4f8f01b53 req-239e758b-7a84-480a-87d7-273380da4b52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.768395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-70a7275f-dd0e-4915-ae3e-63b4f8f01b53 req-239e758b-7a84-480a-87d7-273380da4b52 service nova] Creating event network-changed:234c4074-29a5-4379-a013-b7d22774c044 for instance 316b88da-4255-4d00-a46a-5e853820f529 on n-h1-843834-3 Jul 19 19:47:17.786487 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-70a7275f-dd0e-4915-ae3e-63b4f8f01b53 req-239e758b-7a84-480a-87d7-273380da4b52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079467 Jul 19 19:47:17.789119 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 908/1808] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:17.799757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88698825-693c-48dd-8d23-48913e617a2b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2b21f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:17.886834 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88698825-693c-48dd-8d23-48913e617a2b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 200 len: 1462 microversion: 2.1 time: 0.096427 Jul 19 19:47:17.893861 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 909/1809] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:17 2022] GET /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:17.899220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:17.900433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:17.918307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.918955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:17.920073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:17.921762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.112508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.141375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc874324-87b9-4437-83f9-aff381c4f5ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1467 microversion: 2.1 time: 1.242748 Jul 19 19:47:19.150967 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 910/1810] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:17 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1467 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.162002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.171053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.191290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.191969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.193501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.194178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.620206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:19.620712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:19.621259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:19.621738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:19.622233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:19.641815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.642228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.654817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.655311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.743585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Getting quotas for project 998abc01de1943878facb6a7c7f50dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:19.753554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Getting quotas for user bf659f72d3864979a0970abead916be9 and project 998abc01de1943878facb6a7c7f50dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:19.783686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:19.792815 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e392235-25cc-4b1e-be08-29c205d36ec9 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.643787 Jul 19 19:47:19.795912 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 911/1811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:19 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:19.803989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:19.806736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1950482460"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:19.806902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:19.807868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:19.834679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.837918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.839041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:19.840760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:19.902947 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32ae08f5-508d-49e4-a666-d59292f1cbb6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.434831 Jul 19 19:47:19.905562 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 901/1812] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:19.938805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dabe0f91-f0dd-4d81-9eea-be431744bda2 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:19.941187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dabe0f91-f0dd-4d81-9eea-be431744bda2 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.086164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dabe0f91-f0dd-4d81-9eea-be431744bda2 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:20.097326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dabe0f91-f0dd-4d81-9eea-be431744bda2 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1216 microversion: 2.1 time: 0.183112 Jul 19 19:47:20.107332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 902/1813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:19 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:20.572080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9221eef9-f590-4f43-b3d9-39a9e41e19d6 req-11a6301e-39ad-4d14-ab29-7909c3e8db0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ea3420-b4a6-4caf-b686-a048f762affb", "tag": "4bce019e-2c4f-4ab8-81c0-1311f81a65fe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:20.585914 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3620751b-06b5-49cb-8c7d-0dff0154c624 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "POST /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302/action" status: 202 len: 0 microversion: 2.1 time: 0.787651 Jul 19 19:47:20.592274 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 912/1814] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:19 2022] POST /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:47:20.603999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e98487f5-d2b8-4e67-bf8d-7c2746b3d436 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef34c5e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.610226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9221eef9-f590-4f43-b3d9-39a9e41e19d6 req-11a6301e-39ad-4d14-ab29-7909c3e8db0b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.610989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9221eef9-f590-4f43-b3d9-39a9e41e19d6 req-11a6301e-39ad-4d14-ab29-7909c3e8db0b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.642088 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9221eef9-f590-4f43-b3d9-39a9e41e19d6 req-11a6301e-39ad-4d14-ab29-7909c3e8db0b service nova] Creating event network-changed:4bce019e-2c4f-4ab8-81c0-1311f81a65fe for instance 53ea3420-b4a6-4caf-b686-a048f762affb on n-h1-843834-3 Jul 19 19:47:20.658730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9221eef9-f590-4f43-b3d9-39a9e41e19d6 req-11a6301e-39ad-4d14-ab29-7909c3e8db0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096300 Jul 19 19:47:20.659953 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 903/1815] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:47:20.703018 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e98487f5-d2b8-4e67-bf8d-7c2746b3d436 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.106184 Jul 19 19:47:20.712430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 913/1816] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:20.818402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:20.819047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:20.855769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.858754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:20.861111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:20.862199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.125894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:21.132794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:21.167702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.168164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.169401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.169811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.311491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:21.323664 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fafe7fc4-92ab-449d-980c-23fd6ca1d9c6 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1212 microversion: 2.1 time: 0.208576 Jul 19 19:47:21.333606 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 914/1817] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:21 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:21.333606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e4b29f7b-4804-4ba8-90d5-02a328ccd385 req-81337029-55cd-458b-96af-6734f691eb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c47c23-7b6a-423c-af6f-b3c5a82d424d", "name": "network-vif-unplugged", "status": "completed", "tag": "db322cb0-6c7e-42d2-9a76-de9677d46fe0"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:21.365886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e4b29f7b-4804-4ba8-90d5-02a328ccd385 req-81337029-55cd-458b-96af-6734f691eb8b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:21.370613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e4b29f7b-4804-4ba8-90d5-02a328ccd385 req-81337029-55cd-458b-96af-6734f691eb8b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:21.396469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e4b29f7b-4804-4ba8-90d5-02a328ccd385 req-81337029-55cd-458b-96af-6734f691eb8b service nova] Creating event network-vif-unplugged:db322cb0-6c7e-42d2-9a76-de9677d46fe0 for instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d on n-h1-843834-3 Jul 19 19:47:21.403606 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e4b29f7b-4804-4ba8-90d5-02a328ccd385 req-81337029-55cd-458b-96af-6734f691eb8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077588 Jul 19 19:47:21.404821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 915/1818] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:21.636159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:21.652168 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9378bbca-b365-4cd5-bc77-78e1235c3259 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.842628 Jul 19 19:47:21.653553 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 904/1819] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:20 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:21.720773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6ca1952-e7b7-4ed3-b65e-a02dd2d7b58f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef34c670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:21.777319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6ca1952-e7b7-4ed3-b65e-a02dd2d7b58f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.060676 Jul 19 19:47:21.788144 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 916/1820] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:21 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:22.343724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.344792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:22.356335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.357397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.359061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.360363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.535800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:22.550163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04aaf6c7-62ab-4556-acb6-6a56da8159b7 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1274 microversion: 2.1 time: 0.212324 Jul 19 19:47:22.552125 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 905/1821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:22.673608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.676551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:22.687276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.688594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.689393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:22.689827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:22.793670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d588445-3253-478e-968c-3b74298acbcc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef8a60d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:22.850274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d588445-3253-478e-968c-3b74298acbcc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.062024 Jul 19 19:47:22.852127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 906/1822] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.498325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.507931 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d27273e9-626d-4996-be8c-a3e3e811f4d0 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.839290 Jul 19 19:47:23.508538 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 917/1823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:22 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.570013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:23.570643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:23.578485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.579076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.580013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:23.580983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:23.687102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:23.698048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dace9476-35d3-46b2-9299-d2109d9b538b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1274 microversion: 2.1 time: 0.133031 Jul 19 19:47:23.698884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 907/1824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:23.873637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9fb0bc0b-d037-4de0-9a1a-059eab687e42 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2dea60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:23.929528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9fb0bc0b-d037-4de0-9a1a-059eab687e42 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.063013 Jul 19 19:47:23.933063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 918/1825] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:23 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:24.528525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:24.529400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:24.536231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.536811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.537954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.538694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.716126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:24.717050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:24.737688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.740387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.741360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:24.744449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:24.805401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:24.965279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:24.980672 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7abae65-afae-48ce-af64-91417e965878 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.457042 Jul 19 19:47:24.981451 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 908/1826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:24 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:24.996251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1ccd9aa-97f8-4476-a491-17d3f1b97a62 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef966700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:25.071691 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1ccd9aa-97f8-4476-a491-17d3f1b97a62 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.088697 Jul 19 19:47:25.073206 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 909/1827] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:24 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:25.190897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:25.207694 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5bdb218a-9843-45c7-8df1-c3412be3394b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.495287 Jul 19 19:47:25.209042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 919/1828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:24 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:25.472958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-89183241-7409-4e0b-8fdb-482a5131f80f req-d2cf22b8-4fb3-4e0b-8648-2509ba0e0b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-plugged", "status": "completed", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:25.509523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-89183241-7409-4e0b-8fdb-482a5131f80f req-d2cf22b8-4fb3-4e0b-8648-2509ba0e0b52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:25.512883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-89183241-7409-4e0b-8fdb-482a5131f80f req-d2cf22b8-4fb3-4e0b-8648-2509ba0e0b52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:25.569002 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-89183241-7409-4e0b-8fdb-482a5131f80f req-d2cf22b8-4fb3-4e0b-8648-2509ba0e0b52 service nova] Creating event network-vif-plugged:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:47:25.584464 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-89183241-7409-4e0b-8fdb-482a5131f80f req-d2cf22b8-4fb3-4e0b-8648-2509ba0e0b52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122459 Jul 19 19:47:25.589145 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 910/1829] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:25.998753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:25.999602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:26.007288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.008486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.032908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.035366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.058293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9063a3ec-3a5b-4577-96b6-16836f64ee96 req-ac4d49da-636d-4676-81b7-b96e42a00f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2234cf-3634-4d8b-b0fa-41303a3b977e", "tag": "89be390e-d3f7-4cec-8394-5d79d453bea6"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:26.093639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9063a3ec-3a5b-4577-96b6-16836f64ee96 req-ac4d49da-636d-4676-81b7-b96e42a00f58 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.097275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9063a3ec-3a5b-4577-96b6-16836f64ee96 req-ac4d49da-636d-4676-81b7-b96e42a00f58 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.169135 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9063a3ec-3a5b-4577-96b6-16836f64ee96 req-ac4d49da-636d-4676-81b7-b96e42a00f58 service nova] Creating event network-changed:89be390e-d3f7-4cec-8394-5d79d453bea6 for instance cd2234cf-3634-4d8b-b0fa-41303a3b977e on n-h2-843834-3 Jul 19 19:47:26.190769 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9063a3ec-3a5b-4577-96b6-16836f64ee96 req-ac4d49da-636d-4676-81b7-b96e42a00f58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138743 Jul 19 19:47:26.193700 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 911/1830] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:47:26.230207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68db601d-b359-418a-ad49-4cc5bab16561 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23efdc05e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:26.333605 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68db601d-b359-418a-ad49-4cc5bab16561 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.121823 Jul 19 19:47:26.335846 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 912/1831] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:26 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:26.356209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:26.357345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:26.375865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.376852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.379420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:26.381719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:26.443633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:26.748559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:26.771095 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-703e2f79-78ba-48c8-9e7d-3dcb25d67105 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.776673 Jul 19 19:47:26.772285 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 920/1832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:25 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:26.828671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:26.884425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0514c5df-9fa5-4c70-8d6e-33b240037069 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.544908 Jul 19 19:47:26.888427 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 913/1833] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:26 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:27.349635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d527c2dd-5fee-4b3a-a97e-58fcb5be31f0 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2c3940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:27.432895 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d527c2dd-5fee-4b3a-a97e-58fcb5be31f0 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.089062 Jul 19 19:47:27.433799 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 921/1834] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:27 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:27.794266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:27.795143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:27.810852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.811997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.813396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.814186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.848325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-51b0891f-31be-431d-a862-5eae67f6e16a req-1c57b862-80ed-4707-adca-2c8c0b0f841c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316b88da-4255-4d00-a46a-5e853820f529", "name": "network-vif-plugged", "status": "completed", "tag": "234c4074-29a5-4379-a013-b7d22774c044"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:27.863932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-51b0891f-31be-431d-a862-5eae67f6e16a req-1c57b862-80ed-4707-adca-2c8c0b0f841c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.872292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-51b0891f-31be-431d-a862-5eae67f6e16a req-1c57b862-80ed-4707-adca-2c8c0b0f841c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.896110 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-51b0891f-31be-431d-a862-5eae67f6e16a req-1c57b862-80ed-4707-adca-2c8c0b0f841c service nova] Creating event network-vif-plugged:234c4074-29a5-4379-a013-b7d22774c044 for instance 316b88da-4255-4d00-a46a-5e853820f529 on n-h1-843834-3 Jul 19 19:47:27.912969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-51b0891f-31be-431d-a862-5eae67f6e16a req-1c57b862-80ed-4707-adca-2c8c0b0f841c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069154 Jul 19 19:47:27.915015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 922/1835] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:47:27.925807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:27.926956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:27.942317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.943965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:27.945818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:27.946255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:28.230495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:28.248171 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e9e87bf-0e75-4ec8-a807-37df68553f79 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.460790 Jul 19 19:47:28.259513 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 914/1836] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:27 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:28.323383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:28.334465 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d29d7714-9044-4369-bb27-01236d412401 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.416547 Jul 19 19:47:28.335838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 923/1837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:27 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:28.448065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72c32c40-fefb-4264-a42a-348e189c47bd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef849b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:28.525328 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72c32c40-fefb-4264-a42a-348e189c47bd tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.082483 Jul 19 19:47:28.526337 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 915/1838] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:28 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:29.267150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:29.267773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:29.280469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.281190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.281714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.282711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.353772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:29.355193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:29.369076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.379974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.381364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.382252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.703996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:29.805741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:29.817143 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c039ea5-a698-489c-8e8c-acc81786b8bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1313 microversion: 2.1 time: 0.551925 Jul 19 19:47:29.821649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 924/1839] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:29 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:29.842746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b06e66e-b991-40f4-8fe3-023b99c2d7b7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2b2670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:29.860450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:29.881578 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ccbc76d-8d30-4ba3-a8cf-90990e0ce17c tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.532864 Jul 19 19:47:29.883526 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 916/1840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:29 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:29.921306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b06e66e-b991-40f4-8fe3-023b99c2d7b7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.086333 Jul 19 19:47:29.931412 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 925/1841] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:29 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:29.960436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:29.963636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:29.985245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.988690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:29.992036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:29.994019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:30.120960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:30.331959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c8234dc-1f96-48dc-a37d-45f3105a4a27 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1855 microversion: 2.1 time: 0.379583 Jul 19 19:47:30.332979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 917/1842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:29 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1855 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:30.349735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843834-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:30.351777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:30.359602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:30.360059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:30.361061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:30.361496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:30.408002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lazy-loading 'flavor' on Instance uuid 7d531e1d-a523-45e5-a5b1-146c736db29a {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:30.426691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Going to try to live migrate instance to n-h1-843834-3 {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:47:30.850557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:30.854724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:30.900659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:30.900982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:30.905826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:30.906423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.263634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:31.282643 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b8c24fd-a2ef-441d-918b-4985d17a446a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1462 microversion: 2.1 time: 0.446756 Jul 19 19:47:31.284982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 918/1843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:30 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1462 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:31.292084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:31.293385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:31.314620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.315944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.318012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:31.318802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:31.605674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:31.618825 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4447890-1b24-4606-87ce-6cb5f0f8bced tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.331768 Jul 19 19:47:31.619993 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 919/1844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:31 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:31.628156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae815b5f-3f2f-423a-a270-f0c861ce0352 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef994430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:31.718522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae815b5f-3f2f-423a-a270-f0c861ce0352 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.094995 Jul 19 19:47:31.721013 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 920/1845] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:31 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:32.260432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.276242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'deleted': False, 'project_id': '00e46cc14e7b45209acd57adb14636e1'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:32.291407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.293770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.295563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.296328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.435179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3320e45a-44fc-49bc-b056-9e9197f2822b tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.710489 Jul 19 19:47:32.437912 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 921/1846] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:47:31 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:32.441853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f7a5fa52-7a1b-4e4a-93c9-87f8d24af1b2 req-58aa634f-985c-4e18-918f-95f80a7d031a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2234cf-3634-4d8b-b0fa-41303a3b977e", "name": "network-vif-plugged", "status": "completed", "tag": "89be390e-d3f7-4cec-8394-5d79d453bea6"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:32.452766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f7a5fa52-7a1b-4e4a-93c9-87f8d24af1b2 req-58aa634f-985c-4e18-918f-95f80a7d031a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.453242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f7a5fa52-7a1b-4e4a-93c9-87f8d24af1b2 req-58aa634f-985c-4e18-918f-95f80a7d031a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.466100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f7a5fa52-7a1b-4e4a-93c9-87f8d24af1b2 req-58aa634f-985c-4e18-918f-95f80a7d031a service nova] Creating event network-vif-plugged:89be390e-d3f7-4cec-8394-5d79d453bea6 for instance cd2234cf-3634-4d8b-b0fa-41303a3b977e on n-h2-843834-3 Jul 19 19:47:32.472648 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f7a5fa52-7a1b-4e4a-93c9-87f8d24af1b2 req-58aa634f-985c-4e18-918f-95f80a7d031a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Jul 19 19:47:32.473496 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 922/1847] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:32.581735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-25a4bd89-b1f9-4a14-835a-95d20e2c5ee3 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Calling method '.version_select at 0x7f23ef8df790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.660101 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-25a4bd89-b1f9-4a14-835a-95d20e2c5ee3 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 371 microversion: 2.1 time: 0.185441 Jul 19 19:47:32.660730 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 923/1848] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:32.670657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:32.676561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'deleted': False} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:32.686322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.686938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.688059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:32.688641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:32.845620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:33.020915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.021470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.040304 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2105af0b-a83e-4839-892f-268a1f1fa9b6 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/action" status: 202 len: 0 microversion: 2.1 time: 2.692322 Jul 19 19:47:33.040304 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 926/1849] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:30 2022] POST /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/action => generated 0 bytes in 2694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:33.050664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.051795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:33.089002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.089767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.096219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.097395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.437940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:33.449670 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ea46806-2488-4f50-b765-076341da15e5 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1316 microversion: 2.1 time: 0.409626 Jul 19 19:47:33.460116 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 927/1850] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:33.465599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef253430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:33.586734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.588323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.589426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.590058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.689784 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-82957809-8fe6-4471-ba28-8e0e7cdcd4a9 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 328 microversion: 2.1 time: 0.209092 Jul 19 19:47:33.693417 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 928/1851] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:33 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:33.711348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fec7c17e-221f-4122-9bba-072edccb8844 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef34c820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.790768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fec7c17e-221f-4122-9bba-072edccb8844 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.092744 Jul 19 19:47:33.792847 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 929/1852] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:33.799566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:33.801055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:33.810716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:33.814551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.815544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.816436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:33.816957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:33.906403 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8712a3b2-b291-4225-b38c-cdca41e420ba tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21217 microversion: 2.1 time: 1.244482 Jul 19 19:47:33.907397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 924/1853] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Jul 19 19:47:32 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21217 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:47:34.015015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1684201875", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:34.023799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:34.096867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:34.134590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.157766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22112fc4-3188-422f-af45-a83b3853f640 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.361420 Jul 19 19:47:34.162254 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 930/1854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:33 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.169748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.174652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'deleted': False, 'project_id': '00e46cc14e7b45209acd57adb14636e1'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:34.181698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.183204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.183517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.184055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.294590 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-711e6de8-443d-4c79-8374-4a279f055add tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=da4a326f8bda43bb8a2d351bbe1d7127" status: 200 len: 15 microversion: 2.1 time: 0.130771 Jul 19 19:47:34.304436 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 931/1855] 10.222.0.23 () {58 vars in 1230 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/detail?tenant_id=da4a326f8bda43bb8a2d351bbe1d7127 => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:34.319900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.336926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'tenant_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'deleted': False} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:34.342631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.343303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.344438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.345007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.402277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:34.482699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:34.483439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:34.484112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:34.484691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:34.485260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:34.498304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.498765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.499842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.500470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.523677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:34.530812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for user bb4ba013d06f4c52b156b8744d601729 and project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:34.536240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.537216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.549596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.utils [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] cores quota exceeded for 7c7341667b544ff696e4e66d9baabce2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131229) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:47:34.550618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Request method failure captured: Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 145 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpShaaFiWAKDXuBCNd8QP-r-_CtHrAoxoCB9o7xXs1r1cRckqiCgdX9J_Xjnc_nXBDmTIMLIbA0DoEQPjFpvEr1k1OaGqgjDdEmB3IKiiP_wLP5ZMi0cu4CRiBKiNEVC07keq51-UxZ8ssBJH5sByP6YyIIG4tZdXMRnYbjijzXqb4 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: bb4ba013d06f4c52b156b8744d601729 Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1684201875", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1684201875', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452'}}} Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:47:34.570993 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-756fc1ef-9436-4453-b9e5-a851c61e59aa tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.664600 Jul 19 19:47:34.576557 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 925/1856] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:33 2022] POST /compute/v2.1/servers => generated 111 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:34.585664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.585664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.590313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.590755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.595241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.595698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.723514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0147bd4e-7634-49f6-a580-21f99fbb8206 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=da4a326f8bda43bb8a2d351bbe1d7127" status: 200 len: 4823 microversion: 2.1 time: 0.411206 Jul 19 19:47:34.724276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 932/1857] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=da4a326f8bda43bb8a2d351bbe1d7127 => generated 4823 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.729173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef2e1d30>, body: {"quota_set": {"cores": 20}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:34.818797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.822079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.823662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.823662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.868912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:34.879096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93771938-4d81-4dea-bf4e-939c4a4b2d93 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1503 microversion: 2.1 time: 0.304241 Jul 19 19:47:34.891811 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 926/1858] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:34.899308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.905368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'tenant_id': '00e46cc14e7b45209acd57adb14636e1', 'deleted': False} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:34.911976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.913451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.914545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.915246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.920300 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ff39b6b-17f6-44bc-b36c-7631f86a0c94 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 329 microversion: 2.1 time: 0.194837 Jul 19 19:47:34.922444 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 933/1859] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:34 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:34.927927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e0b0bf7-1875-40de-a4f0-a7ea71ca8f9d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2e1940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.963661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8dbbacc5-c6dd-41d9-a44d-37c40beac058 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=00e46cc14e7b45209acd57adb14636e1" status: 200 len: 15 microversion: 2.1 time: 0.070228 Jul 19 19:47:34.965252 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 927/1860] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=00e46cc14e7b45209acd57adb14636e1 => generated 15 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:34.970551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:34.971698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:34.981535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.982492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:34.983556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:34.984220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.020839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e0b0bf7-1875-40de-a4f0-a7ea71ca8f9d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.097246 Jul 19 19:47:35.021819 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 934/1861] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:34 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:35.033973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d583a638-4c49-4b1d-b4ae-1cdd5c24d280 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Calling method '.version_select at 0x7f23ef244160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.136250 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d583a638-4c49-4b1d-b4ae-1cdd5c24d280 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 371 microversion: 2.1 time: 0.112632 Jul 19 19:47:35.138707 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 935/1862] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:35.145523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9858716-6f90-4e72-9f1e-85b5b7a381d4 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.178941 Jul 19 19:47:35.146158 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 928/1863] 10.222.0.23 () {58 vars in 1295 bytes} [Tue Jul 19 19:47:34 2022] DELETE /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e/os-server-password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:35.147816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41faf93d-0dc5-4548-b096-9c5743a47cd5 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.153115 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41faf93d-0dc5-4548-b096-9c5743a47cd5 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010200 Jul 19 19:47:35.153918 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 936/1864] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:35.165126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23efbed940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:35.174335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.175053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.183319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.183945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.185533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.186242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.228369 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6033fbd0-faff-4a53-9543-23a7c1015f37 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059515 Jul 19 19:47:35.230484 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 937/1865] 10.222.0.23 () {58 vars in 1292 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:35.237049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.240758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.249089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.249554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.251154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.251732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.253041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.253571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.254398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.254878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.322143 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a92c987f-a06c-4b74-9aef-071403552e60 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 328 microversion: 2.1 time: 0.167886 Jul 19 19:47:35.334414 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 929/1866] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:35 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 328 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:35.334414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:35.334414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.356335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.359029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.362556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.364301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.518878 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fcd119b9-4382-4ee8-b94d-fad499653703 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 0 microversion: 2.1 time: 0.194435 Jul 19 19:47:35.524153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 930/1867] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:35 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:35.525152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:35.525956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:35.533141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.533598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.534388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:35.535036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:35.568049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:35.637340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:35.724914 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c4988d0-dd3c-40b0-94c5-35dbeaa07ff1 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 204 len: 0 microversion: 2.1 time: 0.202296 Jul 19 19:47:35.726466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 931/1868] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:35 2022] DELETE /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:35.738481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1092813499", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:35.815021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:36.113177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.127348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c04d41ce-76bd-458b-9c37-073b4a318fcd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.895072 Jul 19 19:47:36.128209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 938/1869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:35 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.133914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.147733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.153682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:36.164008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.164935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.166091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.166853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.291761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:36.292346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:36.292705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:36.293218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:36.293916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:36.306226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:36.317962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.319254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.326352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.326824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.354659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:36.360382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for user bb4ba013d06f4c52b156b8744d601729 and project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:36.375745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.utils [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] instances quota exceeded for 7c7341667b544ff696e4e66d9baabce2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131229) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:47:36.376443 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Request method failure captured: Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 145 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpShaaFiWAKDXuBCNd8QP-r-_CtHrAoxoCB9o7xXs1r1cRckqiCgdX9J_Xjnc_nXBDmTIMLIbA0DoEQPjFpvEr1k1OaGqgjDdEmB3IKiiP_wLP5ZMi0cu4CRiBKiNEVC07keq51-UxZ8ssBJH5sByP6YyIIG4tZdXMRnYbjijzXqb4 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: bb4ba013d06f4c52b156b8744d601729 Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1092813499", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1092813499', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452'}}} Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:47:36.378592 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:36.384371 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83f2a78e-9974-45d7-81ae-ac361eaac968 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.651701 Jul 19 19:47:36.387722 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 932/1870] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:35 2022] POST /compute/v2.1/servers => generated 119 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:36.391237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.391981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.396384 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f11a5849-1a45-4010-b26f-c3e588587c2f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.265656 Jul 19 19:47:36.402492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.402809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.403471 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 939/1871] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:36.403663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.404146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.409773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-388195f8-9cca-4e9c-9f5d-44873fd74efa tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef244af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.511487 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-388195f8-9cca-4e9c-9f5d-44873fd74efa tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.099186 Jul 19 19:47:36.517561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 940/1872] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.522813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef244ca0>, body: {"quota_set": {"instances": 10}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:36.646007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.646455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.647301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.647441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:36.647750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.666441 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59f1f161-56c1-42b6-9c32-67666320ae3b tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1509 microversion: 2.1 time: 0.279252 Jul 19 19:47:36.675532 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 933/1873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:36.680123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:36.687314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.698543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.698543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.698543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.698543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.760756 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f981e25e-9cd7-407d-b2f0-c8097228577c tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 329 microversion: 2.1 time: 0.241601 Jul 19 19:47:36.769872 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 941/1874] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:36 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:36.781985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-836f7441-7159-4f3e-86fb-675e4ce15df6 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Calling method '.version_select at 0x7f23ef244550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.851928 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31278be5-f49b-4c2c-8f49-2eac1152162e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 0 microversion: 2.1 time: 0.175355 Jul 19 19:47:36.855831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 934/1875] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:36 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:36.864673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:36.866126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:36.885120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.885850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.887276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:36.887796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:36.903393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-836f7441-7159-4f3e-86fb-675e4ce15df6 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 371 microversion: 2.1 time: 0.125039 Jul 19 19:47:36.904459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 942/1876] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:36.919891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef244ee0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:37.010389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.011396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.012790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.013599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.065203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-898951b0-280d-4d3d-82de-5087c438c629 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1614 microversion: 2.1 time: 0.207970 Jul 19 19:47:37.078617 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 935/1877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:36 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1614 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:37.083584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.084204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:37.093034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.093499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.094305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.094743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.126744 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0b6cda6-2318-4053-8008-f4a7191e8d76 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 325 microversion: 2.1 time: 0.216020 Jul 19 19:47:37.128876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 943/1878] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:36 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:37.169239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.171557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:37.192203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.193362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.196757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.197454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.446832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48a3ae88-d1f7-4113-a70d-7496aa09d846 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1614 microversion: 2.1 time: 0.366920 Jul 19 19:47:37.449818 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 936/1879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1614 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:37.462107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1262561", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:37.553269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:37.938470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:37.954052 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60a6f51c-9507-47c7-a5dc-1f6568a6dba2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.803676 Jul 19 19:47:37.963895 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 944/1880] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:37.963895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:37.964364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'host': 'n-h1-843834-3', 'deleted': False} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:37.977814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.979507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:37.981290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:37.981941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.046647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:38.102588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:38.104013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:38.104439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:38.104912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:38.105322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:38.105733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:38.120539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.125775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.127394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.128799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.186479 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4499399b-242d-411f-970c-056ee52e869c tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h1-843834-3&all_tenants=1" status: 200 len: 1618 microversion: 2.1 time: 0.230169 Jul 19 19:47:38.188038 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 945/1881] 10.222.0.23 () {58 vars in 1189 bytes} [Tue Jul 19 19:47:37 2022] GET /compute/v2.1/servers?host=n-h1-843834-3&all_tenants=1 => generated 1618 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:38.196417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:38.199533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad2f6c4b-3d18-42ec-925c-00a6f44bbb26 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef24f820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.209005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Getting quotas for user bb4ba013d06f4c52b156b8744d601729 and project 7c7341667b544ff696e4e66d9baabce2. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:38.223617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.utils [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] ram quota exceeded for 7c7341667b544ff696e4e66d9baabce2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131229) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 19:47:38.224158 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Request method failure captured: Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 142 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpShaaFiWAKDXuBCNd8QP-r-_CtHrAoxoCB9o7xXs1r1cRckqiCgdX9J_Xjnc_nXBDmTIMLIbA0DoEQPjFpvEr1k1OaGqgjDdEmB3IKiiP_wLP5ZMi0cu4CRiBKiNEVC07keq51-UxZ8ssBJH5sByP6YyIIG4tZdXMRnYbjijzXqb4 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: bb4ba013d06f4c52b156b8744d601729 Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1262561", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1262561', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452'}}} Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 19:47:38.226293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:38.230682 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db36500d-008f-4e9b-9283-f3a162a0e028 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.776705 Jul 19 19:47:38.233539 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 937/1882] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 781 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:38.238625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.239276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.246230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.246675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.247700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.248314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.282125 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad2f6c4b-3d18-42ec-925c-00a6f44bbb26 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.089455 Jul 19 19:47:38.282739 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 946/1883] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:38.293983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.299703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:38.309405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.310323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.312196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.312902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.340346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bcb4eece-45f3-484d-b79e-5e7b1a70e5f3 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.050431 Jul 19 19:47:38.341260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 947/1884] 10.222.0.23 () {58 vars in 1195 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:47:38.369852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef29e1f0>, body: {"quota_set": {"ram": 51200}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:38.478188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.478643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.479503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.479947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.500001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf659f72d3864979a0970abead916be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998abc01de1943878facb6a7c7f50dc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:38.508706 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ef4ed6a-b380-4121-a127-5bdbb0c73563 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 200 len: 1509 microversion: 2.1 time: 0.275278 Jul 19 19:47:38.509327 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 938/1885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:38.534784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:38.535864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.564546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.565170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.565766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.566199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.574015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-951e3e22-c464-4e2f-bbdf-819033ab09c7 tempest-QuotasAdminNegativeTest-1858676549 tempest-QuotasAdminNegativeTest-1858676549-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 200 len: 329 microversion: 2.1 time: 0.230381 Jul 19 19:47:38.574901 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 948/1886] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:38 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 329 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:38.596326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06d4a43a-4e18-4381-b8d6-d1e91be23946 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Action: 'update', calling method: .version_select at 0x7f23ef2adaf0>, body: {"quota_set": {"ram": 0}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:38.600798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-06d4a43a-4e18-4381-b8d6-d1e91be23946 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'bb4ba013d06f4c52b156b8744d601729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7341667b544ff696e4e66d9baabce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06d4a43a-4e18-4381-b8d6-d1e91be23946 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Request method failure captured: Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 HTTP/1.1 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 25 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wpShaaFiWAKDXuBCNd8QP-r-_CtHrAoxoCB9o7xXs1r1cRckqiCgdX9J_Xjnc_nXBDmTIMLIbA0DoEQPjFpvEr1k1OaGqgjDdEmB3IKiiP_wLP5ZMi0cu4CRiBKiNEVC07keq51-UxZ8ssBJH5sByP6YyIIG4tZdXMRnYbjijzXqb4 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c7341667b544ff696e4e66d9baabce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7c7341667b544ff696e4e66d9baabce2 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103099154 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: bb4ba013d06f4c52b156b8744d601729 Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-QuotasAdminNegativeTest-103099154-project Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: {"quota_set": {"ram": 0}} Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '7c7341667b544ff696e4e66d9baabce2', 'body': {'quota_set': {'ram': 0}}} Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:47:38.613143 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06d4a43a-4e18-4381-b8d6-d1e91be23946 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:38.619530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-06d4a43a-4e18-4381-b8d6-d1e91be23946 tempest-QuotasAdminNegativeTest-103099154 tempest-QuotasAdminNegativeTest-103099154-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2" status: 403 len: 116 microversion: 2.1 time: 0.031180 Jul 19 19:47:38.622691 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 949/1887] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:47:38 2022] PUT /compute/v2.1/os-quota-sets/7c7341667b544ff696e4e66d9baabce2 => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:47:38.652959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-928dfaa7-5c37-4d3c-954d-c624df2a0bec req-2e7ad286-5b3e-43b6-9c1a-5e47ac80b009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2234cf-3634-4d8b-b0fa-41303a3b977e", "name": "network-vif-deleted", "tag": "89be390e-d3f7-4cec-8394-5d79d453bea6"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:38.687275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-928dfaa7-5c37-4d3c-954d-c624df2a0bec req-2e7ad286-5b3e-43b6-9c1a-5e47ac80b009 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.687696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-928dfaa7-5c37-4d3c-954d-c624df2a0bec req-2e7ad286-5b3e-43b6-9c1a-5e47ac80b009 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.720206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-928dfaa7-5c37-4d3c-954d-c624df2a0bec req-2e7ad286-5b3e-43b6-9c1a-5e47ac80b009 service nova] Creating event network-vif-deleted:89be390e-d3f7-4cec-8394-5d79d453bea6 for instance cd2234cf-3634-4d8b-b0fa-41303a3b977e on n-h2-843834-3 Jul 19 19:47:38.738529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-928dfaa7-5c37-4d3c-954d-c624df2a0bec req-2e7ad286-5b3e-43b6-9c1a-5e47ac80b009 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114551 Jul 19 19:47:38.748552 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 950/1888] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:38.792943 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12e2189c-ed73-42fb-9b29-1f3e06051c81 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 0 microversion: 2.1 time: 0.269706 Jul 19 19:47:38.797933 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 939/1889] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:38 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:38.804938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:38.806564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.814853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.815378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.816240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.816681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.968564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:38.969069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:38.969490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:38.969895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:38.970309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:38.973508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:38.974559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:38.985056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.985811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:38.987223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:38.987844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.121494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.126822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.129411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.131207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.131842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.240217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-696ead53-8667-42c1-8f0d-a71ebc9a0fd2 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 1067 microversion: 2.1 time: 0.434598 Jul 19 19:47:39.240217 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 951/1890] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:47:38 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 1067 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 19:47:39.260506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.261900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.267127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:39.274567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.276050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.277397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.279444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.292237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:39.336647 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-030ec724-4198-41c1-a3a8-aaf4cb277f30 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.367843 Jul 19 19:47:39.351144 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 940/1891] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:38 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:39.401760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f235cb3f-0d8c-4315-a0ab-e7f43848ef18 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef58f940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.526545 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f235cb3f-0d8c-4315-a0ab-e7f43848ef18 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.173814 Jul 19 19:47:39.527289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 941/1892] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:39.534343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:39.552212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] [instance: cd2234cf-3634-4d8b-b0fa-41303a3b977e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:39.560878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.561430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.562627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:39.563165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:39.594699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] HTTP exception thrown: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Request method failure captured: Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e HTTP/1.1 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpCuZIa9Oa1lJA4I4FTNgfWI4Mhqch-BTM1tF78pW5iEWPpHp_r8HFIT2gxbFlXgu243_uEeOSdc-jPI4IdRFFrmnsr0OHrCrxDwJFqhRPMUW36FWzx0l03teT0F0mci17uDb9n5dVvjtd_QIhBba8U5qKDvxVeWJsDNeqhtoU03gU Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 998abc01de1943878facb6a7c7f50dc0 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerPasswordTestJSON-1038483062 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/998abc01de1943878facb6a7c7f50dc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/998abc01de1943878facb6a7c7f50dc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_998abc01de1943878facb6a7c7f50dc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/998abc01de1943878facb6a7c7f50dc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerPasswordTestJSON-1038483062 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 998abc01de1943878facb6a7c7f50dc0 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1038483062 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerPasswordTestJSON-1038483062-project Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: bf659f72d3864979a0970abead916be9 Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerPasswordTestJSON-1038483062-project Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'cd2234cf-3634-4d8b-b0fa-41303a3b977e'} Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:39.596613 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. Jul 19 19:47:39.602291 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:39.604547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] Returning 404 to user: Instance cd2234cf-3634-4d8b-b0fa-41303a3b977e could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:39.606325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f626d81f-1f85-46fd-9624-ee670a6efbc9 tempest-ServerPasswordTestJSON-1038483062 tempest-ServerPasswordTestJSON-1038483062-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e" status: 404 len: 111 microversion: 2.1 time: 0.075821 Jul 19 19:47:39.607586 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 942/1893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/servers/cd2234cf-3634-4d8b-b0fa-41303a3b977e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:39.705819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:39.721061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ef7eb57-3182-412f-997e-cfc1de0bb9ac tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.465379 Jul 19 19:47:39.722035 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 952/1894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:39 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:40.355799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:40.356868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:40.370398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.372961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.376795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.378711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.544481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05dab185-f8b6-4320-9385-d26853c40a0f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2ccb80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:40.646632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05dab185-f8b6-4320-9385-d26853c40a0f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1453 microversion: 2.1 time: 0.106913 Jul 19 19:47:40.648583 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 953/1895] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:40 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:40.712289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:40.732935 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-09596ef0-f665-43ea-b32a-08eeb1756a77 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.380297 Jul 19 19:47:40.749781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:40.750629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:40.757164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 943/1896] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:40 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:40.777183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.777986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:40.782858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:40.783361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:41.026753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:41.043553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-191b3287-9621-4f3f-841f-65238937571e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.297983 Jul 19 19:47:41.055382 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 954/1897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:40 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:41.663570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e7acb37-f73e-417d-804f-e22b572a4648 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef849d30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:41.724170 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e7acb37-f73e-417d-804f-e22b572a4648 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1462 microversion: 2.1 time: 0.064911 Jul 19 19:47:41.726201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 944/1898] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:41 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1462 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:41.741014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5a156914-1ee0-469b-9f5f-628dea963fc7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2c3160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:41.758635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:41.759496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:41.768927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.769889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:41.770977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.771727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:41.816836 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5a156914-1ee0-469b-9f5f-628dea963fc7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 200 len: 1462 microversion: 2.1 time: 0.080984 Jul 19 19:47:41.818434 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 955/1899] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:41 2022] GET /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:41.830591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:41.831703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:41.845158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.845890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:41.846666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:41.847543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.022603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:42.033832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-922e4315-21b5-44c7-8f71-23746be3d95e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.284468 Jul 19 19:47:42.044905 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 945/1900] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:41 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.066541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.067570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:42.072866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:42.076877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.077900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.079268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:42.079969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:42.085847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c76a914-1cd3-4b44-9a9a-3f9e235a1dbc tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1466 microversion: 2.1 time: 0.259012 Jul 19 19:47:42.086870 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 956/1901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:41 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.109837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af05876c-769d-45ba-8c23-b03d43701d05 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.244954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af05876c-769d-45ba-8c23-b03d43701d05 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-07-19T19%3A45%3A27Z" status: 200 len: 1903 microversion: 2.1 time: 0.142025 Jul 19 19:47:42.246243 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 957/1902] 10.222.0.23 () {58 vars in 1198 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?changes-since=2022-07-19T19%3A45%3A27Z => generated 1903 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.264989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d621a2f1-bc00-42e5-b928-f0b1339b0ae7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef3154c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.381390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:42.391163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7ebf8744-e4fc-4bb5-bcd0-b08c753d2f44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.329176 Jul 19 19:47:42.401166 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 946/1903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.415173 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d621a2f1-bc00-42e5-b928-f0b1339b0ae7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1955959628" status: 200 len: 485 microversion: 2.1 time: 0.158159 Jul 19 19:47:42.416127 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 958/1904] 10.222.0.23 () {58 vars in 1230 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1955959628 => generated 485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:42.430530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-880e6298-54ae-4ddf-9f60-1c03a58bb66a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23efb60670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.547346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-880e6298-54ae-4ddf-9f60-1c03a58bb66a tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?server=201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 957 microversion: 2.1 time: 0.122146 Jul 19 19:47:42.555082 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 947/1905] 10.222.0.23 () {58 vars in 1208 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?server=201f25f8-06c5-4395-bea5-b44744b00302 => generated 957 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:42.564480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e059a330-e943-4676-a3d9-ae4d81ba79ea tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef31a430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.620186 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e059a330-e943-4676-a3d9-ae4d81ba79ea tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 485 microversion: 2.1 time: 0.063213 Jul 19 19:47:42.626453 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 959/1906] 10.222.0.23 () {58 vars in 1316 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:42.633601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-186132df-3f50-4bc2-abd6-d22c677c6c58 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef550f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.714822 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-186132df-3f50-4bc2-abd6-d22c677c6c58 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 485 microversion: 2.1 time: 0.085990 Jul 19 19:47:42.715821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 948/1907] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 485 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:42.733800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec3d0f26-5606-4cb6-9444-d47e9b37a9e0 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:42.904379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec3d0f26-5606-4cb6-9444-d47e9b37a9e0 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.180060 Jul 19 19:47:42.906810 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 960/1908] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:42.923703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da7d4518-c4ad-43a0-9317-9f2153591bb7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef550a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.031868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da7d4518-c4ad-43a0-9317-9f2153591bb7 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.115206 Jul 19 19:47:43.032485 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 949/1909] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:47:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.058366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.059327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:43.062763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4f125c3-7920-49f2-b585-11da3dd2e3c4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.071816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.072280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.073872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.074252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.244151 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4f125c3-7920-49f2-b585-11da3dd2e3c4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.196540 Jul 19 19:47:43.245316 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 961/1910] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:43.270275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1dfda311-9ca2-4d07-b7f8-a132776652b8 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef315550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.306157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:43.327581 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c7fef32-3de2-4dbc-8997-449a41f8aeab tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.271436 Jul 19 19:47:43.327581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 950/1911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.376449 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1dfda311-9ca2-4d07-b7f8-a132776652b8 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-07-19T19%3A45%3A21Z" status: 200 len: 6329 microversion: 2.1 time: 0.119848 Jul 19 19:47:43.377052 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 962/1912] 10.222.0.23 () {58 vars in 1219 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-19T19%3A45%3A21Z => generated 6329 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.393487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3537c132-2969-4177-9b00-e69124155f9f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23efcff4c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.409358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.409975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:43.417131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.417590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.419286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:43.419788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:43.447825 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3537c132-2969-4177-9b00-e69124155f9f tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1955959628" status: 200 len: 665 microversion: 2.1 time: 0.058815 Jul 19 19:47:43.452225 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 951/1913] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1955959628 => generated 665 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:43.467824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-259452c4-00ea-4559-95fe-9238dc984a21 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef5501f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.549185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-259452c4-00ea-4559-95fe-9238dc984a21 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1465 microversion: 2.1 time: 0.085996 Jul 19 19:47:43.549803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 952/1914] 10.222.0.23 () {58 vars in 1337 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1465 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.621037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:43.629982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b086573-9d97-405f-aa04-9c7599ddc18e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.224794 Jul 19 19:47:43.640292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 963/1915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:43.640292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a62c3a94-0152-4cac-90fc-97443ba24ea3 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313c10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.699710 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a62c3a94-0152-4cac-90fc-97443ba24ea3 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1465 microversion: 2.1 time: 0.067685 Jul 19 19:47:43.700564 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 964/1916] 10.222.0.23 () {58 vars in 1323 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1465 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.715397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92244a51-dca0-44c5-95b9-952271b88373 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef2cc940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.763322 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-822314ba-8469-4f1e-8e68-3e21cfe35ff9 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T19%3A47%3A43.547742&end=2022-07-20T19%3A47%3A43.547742" status: 404 len: 112 microversion: - time: 0.211445 Jul 19 19:47:43.764576 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 953/1917] 10.222.0.23 () {58 vars in 1315 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T19%3A47%3A43.547742&end=2022-07-20T19%3A47%3A43.547742 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:47:43.773954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ab0872f-bbd6-40f5-9822-81b5cb0e16c6 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] Calling method '.version_select at 0x7f23efbd38b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:43.779151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6ab0872f-bbd6-40f5-9822-81b5cb0e16c6 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ab0872f-bbd6-40f5-9822-81b5cb0e16c6 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] Request method failure captured: Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-simple-tenant-usage/96df3a5c7f594c0bb75bedd59a5cf147?start=2022-07-20T19%3A47%3A43.547742&end=2022-07-18T19%3A47%3A43.547742 HTTP/1.1 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpfX8k2ZIsb47jJi4qzsXSN0g3QXcE6Vz8dm_rjfsynQWxiTCGEGXrnubWHqK6lRCib-bXH8k7OwGfEp9SArWQQyYeGJkzz2u1Ef-FGRArAluZEazvuPOW04mbOJIkw_F_dHWw4_3K9-D2MqInAiTHg9UwirySzJBP08pydwfMAuWs Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 688236a1e2934b23b043c9e58425c3ac Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-776864250 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/688236a1e2934b23b043c9e58425c3ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/688236a1e2934b23b043c9e58425c3ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_688236a1e2934b23b043c9e58425c3ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/688236a1e2934b23b043c9e58425c3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-776864250 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 688236a1e2934b23b043c9e58425c3ac Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-776864250 Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TenantUsagesNegativeTestJSON-776864250-project-admin Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a9f57c19b0ed4c6891770ac3447ce70d Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-776864250-project-admin Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid start time. The start time cannot occur after the end time. Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '96df3a5c7f594c0bb75bedd59a5cf147'} Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 19 19:47:43.788446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:43.806809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ab0872f-bbd6-40f5-9822-81b5cb0e16c6 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:43.806809 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ab0872f-bbd6-40f5-9822-81b5cb0e16c6 tempest-TenantUsagesNegativeTestJSON-776864250 tempest-TenantUsagesNegativeTestJSON-776864250-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/96df3a5c7f594c0bb75bedd59a5cf147?start=2022-07-20T19%3A47%3A43.547742&end=2022-07-18T19%3A47%3A43.547742" status: 400 len: 111 microversion: 2.1 time: 0.022222 Jul 19 19:47:43.806809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 954/1918] 10.222.0.23 () {58 vars in 1411 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/os-simple-tenant-usage/96df3a5c7f594c0bb75bedd59a5cf147?start=2022-07-20T19%3A47%3A43.547742&end=2022-07-18T19%3A47%3A43.547742 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:47:43.855669 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92244a51-dca0-44c5-95b9-952271b88373 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.144732 Jul 19 19:47:43.858081 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 965/1919] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:43.887185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b721f61-ea05-40af-aab8-3dd8239498df tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef334ca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.002228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7b721f61-ea05-40af-aab8-3dd8239498df tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.121852 Jul 19 19:47:44.007524 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 966/1920] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:44.029185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2692ed7f-e71f-43e5-aaae-fda44ae49806 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef313af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.107505 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2692ed7f-e71f-43e5-aaae-fda44ae49806 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29" status: 200 len: 784 microversion: 2.1 time: 0.084181 Jul 19 19:47:44.108603 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 967/1921] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:47:44 2022] GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29 => generated 784 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:47:44.126215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-feb033ed-88b9-45c3-81d9-6995c66bce78 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef24f0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.129736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155c4b29-623e-4a01-987e-35fe84a8c4c5 tempest-TenantUsagesNegativeTestJSON-1612046854 tempest-TenantUsagesNegativeTestJSON-1612046854-project] Calling method '.version_select at 0x7f23ef84d430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.132128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-155c4b29-623e-4a01-987e-35fe84a8c4c5 tempest-TenantUsagesNegativeTestJSON-1612046854 tempest-TenantUsagesNegativeTestJSON-1612046854-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7a1e6c305ef4498895c8dc7b70cd3687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96df3a5c7f594c0bb75bedd59a5cf147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155c4b29-623e-4a01-987e-35fe84a8c4c5 tempest-TenantUsagesNegativeTestJSON-1612046854 tempest-TenantUsagesNegativeTestJSON-1612046854-project] Request method failure captured: Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A47%3A43.547742&end=2022-07-20T19%3A47%3A43.547742&detailed=1 HTTP/1.1 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpeXMKLKNsVFkOAEYkLHbN8AnXZeXogSUG-oy2wPklBHowfkEe-aFb91-ip_QhXgrelJmuJuWnS92CSrTUOZUTkWCraJQDOg2bNo51WPAKT5PAi4UtUvNqEt3yiPzHwzhERAdNYhE3LQFFEPfbY8DxQ8AFqVTbltFn8Y3Q0-O9WNL8 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 96df3a5c7f594c0bb75bedd59a5cf147 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1612046854 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96df3a5c7f594c0bb75bedd59a5cf147"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96df3a5c7f594c0bb75bedd59a5cf147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96df3a5c7f594c0bb75bedd59a5cf147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96df3a5c7f594c0bb75bedd59a5cf147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1612046854 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 96df3a5c7f594c0bb75bedd59a5cf147 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1612046854 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TenantUsagesNegativeTestJSON-1612046854-project Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7a1e6c305ef4498895c8dc7b70cd3687 Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1612046854-project Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:47:44.137419 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155c4b29-623e-4a01-987e-35fe84a8c4c5 tempest-TenantUsagesNegativeTestJSON-1612046854 tempest-TenantUsagesNegativeTestJSON-1612046854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-155c4b29-623e-4a01-987e-35fe84a8c4c5 tempest-TenantUsagesNegativeTestJSON-1612046854 tempest-TenantUsagesNegativeTestJSON-1612046854-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A47%3A43.547742&end=2022-07-20T19%3A47%3A43.547742&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.336468 Jul 19 19:47:44.144604 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 955/1922] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Jul 19 19:47:43 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T19%3A47%3A43.547742&end=2022-07-20T19%3A47%3A43.547742&detailed=1 => generated 123 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:44.200815 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-feb033ed-88b9-45c3-81d9-6995c66bce78 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.083622 Jul 19 19:47:44.201795 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 968/1923] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:47:44 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:44.217136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ec15db0-0668-4718-85cc-9aded9cf445d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f240095c790>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.348676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.349693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:44.369770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.371071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:44.374022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.376590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:44.666391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:44.685702 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f38e634-d3db-4740-bb8e-69fd5fb71bb7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.341748 Jul 19 19:47:44.686667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 969/1924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:44 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:44.694715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:44.695634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:44.724239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.725318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:44.732072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:44.732800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:45.032578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:45.067104 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4fa714f-baa6-43d7-b543-ede93bc39b7d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.374258 Jul 19 19:47:45.078333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 970/1925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:44 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:45.276768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-bc3d6c7a-6a63-4b67-84c5-ad20d7af6921 req-5d6bd634-eeff-4570-b22d-676c9f916d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-unplugged", "status": "completed", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:45.294141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bc3d6c7a-6a63-4b67-84c5-ad20d7af6921 req-5d6bd634-eeff-4570-b22d-676c9f916d18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:45.294591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bc3d6c7a-6a63-4b67-84c5-ad20d7af6921 req-5d6bd634-eeff-4570-b22d-676c9f916d18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:45.326095 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bc3d6c7a-6a63-4b67-84c5-ad20d7af6921 req-5d6bd634-eeff-4570-b22d-676c9f916d18 service nova] Creating event network-vif-unplugged:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:47:45.339587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-bc3d6c7a-6a63-4b67-84c5-ad20d7af6921 req-5d6bd634-eeff-4570-b22d-676c9f916d18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067715 Jul 19 19:47:45.340626 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 971/1926] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:45.493218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ec15db0-0668-4718-85cc-9aded9cf445d tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7" status: 204 len: 0 microversion: 2.1 time: 1.282168 Jul 19 19:47:45.493932 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 956/1927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:44 2022] DELETE /compute/v2.1/images/14088d05-563a-4764-b097-1167286b38f7 => generated 0 bytes in 1284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:45.503599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c674ba05-b711-4dbf-a40c-208694234666 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef34cd30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:45.710776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:45.711460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:45.722736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:45.735792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:45.736744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:45.737338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:45.906631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:45.916421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-acad0108-54ae-4649-be7f-69060f69c591 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.214096 Jul 19 19:47:45.917162 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 957/1928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:45 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:46.087349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:46.088076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:46.095511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.096338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:46.097367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.098015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:46.103364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:46.292221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:46.305091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d29cf56-17bc-4eab-9f12-f0b29acd867f tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.221401 Jul 19 19:47:46.306645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 958/1929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:46 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:46.698557 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c674ba05-b711-4dbf-a40c-208694234666 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4" status: 204 len: 0 microversion: 2.1 time: 1.199341 Jul 19 19:47:46.701625 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 972/1930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:45 2022] DELETE /compute/v2.1/images/04d80ab7-2a98-4455-9710-2f9b61246da4 => generated 0 bytes in 1203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:46.711978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9e04a21-2da1-4136-95f8-84f166de3e98 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f240090b160>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:46.937391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:46.938238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:46.947113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.947868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:46.948929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:46.949372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.110768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.120021 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-773110a7-db52-4661-9e9c-ac850f060aad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.187568 Jul 19 19:47:47.135344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 973/1931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:46 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:47.325823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.326966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.333686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.334623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.335968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.336662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.541862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:47.551407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aadd1368-698c-4e89-a246-3f3027df072e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.229613 Jul 19 19:47:47.561787 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 974/1932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:47.677191 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9e04a21-2da1-4136-95f8-84f166de3e98 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82" status: 204 len: 0 microversion: 2.1 time: 0.970671 Jul 19 19:47:47.678207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 959/1933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:46 2022] DELETE /compute/v2.1/images/bf77b928-26eb-4bb0-8541-f3aaaaf0ed82 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:47.690158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.690848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.715233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.717102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.718260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.718701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.746660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:47.842010 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60a24a10-cd0c-47e5-bae1-b0e9863a9be1 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 204 len: 0 microversion: 2.1 time: 0.157919 Jul 19 19:47:47.843357 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 975/1934] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:47 2022] DELETE /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:47.854114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:47.854824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:47.863313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.864317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:47.865318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:47.865924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.141002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.142460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.150162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.150628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.151520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.152045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.154419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=14 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:48.168886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:48.218065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.220386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=30 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:48.227664 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-debeaad7-5ddd-4103-b1bb-c0c0ae9c9307 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1473 microversion: 2.1 time: 0.380072 Jul 19 19:47:48.228260 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 960/1935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:47 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1473 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:48.474094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.488159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e78a685d-de63-4858-a8ee-1986847e71fd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.352436 Jul 19 19:47:48.489285 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 976/1936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:48.570408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:48.571134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:48.578341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.578990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.579839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:48.580338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:48.845067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:48.858055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55566152-d9a3-43ea-aa11-84ac08d16650 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.292548 Jul 19 19:47:48.861641 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 961/1937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:48 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:49.245328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.246006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:49.248271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=20 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:49.249051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=46 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:49.264960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.265451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.266430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.267013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.514989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.516106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:49.533606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:49.538588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.541464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.542687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.543379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.598167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.609853 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be91714a-27e0-4e5c-94e5-d2012e91ce17 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1473 microversion: 2.1 time: 0.368575 Jul 19 19:47:49.611742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 977/1938] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1473 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:49.659108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.665974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.668541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Searching by: {'deleted': False, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:49.678371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.679373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.681264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.681985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.728295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:49.790783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f7c71a4-2d26-4396-b36f-f4cbf4d6ea9d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.136557 Jul 19 19:47:49.791865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 978/1939] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers => generated 340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:49.806120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:49.815843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.820064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Searching by: {'deleted': False, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:47:49.836184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.837884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.839196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.842026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:49.878013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:47:49.923290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:49.930353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:49.930983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.408875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:50.418882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ddb4bd9-4a0e-47ef-b3c2-3312a7dc3a54 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.908966 Jul 19 19:47:50.419497 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 962/1940] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:50.425516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.426118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.432684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.433457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.434248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.434678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.787486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-623e2419-aece-46d4-929e-e9f50ec10e89 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1714 microversion: 2.1 time: 0.987421 Jul 19 19:47:50.801595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 979/1941] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:47:49 2022] GET /compute/v2.1/servers/detail => generated 1714 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:50.810041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.810476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:50.819875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.821686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.822521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:50.823205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:50.914509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:50.929835 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98f7531f-d06d-4dde-af90-5b75b3dd3f34 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.505291 Jul 19 19:47:50.944367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 963/1942] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:50.961021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc2981ee-b17b-4588-ae84-67d7e5b802e9 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:50.987896 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc2981ee-b17b-4588-ae84-67d7e5b802e9 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039337 Jul 19 19:47:50.989924 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 964/1943] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:51.005127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3bd0fa20-69b6-4c7b-94d9-a40d033283b9 req-05a60338-1d21-4aff-baef-96d5bb055d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "name": "network-vif-unplugged", "status": "completed", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:51.024425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bd0fa20-69b6-4c7b-94d9-a40d033283b9 req-05a60338-1d21-4aff-baef-96d5bb055d20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.024992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bd0fa20-69b6-4c7b-94d9-a40d033283b9 req-05a60338-1d21-4aff-baef-96d5bb055d20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.058351 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3bd0fa20-69b6-4c7b-94d9-a40d033283b9 req-05a60338-1d21-4aff-baef-96d5bb055d20 service nova] Creating event network-vif-unplugged:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:47:51.070716 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3bd0fa20-69b6-4c7b-94d9-a40d033283b9 req-05a60338-1d21-4aff-baef-96d5bb055d20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079161 Jul 19 19:47:51.071575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 965/1944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:51.370899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:51.371448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.392757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.393207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.393998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.395779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.464152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:51.537006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:51.548715 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-391abfa0-11ef-4a72-8ea8-6ad6cb9c794b tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1473 microversion: 2.1 time: 0.745427 Jul 19 19:47:51.553879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 980/1945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:50 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1473 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:51.566312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:51.567358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.578367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.582903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.583797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.584236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.604059 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40c3b01e-ebda-478d-97e6-a1368860d1bc tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 204 len: 0 microversion: 2.1 time: 0.242254 Jul 19 19:47:51.608635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 966/1946] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:51 2022] DELETE /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:47:51.618593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:51.619530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:51.633381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.633767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:51.636808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:51.641050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.197064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:52.207146 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-430928b4-e4ae-40fa-911a-7834435d7afd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.651686 Jul 19 19:47:52.208053 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 981/1947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:51 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:52.229238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:52.230487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:52.239955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:52.240696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.241798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:52.242389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.453876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:52.462555 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de029a9f-e3eb-48e9-aece-46145f365c82 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1717 microversion: 2.1 time: 0.852257 Jul 19 19:47:52.475446 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 967/1948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:51 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1717 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:52.575339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:52.576280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:52.584423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:52.584826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.585640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:52.586079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.701500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:52.701981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:52.706442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lazy-loading 'fault' on Instance uuid c1c47c23-7b6a-423c-af6f-b3c5a82d424d {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:47:52.894978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:52.906832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fe7301d6-ebce-400f-b7e4-50bd45bf638e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 200 len: 1307 microversion: 2.1 time: 0.340960 Jul 19 19:47:52.911300 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 968/1949] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:52 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:53.170688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c47c23-7b6a-423c-af6f-b3c5a82d424d", "name": "network-vif-deleted", "tag": "db322cb0-6c7e-42d2-9a76-de9677d46fe0"}, {"name": "network-changed", "server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:53.191931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.192889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.225246 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] Creating event network-vif-deleted:db322cb0-6c7e-42d2-9a76-de9677d46fe0 for instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d on n-h1-843834-3 Jul 19 19:47:53.225767 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] Creating event network-changed:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:47:53.235834 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-bcd5f005-7bac-4af5-a0c7-0189156cfe75 req-b27b394b-c06e-4302-a1e0-5fe7d8766898 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078073 Jul 19 19:47:53.236800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 969/1950] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:53.242793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.244050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.253105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.254499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.255661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.256508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.285256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.313334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62ba31ee-43f3-40e2-b4b8-6a8189435555 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 1.103695 Jul 19 19:47:53.314593 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 982/1951] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:52 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:53.492589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.493433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.501871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.507918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.515680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.517999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.577439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.590514 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1651c513-dd05-40bb-bd50-bcee22dd3a1c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.352418 Jul 19 19:47:53.591170 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 970/1952] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:53.920440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:53.930395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.931742 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ebec1f25-6900-4ec4-92f6-b16a20993c66 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1717 microversion: 2.1 time: 0.443045 Jul 19 19:47:53.932133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: c1c47c23-7b6a-423c-af6f-b3c5a82d424d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.932395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 983/1953] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1717 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:53.940582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.941207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.942234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.942679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.967077 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] HTTP exception thrown: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Request method failure captured: Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d HTTP/1.1 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wnQeibB77Kfy0OJlcAv8rYhaTn9CZ-3WSupXdFhtjPOhpCSlJwIUtO_ccVx2uRAZ0HH6GVZm-QrC0EC_-n5X0Ib-o8RCSyc1PHViSYZqzR0IBITQKf5TAFBFov-Q8pMuGZGGEGEXOU-NHDXWl76BUVMhrgdaNSjcKIu_20kySKF-B0 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e35827fb886b4c3980b7c7999163f0c1 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e35827fb886b4c3980b7c7999163f0c1 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ListImageFiltersTestJSON-554704885-project Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8601b797c397479fbb09f2e3da659145 Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ListImageFiltersTestJSON-554704885-project Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c1c47c23-7b6a-423c-af6f-b3c5a82d424d'} Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:53.972259 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Returning 404 to user: Instance c1c47c23-7b6a-423c-af6f-b3c5a82d424d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4cb06eb8-f2ec-4a00-8f94-c8c9488d96b4 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d" status: 404 len: 111 microversion: 2.1 time: 0.052741 Jul 19 19:47:53.982069 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 971/1954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:53 2022] GET /compute/v2.1/servers/c1c47c23-7b6a-423c-af6f-b3c5a82d424d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:53.987435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:53.987937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:53.996162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.996628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:53.997427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:53.997995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:54.025733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:47:54.148712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d75feb61-540d-4476-83d0-4731dd3e1232 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 204 len: 0 microversion: 2.1 time: 0.165961 Jul 19 19:47:54.155523 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 984/1955] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:47:53 2022] DELETE /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:54.164199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:54.165325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:54.178156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:54.183885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:54.184904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:54.186260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:54.333691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:54.335295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:54.346113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:54.351726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:54.352826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:54.357936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.242975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.251958 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f9df7e6-7799-44d5-b42d-01cfad81fc63 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1472 microversion: 2.1 time: 1.091926 Jul 19 19:47:55.252462 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 972/1956] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:54 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1472 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:55.266300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:55.266950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:55.290840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.291597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.292870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.293478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.365988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.378688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ea2ad1c-4c94-4d6e-aeb5-10f145479d63 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 1.049364 Jul 19 19:47:55.380267 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 985/1957] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:54 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:55.394667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:55.397405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:55.411678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.415520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.416773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:55.417542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:55.614732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4c97c21fd434d93a40ec91931e45dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39d6bb03fa345c3932aa6a424d3bea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.630334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c93bcb60-b29e-486a-87f9-49ceddc4118d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 200 len: 1649 microversion: 2.1 time: 0.246862 Jul 19 19:47:55.631379 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 986/1958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:55 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 1649 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:55.862290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:55.879984 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7869ad33-6de1-4ff9-ab9e-d4ba99608690 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.618842 Jul 19 19:47:55.884366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 973/1959] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:55 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:56.089412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-20eb3f98-6f7d-4274-b9c1-afe71e2ad19b req-ff35e35d-85b5-4090-82c6-dccff951f02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43911b4-f882-4619-b398-71c3d4f3569a", "name": "network-vif-deleted", "tag": "253db289-756a-4d65-bac8-ef499993f038"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:56.101161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-20eb3f98-6f7d-4274-b9c1-afe71e2ad19b req-ff35e35d-85b5-4090-82c6-dccff951f02e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.101612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-20eb3f98-6f7d-4274-b9c1-afe71e2ad19b req-ff35e35d-85b5-4090-82c6-dccff951f02e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.142699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-20eb3f98-6f7d-4274-b9c1-afe71e2ad19b req-ff35e35d-85b5-4090-82c6-dccff951f02e service nova] Creating event network-vif-deleted:253db289-756a-4d65-bac8-ef499993f038 for instance c43911b4-f882-4619-b398-71c3d4f3569a on n-h2-843834-3 Jul 19 19:47:56.158242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-20eb3f98-6f7d-4274-b9c1-afe71e2ad19b req-ff35e35d-85b5-4090-82c6-dccff951f02e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074871 Jul 19 19:47:56.161864 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 987/1960] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:56.270178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:56.270806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:56.282122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.282485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.285577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.285881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.398381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:56.399114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:56.409051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.409503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:56.410348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:56.410783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.044865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8601b797c397479fbb09f2e3da659145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35827fb886b4c3980b7c7999163f0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:57.052921 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4de9bfb8-3526-4636-8eb5-5e99bb03d3ab tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 200 len: 1472 microversion: 2.1 time: 0.787018 Jul 19 19:47:57.054171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 974/1961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:56 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 1472 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:57.059570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.066778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] [instance: c43911b4-f882-4619-b398-71c3d4f3569a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:57.127090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.137146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.139482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.147786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.212300 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] HTTP exception thrown: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Request method failure captured: Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a HTTP/1.1 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1woh1sLW3Uf1tBdKtVsusk5Y0xh05Gb_SfXUiV-Z66bya1VoFqeQDiCjXluMN9O4P7T_T9O4k-2gzIa2MTl1C2mrr_-wFBL-PUe0AWjMuqm6DyKu1GtOsBZ6MYeDMY3Og3TJrt6l0kCvDhIdNvLknAf-KsHtAryF4d6uo0qCT8RXVVI Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: f39d6bb03fa345c3932aa6a424d3bea8 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestManualDisk-1364678332 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f39d6bb03fa345c3932aa6a424d3bea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f39d6bb03fa345c3932aa6a424d3bea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f39d6bb03fa345c3932aa6a424d3bea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f39d6bb03fa345c3932aa6a424d3bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestManualDisk-1364678332 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: f39d6bb03fa345c3932aa6a424d3bea8 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestManualDisk-1364678332 Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestManualDisk-1364678332-project Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b4c97c21fd434d93a40ec91931e45dfe Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestManualDisk-1364678332-project Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c43911b4-f882-4619-b398-71c3d4f3569a'} Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:57.221717 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. Jul 19 19:47:57.233003 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:47:57.244372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Returning 404 to user: Instance c43911b4-f882-4619-b398-71c3d4f3569a could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:57.251861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72bd1a01-de3a-478e-a26b-c16a0291fda5 tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a" status: 404 len: 111 microversion: 2.1 time: 0.192958 Jul 19 19:47:57.259295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 975/1962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:57 2022] GET /compute/v2.1/servers/c43911b4-f882-4619-b398-71c3d4f3569a => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:57.374695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:57.388783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-170725c1-6be7-4e8e-83ba-a4ef273340cd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1471 microversion: 2.1 time: 0.995335 Jul 19 19:47:57.391966 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 988/1963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:56 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1471 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:47:57.397096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.404074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:57.425420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.427077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.428133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.435803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.616503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-505382908", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "729df022-220f-4501-a12f-95a3cd1dd40a"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:57.740881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] validate_networks() for [('729df022-220f-4501-a12f-95a3cd1dd40a', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:47:57.743146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:57.756895 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-053dc45a-ba7a-45e5-a6de-5ce82053cc9f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.363305 Jul 19 19:47:57.758330 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 989/1964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:57 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:47:57.764080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-eab93e9f-4150-40e9-b900-9666f77bb10f req-4d3860c9-9533-45d6-9c6b-220989c5472b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f25f8-06c5-4395-bea5-b44744b00302", "name": "network-vif-deleted", "tag": "da3d8421-babc-4ea7-aeb4-5036a28eed20"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:47:57.775310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-eab93e9f-4150-40e9-b900-9666f77bb10f req-4d3860c9-9533-45d6-9c6b-220989c5472b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:57.775908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-eab93e9f-4150-40e9-b900-9666f77bb10f req-4d3860c9-9533-45d6-9c6b-220989c5472b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:57.795490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-eab93e9f-4150-40e9-b900-9666f77bb10f req-4d3860c9-9533-45d6-9c6b-220989c5472b service nova] Creating event network-vif-deleted:da3d8421-babc-4ea7-aeb4-5036a28eed20 for instance 201f25f8-06c5-4395-bea5-b44744b00302 on n-h2-843834-3 Jul 19 19:47:57.805217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-eab93e9f-4150-40e9-b900-9666f77bb10f req-4d3860c9-9533-45d6-9c6b-220989c5472b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043912 Jul 19 19:47:57.806794 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 990/1965] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:47:57.816544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac503fc8-a484-4e81-990b-057fbe34365d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] Calling method '.version_select at 0x7f23ef315ca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:57.854490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac503fc8-a484-4e81-990b-057fbe34365d tempest-ServersTestManualDisk-1364678332 tempest-ServersTestManualDisk-1364678332-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156135663" status: 202 len: 0 microversion: 2.1 time: 0.044556 Jul 19 19:47:57.855990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 991/1966] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156135663 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:47:58.070634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.071743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] [instance: 201f25f8-06c5-4395-bea5-b44744b00302] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.087959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.089094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.090825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.091975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.134752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] HTTP exception thrown: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Request method failure captured: Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 HTTP/1.1 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wnQeibB77Kfy0OJlcAv8rYhaTn9CZ-3WSupXdFhtjPOhpCSlJwIUtO_ccVx2uRAZ0HH6GVZm-QrC0EC_-n5X0Ib-o8RCSyc1PHViSYZqzR0IBITQKf5TAFBFov-Q8pMuGZGGEGEXOU-NHDXWl76BUVMhrgdaNSjcKIu_20kySKF-B0 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e35827fb886b4c3980b7c7999163f0c1 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e35827fb886b4c3980b7c7999163f0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e35827fb886b4c3980b7c7999163f0c1 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-554704885 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListImageFiltersTestJSON-554704885-project Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8601b797c397479fbb09f2e3da659145 Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListImageFiltersTestJSON-554704885-project Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '201f25f8-06c5-4395-bea5-b44744b00302'} Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:47:58.143829 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. Jul 19 19:47:58.149832 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:47:58.152225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Returning 404 to user: Instance 201f25f8-06c5-4395-bea5-b44744b00302 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:47:58.153351 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b0ccda2-8015-4623-9a01-e0a3e8f455ed tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302" status: 404 len: 111 microversion: 2.1 time: 0.087380 Jul 19 19:47:58.157868 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 992/1967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/201f25f8-06c5-4395-bea5-b44744b00302 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:47:58.167679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d42b64b-23a6-4812-8ca7-98a53ca05b31 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f23ef3a34c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.816252 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d42b64b-23a6-4812-8ca7-98a53ca05b31 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4" status: 204 len: 0 microversion: 2.1 time: 0.656845 Jul 19 19:47:58.821226 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 993/1968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:58 2022] DELETE /compute/v2.1/images/6ef85451-2834-41dd-a7b4-170f9697fff4 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:47:58.835387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:58.836460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:58.851740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.852679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.853681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.854336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.862542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:47:58.863151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:47:58.863510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:47:58.863926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:47:58.864392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:47:58.880054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:58.884827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.885332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.886149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:58.886590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:58.966313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Getting quotas for project 1c4b47c0607141a1ad7273d10ad1583b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:47:58.981431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Getting quotas for user 93f0a443d7144ae09a3d816e1dd9ea3b and project 1c4b47c0607141a1ad7273d10ad1583b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:47:59.013224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:47:59.022129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:47:59.162142 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1ac0ad9-6eee-4f59-83b0-cc7a3085c6d5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895139 Jul 19 19:47:59.170320 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 976/1969] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:47:59.196704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.201145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.256470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.264705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.267810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.268307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.482116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:59.506136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:59.508723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:47:59.513982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3743d470-52cd-4963-9cde-cb52062db9bc tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2954 microversion: 2.42 time: 0.691043 Jul 19 19:47:59.530842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 994/1970] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:47:58 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2954 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:47:59.541182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:47:59.549024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:47:59.561367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.571802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.573452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:47:59.574103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:47:59.849671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:47:59.920340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:00.170589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.192728 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dcfa5584-35cf-45be-b4be-7b41ecbc5b09 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1477 microversion: 2.1 time: 1.019144 Jul 19 19:48:00.194860 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 977/1971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:59 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1477 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:00.211698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bbcf3ff-92d8-4eb5-b251-7d3345c1563e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f24008f1d30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.315316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.338013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b1992971-3ddb-4a6a-ac22-684eefc01b0e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.797566 Jul 19 19:48:00.340836 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 995/1972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:47:59 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:00.363127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.363801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.376135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.376830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.377832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.378452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.492333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:00.506533 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a250eee9-3531-42f2-a333-65740122b6b9 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1227 microversion: 2.1 time: 0.163187 Jul 19 19:48:00.507370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 996/1973] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1227 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:00.520458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9fe616e0-b3a8-40c6-8b50-044a167f9c3e req-e91cb9bf-08eb-48e8-978b-ac3b6ff05696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "name": "network-vif-unplugged", "status": "completed", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:00.566059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9fe616e0-b3a8-40c6-8b50-044a167f9c3e req-e91cb9bf-08eb-48e8-978b-ac3b6ff05696 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.567015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9fe616e0-b3a8-40c6-8b50-044a167f9c3e req-e91cb9bf-08eb-48e8-978b-ac3b6ff05696 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.592528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9fe616e0-b3a8-40c6-8b50-044a167f9c3e req-e91cb9bf-08eb-48e8-978b-ac3b6ff05696 service nova] Creating event network-vif-unplugged:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h2-843834-3 Jul 19 19:48:00.603214 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9fe616e0-b3a8-40c6-8b50-044a167f9c3e req-e91cb9bf-08eb-48e8-978b-ac3b6ff05696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094258 Jul 19 19:48:00.604720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 997/1974] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:00.644960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:00.646046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:00.671398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.672118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.673671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:00.674592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:00.775702 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bbcf3ff-92d8-4eb5-b251-7d3345c1563e tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b" status: 204 len: 0 microversion: 2.1 time: 0.578967 Jul 19 19:48:00.776600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 978/1975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] DELETE /compute/v2.1/images/4c5c6591-20ae-4312-9817-3617c264c44b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:00.786737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d12b57ab-226b-4c57-aa61-8be25a6ab208 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] Calling method '.version_select at 0x7f240090b310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:01.031708 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.410566 Jul 19 19:48:01.034297 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 998/1976] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:48:00 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c/os-interface => generated 1831 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:01.037501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:01.040168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a7c7c99-6117-4f06-ac88-e6b6000d6778 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004159 Jul 19 19:48:01.041004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 999/1977] 10.222.0.23 () {56 vars in 885 bytes} [Tue Jul 19 19:48:01 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 19:48:01.213215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:01.213891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:01.222719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.223207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.240042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.240415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.323325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d12b57ab-226b-4c57-aa61-8be25a6ab208 tempest-ListImageFiltersTestJSON-554704885 tempest-ListImageFiltersTestJSON-554704885-project] 10.222.0.23 "DELETE /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced" status: 204 len: 0 microversion: 2.1 time: 0.542287 Jul 19 19:48:01.324067 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 979/1978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:00 2022] DELETE /compute/v2.1/images/c8cca1a7-8eb4-4b8b-a9c5-86ea81208ced => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:01.360174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:01.360625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:01.376050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.378997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.381763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:01.382343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:01.456424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:02.562140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:02.576137 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b58be4b-953c-47c3-88bf-2589802ad566 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1477 microversion: 2.1 time: 1.364242 Jul 19 19:48:02.577037 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1000/1979] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:01 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1477 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:02.595503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:02.596387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:02.610562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.615669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.617157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.617778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.900215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:02.911849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e4e88fc-00e7-4c63-980a-19db1e6958f4 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1289 microversion: 2.1 time: 0.324553 Jul 19 19:48:02.913673 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1001/1980] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:02 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1289 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:02.927644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:02.928617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0c75893f-f2d6-4a63-b883-ea0cb3c5db94 req-f582db55-fcbe-4cd7-b9b6-b91e121b9fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-unplugged", "status": "completed", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:02.941192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0c75893f-f2d6-4a63-b883-ea0cb3c5db94 req-f582db55-fcbe-4cd7-b9b6-b91e121b9fb7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:02.946859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0c75893f-f2d6-4a63-b883-ea0cb3c5db94 req-f582db55-fcbe-4cd7-b9b6-b91e121b9fb7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:02.949411 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e876028-a052-4f81-bcac-68275733d495 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 1.593143 Jul 19 19:48:02.962873 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 980/1981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:01 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:02.997837 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0c75893f-f2d6-4a63-b883-ea0cb3c5db94 req-f582db55-fcbe-4cd7-b9b6-b91e121b9fb7 service nova] Creating event network-vif-unplugged:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:48:03.005712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0c75893f-f2d6-4a63-b883-ea0cb3c5db94 req-f582db55-fcbe-4cd7-b9b6-b91e121b9fb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088006 Jul 19 19:48:03.011293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1002/1982] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:03.596061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:03.596541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.616924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.618147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.621888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.622630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.719085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:03.720135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:03.728670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.729581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.731505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:03.732436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:03.809529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:04.040479 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cfcc159c-70d2-4d2b-a64e-69f0fa8a0d6d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 204 len: 0 microversion: 2.1 time: 0.323740 Jul 19 19:48:04.044888 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1003/1983] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:03 2022] DELETE /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:48:04.063868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:04.077502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:04.105752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.106272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:04.107275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:04.107733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.180356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.190145 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d1d0a04-240d-4ded-9f5d-31bb145a9a73 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1477 microversion: 2.1 time: 1.600497 Jul 19 19:48:05.194324 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 981/1984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:03 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1477 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:05.208024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.208955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:05.218080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.218535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.220009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.220452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.450225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.469670 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3b6d453-74f1-4ddb-a7d9-9652d3676d47 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 1.422918 Jul 19 19:48:05.474354 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1004/1985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:04 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:05.488165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:05.490328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:05.515257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.517329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.518350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:05.518991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:05.726837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:05.748912 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-311dd44e-4d95-4f9c-b145-9972eef946f0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.553124 Jul 19 19:48:05.750692 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 982/1986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.196546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b05c505-0964-46bf-8291-5c8fd572ea47 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] Calling method '.version_select at 0x7f23ef58f940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.264124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b05c505-0964-46bf-8291-5c8fd572ea47 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] 10.222.0.23 "GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29" status: 200 len: 784 microversion: 2.1 time: 0.510898 Jul 19 19:48:06.265282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 983/1987] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29 => generated 784 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:06.271773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.272763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.280072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.280715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.281698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.282583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.670588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:06.682340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e642ea81-4a8d-4fa0-804f-17d1ac14f18f tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1666 microversion: 2.1 time: 1.205806 Jul 19 19:48:06.684910 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1005/1988] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:05 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1666 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.703481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7f070ca0-a1da-407d-a191-001a1f8209a7 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] Calling method '.version_select at 0x7f23ef43a820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.854132 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7f070ca0-a1da-407d-a191-001a1f8209a7 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.166801 Jul 19 19:48:06.855067 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1006/1989] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/images => generated 445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:06.860807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.862369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.871114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.872573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.873662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.874348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.927551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:06.938607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9eb30148-7ae5-4057-9d56-70ad5855c333 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1477 microversion: 2.1 time: 0.671875 Jul 19 19:48:06.939629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 984/1990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1477 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:06.954378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:06.955515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:06.977940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.979525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:06.980637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:06.981283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.083257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:08.099035 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2569eea8-8bf0-49e0-9f55-287a19322230 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 1.241827 Jul 19 19:48:08.103811 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1007/1991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:08.110038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d25417f3-23aa-4e49-8db7-39dc6ca0b232 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] Calling method '.version_select at 0x7f23ef3a3b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.198689 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d25417f3-23aa-4e49-8db7-39dc6ca0b232 tempest-ListImagesTestJSON-1507809434 tempest-ListImagesTestJSON-1507809434-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.093352 Jul 19 19:48:08.200465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1008/1992] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:08.211213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-574567e9-a8fe-41bd-b519-131db4e02144 req-26d945ef-35f5-4dd4-94c8-e60a48875ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f7bd88-2411-4b0f-983d-5ac89232233c", "tag": "9e566964-3298-44a7-b47d-98307bc7f2c2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:08.216160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:08.229649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-574567e9-a8fe-41bd-b519-131db4e02144 req-26d945ef-35f5-4dd4-94c8-e60a48875ced service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.230742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-574567e9-a8fe-41bd-b519-131db4e02144 req-26d945ef-35f5-4dd4-94c8-e60a48875ced service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.247989 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-574567e9-a8fe-41bd-b519-131db4e02144 req-26d945ef-35f5-4dd4-94c8-e60a48875ced service nova] Creating event network-changed:9e566964-3298-44a7-b47d-98307bc7f2c2 for instance 74f7bd88-2411-4b0f-983d-5ac89232233c on n-h2-843834-3 Jul 19 19:48:08.257068 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-574567e9-a8fe-41bd-b519-131db4e02144 req-26d945ef-35f5-4dd4-94c8-e60a48875ced service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053324 Jul 19 19:48:08.257986 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1009/1993] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:08.264216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.265734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:08.275435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.276081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.277063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.277597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.292149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:08.301982 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e379b32-0c03-439b-adc7-cb34906ebb8a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 1.360415 Jul 19 19:48:08.316044 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 985/1994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:06 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:08.321314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-51f85477-f118-4df1-ae2c-127a6415f95f req-13e924d5-32db-4d6d-b546-cd9933322a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-plugged", "status": "completed", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:08.330457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-51f85477-f118-4df1-ae2c-127a6415f95f req-13e924d5-32db-4d6d-b546-cd9933322a15 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.332435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-51f85477-f118-4df1-ae2c-127a6415f95f req-13e924d5-32db-4d6d-b546-cd9933322a15 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.371533 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-51f85477-f118-4df1-ae2c-127a6415f95f req-13e924d5-32db-4d6d-b546-cd9933322a15 service nova] Creating event network-vif-plugged:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:48:08.377283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-51f85477-f118-4df1-ae2c-127a6415f95f req-13e924d5-32db-4d6d-b546-cd9933322a15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059747 Jul 19 19:48:08.377908 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 986/1995] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:08.391656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:08.397747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:08.408159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.409790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.411164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:08.422491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:08.946244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:08.987505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.001925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:09.005180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4dd4c8a-deff-42e7-92de-7a46bd28d7f8 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1666 microversion: 2.1 time: 0.744414 Jul 19 19:48:09.008366 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1010/1996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1666 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.070048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.100169 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2e82c93-627b-4e86-9dfe-d89228c72dc5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1477 microversion: 2.1 time: 0.712701 Jul 19 19:48:09.104708 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 987/1997] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:08 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1477 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.134841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.135455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:09.144026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.145038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.146527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.148361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.332915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:09.333707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:09.345622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.346881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.348007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:09.348562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:09.746611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.762317 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0adaebd-be1f-4967-82a4-5e806a3bbda6 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 0.637211 Jul 19 19:48:09.763366 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1011/1998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:09.825765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:09.836887 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb9fdfb4-28c2-48a8-bd21-4e2c3eb6e8e9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.508234 Jul 19 19:48:09.837587 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 988/1999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:09 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:10.026347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.027114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.039169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.040496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.045311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.046866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.127378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.128032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.138217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.141289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.142224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.145217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.475940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de77e9b9c0784bd2a8e886fa7f0ebab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a75cc5e534c1fb9e5f553509ccdba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:10.489007 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b552b6c8-0a1f-4be8-a3af-678936ba7bc3 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 200 len: 1598 microversion: 2.1 time: 0.467457 Jul 19 19:48:10.490518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1012/2000] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 1598 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:10.701235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:10.713005 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8533cd79-7eca-4ca0-8197-f0f22b3f77df tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1463 microversion: 2.1 time: 0.590199 Jul 19 19:48:10.715886 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 989/2001] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1463 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:10.730556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.731514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.739112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.739914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.740754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.741344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.780337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:10.781137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:10.788216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.788983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:10.790029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:10.790855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.718713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:11.731516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1bee5ca5-7fa8-4a67-9fb0-d88ec56ae67e tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 0.954579 Jul 19 19:48:11.735543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 990/2002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:11.781265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:11.794430 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2103256a-9981-4c6f-9a09-a95597af6701 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1463 microversion: 2.1 time: 1.064848 Jul 19 19:48:11.807640 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1013/2003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:10 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1463 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:11.813875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:11.814822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:11.823230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.824412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.825350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.826008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.981018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:11.982713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.983186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:11.983992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:11.984425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.039466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a080998c-f4ec-4ed1-b971-b831ba985056 tempest-AZV2TestJSON-1123860540 tempest-AZV2TestJSON-1123860540-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.302559 Jul 19 19:48:12.040367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 991/2004] 10.222.0.23 () {58 vars in 1163 bytes} [Tue Jul 19 19:48:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:48:12.045935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.050293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] [instance: 53ea3420-b4a6-4caf-b686-a048f762affb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.066041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.066722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.067754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.068691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.107995 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] HTTP exception thrown: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Request method failure captured: Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb HTTP/1.1 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wojTNOCd7lO5Z7t0b8y7uhH_-F1b5bPa9zZMid6tf8B2blDAR5co8mCAu6xVUjqthR9ihq89xXSwdk5RWSvJNTZvXmwecGMy_pGk7yvMRLQhHI1tN3Omsv5AlZhTAlJ9VAC3LBgcQs38VbR3fte5W6gDmw55TvNl_jC7h1oJ4WPBS8 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c72a75cc5e534c1fb9e5f553509ccdba Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestFqdnHostnames-1015356063 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c72a75cc5e534c1fb9e5f553509ccdba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c72a75cc5e534c1fb9e5f553509ccdba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c72a75cc5e534c1fb9e5f553509ccdba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c72a75cc5e534c1fb9e5f553509ccdba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestFqdnHostnames-1015356063 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c72a75cc5e534c1fb9e5f553509ccdba Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1015356063 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestFqdnHostnames-1015356063-project Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: de77e9b9c0784bd2a8e886fa7f0ebab1 Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestFqdnHostnames-1015356063-project Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '53ea3420-b4a6-4caf-b686-a048f762affb'} Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:12.110029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. Jul 19 19:48:12.113076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:12.115501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Returning 404 to user: Instance 53ea3420-b4a6-4caf-b686-a048f762affb could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:12.116559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1787b3ff-67a7-4253-92fa-277355321f83 tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb" status: 404 len: 111 microversion: 2.1 time: 0.075111 Jul 19 19:48:12.117285 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 992/2005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:12 2022] GET /compute/v2.1/servers/53ea3420-b4a6-4caf-b686-a048f762affb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:48:12.131572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-de26b364-2514-4b04-a539-6e2b481fd627 req-d536bf15-f4f9-4f15-bbe7-a4d6105ec6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea3420-b4a6-4caf-b686-a048f762affb", "name": "network-vif-deleted", "tag": "4bce019e-2c4f-4ab8-81c0-1311f81a65fe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:12.148560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de26b364-2514-4b04-a539-6e2b481fd627 req-d536bf15-f4f9-4f15-bbe7-a4d6105ec6f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.158434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de26b364-2514-4b04-a539-6e2b481fd627 req-d536bf15-f4f9-4f15-bbe7-a4d6105ec6f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.179938 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-de26b364-2514-4b04-a539-6e2b481fd627 req-d536bf15-f4f9-4f15-bbe7-a4d6105ec6f7 service nova] Creating event network-vif-deleted:4bce019e-2c4f-4ab8-81c0-1311f81a65fe for instance 53ea3420-b4a6-4caf-b686-a048f762affb on n-h1-843834-3 Jul 19 19:48:12.199049 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-de26b364-2514-4b04-a539-6e2b481fd627 req-d536bf15-f4f9-4f15-bbe7-a4d6105ec6f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077071 Jul 19 19:48:12.201952 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 993/2006] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:12.210799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:12.215759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.234863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.236367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.237332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.239163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.314702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:12.317533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:12.331332 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-682ad0a0-0824-4977-80de-210698568ed1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1714 microversion: 2.1 time: 0.521081 Jul 19 19:48:12.334170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1014/2007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:11 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1714 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:12.344858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-debbe605-fe1b-4a86-a2dd-c5535e64450d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] Calling method '.version_select at 0x7f23ef3b3dc0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.386366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-debbe605-fe1b-4a86-a2dd-c5535e64450d tempest-ServersTestFqdnHostnames-1015356063 tempest-ServersTestFqdnHostnames-1015356063-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236683161" status: 202 len: 0 microversion: 2.1 time: 0.050238 Jul 19 19:48:12.387261 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1015/2008] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236683161 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:48:12.460311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:12.474222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:12.476592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:12.478237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:12.478869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:12.601286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.615238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.615901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.617542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.623116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.664898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b43cfd1-12b1-4e9e-9709-1f354c67d088 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 1067 microversion: 2.1 time: 0.461449 Jul 19 19:48:12.666343 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 994/2009] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:12 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 1067 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 19:48:12.684054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.685223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.692572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.693037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.694136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.694573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.749659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:12.750281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:12.765911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.768539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:12.773694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:12.775362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.527305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.541203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ee2c7465-6005-429c-8a9f-dbed53330f27 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.858428 Jul 19 19:48:13.542411 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1016/2010] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:12 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:13.548948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:13.549836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:13.558893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.559749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.560857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.561836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.786076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.802612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56a8f1ac-e002-497a-8c01-4a39bd55f333 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 1.056765 Jul 19 19:48:13.803431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 995/2011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:12 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:13.908491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6f80e09e-1aa3-45d6-8236-2dad02070fca req-29e7b8da-7633-42b0-b827-0daeb6225ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f7bd88-2411-4b0f-983d-5ac89232233c", "name": "network-vif-plugged", "status": "completed", "tag": "9e566964-3298-44a7-b47d-98307bc7f2c2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:13.929587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6f80e09e-1aa3-45d6-8236-2dad02070fca req-29e7b8da-7633-42b0-b827-0daeb6225ff8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:13.933134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6f80e09e-1aa3-45d6-8236-2dad02070fca req-29e7b8da-7633-42b0-b827-0daeb6225ff8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:13.968034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6f80e09e-1aa3-45d6-8236-2dad02070fca req-29e7b8da-7633-42b0-b827-0daeb6225ff8 service nova] Creating event network-vif-plugged:9e566964-3298-44a7-b47d-98307bc7f2c2 for instance 74f7bd88-2411-4b0f-983d-5ac89232233c on n-h2-843834-3 Jul 19 19:48:13.983088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:13.991105 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6f80e09e-1aa3-45d6-8236-2dad02070fca req-29e7b8da-7633-42b0-b827-0daeb6225ff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083189 Jul 19 19:48:13.994434 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 996/2012] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:48:14.001407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4408b5e-82be-4865-aa74-2a353a58dcfa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1704 microversion: 2.1 time: 0.457557 Jul 19 19:48:14.002039 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1017/2013] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:13 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1704 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.021901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26574229-69ed-483b-ba7b-4e0e6a50c49e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '.version_select at 0x7f240090fdc0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.024977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26574229-69ed-483b-ba7b-4e0e6a50c49e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.025662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26574229-69ed-483b-ba7b-4e0e6a50c49e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.038396 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26574229-69ed-483b-ba7b-4e0e6a50c49e tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.020843 Jul 19 19:48:14.039487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 997/2014] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.051308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.052319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.061667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.063540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.064660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.065350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.454014 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-230995b2-94db-408f-b139-6b3b2f03e1ea tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1855 microversion: 2.1 time: 0.406530 Jul 19 19:48:14.458629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1018/2015] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1855 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.479084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.479900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.492321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.493258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.495438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.497462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.562228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.564831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.572202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.573073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.574558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.575256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.871720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:14.891171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19e52642-35e2-42a3-bb1b-d9fa3120f0f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.334682 Jul 19 19:48:14.891982 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac836709-f29a-4f36-b6cd-1b7c86216bd5 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1855 microversion: 2.1 time: 0.421128 Jul 19 19:48:14.892699 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1019/2016] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.893737 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 998/2017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1855 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:14.932767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.933392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:14.953808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.956652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.957771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:14.958562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:14.992002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:14.992889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:15.008846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.010599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.011912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.013802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.219938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lazy-loading 'services' on Instance uuid 7d531e1d-a523-45e5-a5b1-146c736db29a {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:48:15.290226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:15.299381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:15.307798 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6057ded-fb58-4d18-a98a-43d961c7565f tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1331 microversion: 2.1 time: 0.409491 Jul 19 19:48:15.308451 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 999/2018] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:14 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1331 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:15.391438 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81926698-75b7-4bbc-951a-0d47c11b0f34 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments/e3fceaed-17fa-4fd7-8711-73befc928235" status: 202 len: 0 microversion: 2.1 time: 0.403163 Jul 19 19:48:15.393926 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1020/2019] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 19:48:14 2022] DELETE /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments/e3fceaed-17fa-4fd7-8711-73befc928235 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:48:15.402598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:15.403680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:15.411887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.412310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.413096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.413733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.451470 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19fc7863-08dd-489c-9ac8-7ac7c7e43e5a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053393 Jul 19 19:48:15.455020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1000/2020] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:15 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:15.911229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:15.912802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:15.942349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.943216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:15.948125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:15.951324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.326127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.326742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:16.343510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.343975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.346134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.348700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.395969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:16.408987 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a91fd8d2-238d-4852-bc20-c4f0df526576 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.502041 Jul 19 19:48:16.411767 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1021/2021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:15 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:16.467931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:16.468933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:16.484583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.485251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.486201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:16.488264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:16.577909 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9a08b74-6001-4a5d-b993-ae1fb7eff8ce tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115105 Jul 19 19:48:16.578505 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1022/2022] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:16.722864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:16.735021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-454e54a5-c175-4dd2-b015-9329f12003e5 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1535 microversion: 2.1 time: 0.413578 Jul 19 19:48:16.735638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1001/2023] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:16 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1535 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:16.753161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-699efdca-b8f6-4702-9aa9-646f58833a35 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'create', calling method: .version_select at 0x7f23ef3f5c10>, body: {"pool": "d24ebc78-568f-42c3-b67a-19b61dbb42d6"} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:17.427522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:17.428129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:17.431248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:17.442728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.443808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.449441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.450115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.722518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:17.733606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c474f5c-fe66-4a9a-896a-b436399b4b3a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.309872 Jul 19 19:48:17.737539 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1002/2024] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:17 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:17.752690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:17.756219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:17.771709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.775106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.776127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:17.777983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:17.857740 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6812e53f-cbf0-4d14-b7e7-7a43c7558341 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118664 Jul 19 19:48:17.862178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1003/2025] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:17 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:18.757846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:18.759216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:18.778322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:18.783557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:18.786062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:18.788480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:19.857735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:19.892668 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-904c74b9-865c-4edf-a85e-92b39c4aa4fb tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.134158 Jul 19 19:48:19.894363 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1004/2026] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:18 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:19.908334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:19.913868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:19.925567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:19.926388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:19.932385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:19.933638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.021056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122270 Jul 19 19:48:20.032926 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1005/2027] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:19 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:20.034483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:20.036067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b8a81b6-4371-458c-9965-a6e5b83d358b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001977 Jul 19 19:48:20.043216 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1006/2028] 10.222.0.23 () {56 vars in 885 bytes} [Tue Jul 19 19:48:20 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 19:48:20.909642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:20.914353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:20.934318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.938471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:20.939569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:20.941236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:21.024196 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-699efdca-b8f6-4702-9aa9-646f58833a35 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.275794 Jul 19 19:48:21.031521 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1023/2029] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:48:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:21.037273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.194"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:21.038686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:21.081361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:21.082173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:21.083227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:21.083883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:21.128864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Acquired lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:21.989741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:22.064207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:22.088426 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd0ea9d9-1be9-4e18-9016-93c06eb770c7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.180448 Jul 19 19:48:22.100183 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1007/2030] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:20 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:22.129076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:22.130903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:22.153805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:22.154751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:22.156291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:22.158544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:22.210202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fea3d370-1a16-4a96-9a29-affd166b5f88 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097857 Jul 19 19:48:22.231863 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1008/2031] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:22 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:22.741065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-275591099", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:22.832908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:24.336435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:24.337006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:24.337523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:24.338064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:24.338551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:24.350008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.350937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:24.351931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.352569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:24.378039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:24.385530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:24.400944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:24.404333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:24.508818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07ff18bf-09a2-4272-b9cf-764b64f34bbd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.275331 Jul 19 19:48:24.514395 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1009/2032] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:24.524403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:24.525535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:24.535658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.536207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:24.537016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:24.537512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.154160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.161905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b5edbdaf-70cb-429a-815e-0f50030cfc37 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.649311 Jul 19 19:48:25.162506 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1010/2033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:24 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:25.175777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:25.176830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:25.192065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.192803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.194182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.199518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.248215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5527836f-8ca8-4d9a-b2be-02857d6e07ea tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076306 Jul 19 19:48:25.254207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1011/2034] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:48:25 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:48:25.262481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:25.266995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:25.282142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.286881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.288575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:25.289514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:25.482020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:25.490779 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7007e9b-a62d-4f91-b06d-17a1efecb173 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1218 microversion: 2.1 time: 0.235095 Jul 19 19:48:25.492677 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1012/2035] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:25 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:26.155987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Building network info cache for instance {{(pid=131230) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:26.183325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:26.183950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:26.200887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.201344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:26.202138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:26.202572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:27.964531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:27.984899 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-add4a57e-5b13-4758-998b-fa2398fe97dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.800075 Jul 19 19:48:27.988494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1013/2036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:26 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:28.004904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4da90138-33ba-4139-860a-445301edd488 req-01012d48-8eac-469d-9366-a6ff4d5aa892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f7bd88-2411-4b0f-983d-5ac89232233c", "tag": "9e566964-3298-44a7-b47d-98307bc7f2c2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:28.033281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4da90138-33ba-4139-860a-445301edd488 req-01012d48-8eac-469d-9366-a6ff4d5aa892 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.033751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4da90138-33ba-4139-860a-445301edd488 req-01012d48-8eac-469d-9366-a6ff4d5aa892 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.050513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4da90138-33ba-4139-860a-445301edd488 req-01012d48-8eac-469d-9366-a6ff4d5aa892 service nova] Creating event network-changed:9e566964-3298-44a7-b47d-98307bc7f2c2 for instance 74f7bd88-2411-4b0f-983d-5ac89232233c on n-h2-843834-3 Jul 19 19:48:28.068923 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4da90138-33ba-4139-860a-445301edd488 req-01012d48-8eac-469d-9366-a6ff4d5aa892 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078609 Jul 19 19:48:28.072167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1014/2037] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:28.081028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:28.083819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:28.100200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.105612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.116704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:28.117668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:28.444146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:28.474271 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a67477fb-5b5e-4627-abdd-f2b3533bcdaa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1272 microversion: 2.1 time: 0.400080 Jul 19 19:48:28.480052 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1015/2038] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:28 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:29.004227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:29.004920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:29.014486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:29.026038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:29.028130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:29.031253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.074228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:30.126091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b2ad4dd-0ae1-49de-9174-47cc083f3d1a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.127772 Jul 19 19:48:30.127824 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1016/2039] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:28 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:30.142024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:30.143288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:30.157678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.158459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.161489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:30.162526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:30.341744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Updating instance_info_cache with network_info: [{"id": "9e566964-3298-44a7-b47d-98307bc7f2c2", "address": "fa:16:3e:01:ac:93", "network": {"id": "729df022-220f-4501-a12f-95a3cd1dd40a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1057282774-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1c4b47c0607141a1ad7273d10ad1583b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9e566964-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:30.358847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Releasing lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:30.359817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49338912-eed4-4059-832d-6ec4a2dd0328 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 202 len: 0 microversion: 2.1 time: 9.326845 Jul 19 19:48:30.360762 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1024/2040] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:21 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 0 bytes in 9328 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:30.371265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-064b4749-deb5-4ace-a750-ee13a0adb1d7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'create', calling method: .version_select at 0x7f23ef3a3040>, body: {"pool": "d24ebc78-568f-42c3-b67a-19b61dbb42d6"} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:30.466145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:30.487393 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93ea1145-b528-4f29-bae3-a887a160671d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1272 microversion: 2.1 time: 0.353565 Jul 19 19:48:30.490385 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1017/2041] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:30 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:31.078640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:31.147968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:31.149220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:31.158141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.158928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.160570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.161250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.741065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:31.743531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:31.764808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2563b97-b4dd-4809-95c3-65332ef3fcc6 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.616046 Jul 19 19:48:31.766441 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1018/2042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:31 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:31.786121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:31.787028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:31.799544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.800170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:31.801112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:31.801723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:32.847152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:32.858965 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72c80793-7dc0-45d7-8b4d-ba2feee39dec tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 1.091172 Jul 19 19:48:32.860199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1019/2043] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:31 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:32.869164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:32.870456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:32.881922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:32.882863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:32.884693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:32.885302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:33.980146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:33.992772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f56cf47f-2511-4dc2-8ec0-9b00f7458b62 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.131140 Jul 19 19:48:34.003400 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1020/2044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:32 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:34.009904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:34.010789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:34.018397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:34.019115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:34.020302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:34.020913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:34.362810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:34.395634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:34.631588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:34.641098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be0d7f99-f9d9-48ab-818c-9c29cf663e05 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 0.635835 Jul 19 19:48:34.646035 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1021/2045] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:34 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:35.011013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:35.012068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:35.021648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.026743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:35.029694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:35.031132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:36.271897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:36.296060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-917a506d-813a-4d65-aada-e19275cf2a41 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 1.289828 Jul 19 19:48:36.299383 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1022/2046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:35 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:36.579798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: .version_select at 0x7f24008b49d0>, body: {"keypair": {"name": "tempest-keypair-70956320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSZDSimljeZM7OQzYNYwdjg4lH9p0qHlfVGDgLWkGFXptPp+D35BvSpvGnA2Wxau5Uyg0ZQgru8iih8VC77dDF27fteBwyBoIaKHCdGmPFCbD4nQhfZDcCjp8Isj40RzQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:36.616371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for project 6f78585de12146399a7ae194aae19e52. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:36.624691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for user 23a43026b121469baad2d3978d113bc2 and project 6f78585de12146399a7ae194aae19e52. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:36.657133 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [90f78fcf-a43f-49ee-87ce-987660c2225a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 19:48:37.671996 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [90f78fcf-a43f-49ee-87ce-987660c2225a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55574. Jul 19 19:48:37.701099 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b189d76f-3933-4e42-93b6-6c36086c4a07 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.399634 Jul 19 19:48:37.712842 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1023/2047] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:48:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1413 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:48:37.719956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:37.721378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:37.749902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.751346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:37.754387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:37.756363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.470241 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-064b4749-deb5-4ace-a750-ee13a0adb1d7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.105258 Jul 19 19:48:38.471542 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1025/2048] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:48:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:38.483025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-dbf46ed4-a535-49e8-997f-e796f65902e1 req-3e62cebb-b86c-4dd2-bba9-a1954a8a588b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c062a9-d5b3-4ce8-b1b4-e2db78787c3d", "tag": "542025ec-8f77-4e63-8b11-5fa14f60cf00"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:38.487467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:38.514225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dbf46ed4-a535-49e8-997f-e796f65902e1 req-3e62cebb-b86c-4dd2-bba9-a1954a8a588b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.514566 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6550eb05-b325-44be-8ac5-6fe67ba860aa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 0.800056 Jul 19 19:48:38.515209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dbf46ed4-a535-49e8-997f-e796f65902e1 req-3e62cebb-b86c-4dd2-bba9-a1954a8a588b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.521440 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1024/2049] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:37 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:38.547653 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-dbf46ed4-a535-49e8-997f-e796f65902e1 req-3e62cebb-b86c-4dd2-bba9-a1954a8a588b service nova] Creating event network-changed:542025ec-8f77-4e63-8b11-5fa14f60cf00 for instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d on n-h1-843834-3 Jul 19 19:48:38.555055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:38.558360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:38.562614 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-dbf46ed4-a535-49e8-997f-e796f65902e1 req-3e62cebb-b86c-4dd2-bba9-a1954a8a588b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089223 Jul 19 19:48:38.567112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1026/2050] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:38.574819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.580606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.581515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.581966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.583653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.214"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:38.593129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:38.617570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.618025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.618811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:38.625996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:38.776372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Acquired lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:39.089217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:39.102501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-586a24a1-d5cc-4c92-9e60-a3ca6a6fc6bf tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.579733 Jul 19 19:48:39.103302 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1025/2051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:38 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:39.285610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd7585bb-fbbf-48d0-9479-e262eabcc5f9 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Action: 'create', calling method: .version_select at 0x7f23ef020dc0>, body: {"keypair": {"name": "tempest-keypair-1932459534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/mljz1fEMp9ktIe7ak9Vkzy66oL6PWM59n8ka58jLG9PrriIiMMqCePhI/3onqJ9FmddcZMIBC5UPgQKDRev7aZFXkH+HgFDZ09UjtDw6Q4zZA+IEV70rnMFg7i4Vodg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:39.318984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bd7585bb-fbbf-48d0-9479-e262eabcc5f9 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for project d3247cd3d0104132aaa309e86515ccae. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:39.344387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bd7585bb-fbbf-48d0-9479-e262eabcc5f9 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for user 2d0e2529545b4a778238fe8bcc7a0fd0 and project d3247cd3d0104132aaa309e86515ccae. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:39.423182 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd7585bb-fbbf-48d0-9479-e262eabcc5f9 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313729 Jul 19 19:48:39.425265 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1026/2052] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:48:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:39.537678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:39.538749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:39.566164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.568124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.570188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:39.571789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:39.685920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6.", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:48:39.686627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Releasing lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:39.687241 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.687241 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Request method failure captured: Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action HTTP/1.1 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 46 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wpsbGGWQnFtX6BVtFJebRT6uQOuGKWAVa-MIEWcksZExJ2RBaUgQwzaRf_0hrpjzRTAgCzKeBOE9QoPEfXpDR6NpTdsDbbez1ZW0ebdriNhKZBoW-PD_Emc7PeTmoPSAe1BU_onXp990VUOnQ-wu5YKt9PVtFBeWtskbIEr0HmgCKw Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 93f0a443d7144ae09a3d816e1dd9ea3b Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: {"addFloatingIp": {"address": "172.25.8.214"}} Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '74f7bd88-2411-4b0f-983d-5ac89232233c', 'body': {'addFloatingIp': {'address': '172.25.8.214'}}} Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:48:39.691103 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] Jul 19 19:48:39.694574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:39.699015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Returning 400 to user: Cannot associate floating IP 172.25.8.214 (72c318da-c111-429a-87b6-0ed2b2a183a0) with port 9e566964-3298-44a7-b47d-98307bc7f2c2 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d24ebc78-568f-42c3-b67a-19b61dbb42d6. Jul 19 19:48:39.699015 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-e1f91c53-ded2-49f9-935a-5a665c0f81b8'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:39.699015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05d77a9e-03f5-412b-94ca-7a571e377ddb tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 400 len: 381 microversion: 2.1 time: 1.124461 Jul 19 19:48:39.699015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1027/2053] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:38 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 381 bytes in 1126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:48:39.715157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-350cab47-f73c-445f-846b-f1601d4be2c2 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '.version_select at 0x7f23ef4b5040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:40.198667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:40.212137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5846cae5-cccb-468e-9ef3-215f87c97dba tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 0.678944 Jul 19 19:48:40.227148 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1027/2054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:39 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:40.238455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:40.239569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:40.251793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:40.254076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:40.255259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:40.256069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:40.953682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:40.965817 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7654c9c-64de-46e5-9466-fae7f0c4e8ed tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1472 microversion: 2.1 time: 0.735489 Jul 19 19:48:40.972283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1028/2055] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:40 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1472 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:41.229193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:41.230761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:41.246209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.246672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:41.247609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:41.248055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.050978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:43.062006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2aa8813-fc8a-49f1-89c7-e88520603d8d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 1.836491 Jul 19 19:48:43.069740 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1029/2056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:41 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:43.086452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:43.088374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:43.108641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:43.109347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.110320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:43.113004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:43.708727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:43.718168 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aab01821-7df2-4903-91e1-11778fef8a4e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.647075 Jul 19 19:48:43.726581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1030/2057] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:43 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:43.967143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-330201134", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a3e1ad98-8d12-41c4-bd43-b869ae1f9f61"}], "security_groups": [{"name": "tempest-securitygroup--1655771232"}], "key_name": "tempest-keypair-1932459534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:44.340105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] validate_networks() for [('a3e1ad98-8d12-41c4-bd43-b869ae1f9f61', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:44.725209 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-350cab47-f73c-445f-846b-f1601d4be2c2 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/72c318da-c111-429a-87b6-0ed2b2a183a0" status: 202 len: 0 microversion: 2.1 time: 5.026790 Jul 19 19:48:44.726326 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1028/2058] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:39 2022] DELETE /compute/v2.1/os-floating-ips/72c318da-c111-429a-87b6-0ed2b2a183a0 => generated 0 bytes in 5028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:48:44.740554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a416a626-9439-4027-b03a-3d092e4f7f6f req-f3d53b56-3bb0-47a1-b5e3-5b46961a8383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-unplugged", "status": "completed", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:44.752717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a416a626-9439-4027-b03a-3d092e4f7f6f req-f3d53b56-3bb0-47a1-b5e3-5b46961a8383 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:44.761202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a416a626-9439-4027-b03a-3d092e4f7f6f req-f3d53b56-3bb0-47a1-b5e3-5b46961a8383 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:44.770670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:44.781831 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a416a626-9439-4027-b03a-3d092e4f7f6f req-f3d53b56-3bb0-47a1-b5e3-5b46961a8383 service nova] Creating event network-vif-unplugged:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:48:44.789550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a416a626-9439-4027-b03a-3d092e4f7f6f req-f3d53b56-3bb0-47a1-b5e3-5b46961a8383 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060846 Jul 19 19:48:44.790753 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1029/2059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:44.799163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:44.801820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:44.809710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:44.810482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:44.811630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:44.812490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:45.410189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:45.473612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d8296c2-784e-481a-9305-bcdc6f035d87 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 0.681420 Jul 19 19:48:45.474216 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1030/2060] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:44 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:45.498163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.194"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:45.979034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for project d3247cd3d0104132aaa309e86515ccae. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:45.994585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for user 2d0e2529545b4a778238fe8bcc7a0fd0 and project d3247cd3d0104132aaa309e86515ccae. Resources: dict_keys(['metadata_items']) {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:46.031697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:46.042272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:46.042806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:46.043324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:46.043747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:46.044167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:46.063558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:46.073777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.075296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.076012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.079126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.079295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.079918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.080980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.081588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.118528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for project d3247cd3d0104132aaa309e86515ccae. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:46.140887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Getting quotas for user 2d0e2529545b4a778238fe8bcc7a0fd0 and project d3247cd3d0104132aaa309e86515ccae. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:46.179453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:46.182246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:46.277994 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2bd0b20-f344-412d-bac0-65a29ec46c93 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.316856 Jul 19 19:48:46.282445 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1031/2061] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:43 2022] POST /compute/v2.1/servers => generated 407 bytes in 2322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:46.293408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:46.296066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:46.347904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.356933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.358372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:46.359340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:46.912187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Acquired lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:47.000952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:47.020098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e9fa4cb0-2661-4880-b60e-f3c3316cd852 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.734222 Jul 19 19:48:47.021564 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1032/2062] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:46 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:47.038564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-783393085", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c737f796-c7f6-4ab9-bce5-9b5f4c2b900a"}], "security_groups": [{"name": "tempest-securitygroup--261856680"}], "key_name": "tempest-keypair-70956320", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:47.470857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] validate_networks() for [('c737f796-c7f6-4ab9-bce5-9b5f4c2b900a', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:49.091555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:49.093469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:49.094586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:49.095210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:49.096118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:49.125816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.127708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.129238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.129695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.172637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Building network info cache for instance {{(pid=131230) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:48:49.178403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for project 6f78585de12146399a7ae194aae19e52. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:49.187895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for user 23a43026b121469baad2d3978d113bc2 and project 6f78585de12146399a7ae194aae19e52. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:49.227394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:49.229565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:49.351327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41a21ff0-434b-4d57-a50a-0e1730bd6e69 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.326203 Jul 19 19:48:49.352516 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1033/2063] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:48:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:48:49.370398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:49.371693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:49.388524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.389791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.390894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.392199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.568085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:49.581843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71b44ffc-5ab8-4d2a-92d7-2ddd6c43f643 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1327 microversion: 2.1 time: 0.225427 Jul 19 19:48:49.584339 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1034/2064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:49 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1327 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:49.589599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:49.590222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:49.636410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.642512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:49.643413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:49.643860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.227547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:50.235425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba30359a-64b0-4105-b6fc-75fe7c6ee4dd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1314 microversion: 2.1 time: 0.649661 Jul 19 19:48:50.236036 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1035/2065] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:49 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:50.259584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5baa7225-d62e-4027-a75d-52a4eebe1ba3 req-a7317c47-abd4-4aea-8c27-93cf219d8f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c062a9-d5b3-4ce8-b1b4-e2db78787c3d", "name": "network-vif-plugged", "status": "completed", "tag": "542025ec-8f77-4e63-8b11-5fa14f60cf00"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:50.289915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5baa7225-d62e-4027-a75d-52a4eebe1ba3 req-a7317c47-abd4-4aea-8c27-93cf219d8f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.290557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5baa7225-d62e-4027-a75d-52a4eebe1ba3 req-a7317c47-abd4-4aea-8c27-93cf219d8f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.304973 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5baa7225-d62e-4027-a75d-52a4eebe1ba3 req-a7317c47-abd4-4aea-8c27-93cf219d8f57 service nova] Creating event network-vif-plugged:542025ec-8f77-4e63-8b11-5fa14f60cf00 for instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d on n-h1-843834-3 Jul 19 19:48:50.311798 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5baa7225-d62e-4027-a75d-52a4eebe1ba3 req-a7317c47-abd4-4aea-8c27-93cf219d8f57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070556 Jul 19 19:48:50.313010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1036/2066] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:50.320502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1554361187", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "8ca63e29-a94c-4bdb-ac43-6323fbcb8ecc"}, {"uuid": "1c1213ff-7deb-4217-946b-9334016610c9"}, {"uuid": "8ca63e29-a94c-4bdb-ac43-6323fbcb8ecc"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:50.425158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] validate_networks() for [('8ca63e29-a94c-4bdb-ac43-6323fbcb8ecc', None, None, None, None, None), ('1c1213ff-7deb-4217-946b-9334016610c9', None, None, None, None, None), ('8ca63e29-a94c-4bdb-ac43-6323fbcb8ecc', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:50.445170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Updating instance_info_cache with network_info: [{"id": "9e566964-3298-44a7-b47d-98307bc7f2c2", "address": "fa:16:3e:01:ac:93", "network": {"id": "729df022-220f-4501-a12f-95a3cd1dd40a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1057282774-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1c4b47c0607141a1ad7273d10ad1583b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9e566964-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:48:50.461497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Releasing lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:50.464076 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-77f50951-0a18-466f-b2db-4f7902c54998 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 202 len: 0 microversion: 2.1 time: 4.972716 Jul 19 19:48:50.465617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1031/2067] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:45 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 0 bytes in 4976 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:48:50.476995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:50.479925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:50.498151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.499190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.501612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:50.504416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:50.921661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:50.932875 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71115123-eef0-4a59-93fb-ed72cbaf8d96 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.463512 Jul 19 19:48:50.947766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1032/2068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:50 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:50.974402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-268fce3c-d4d2-4dc3-9f3b-af43de0483bc req-36e80b63-6123-42bc-910e-07993578c521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f7bd88-2411-4b0f-983d-5ac89232233c", "tag": "9e566964-3298-44a7-b47d-98307bc7f2c2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:51.018608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-268fce3c-d4d2-4dc3-9f3b-af43de0483bc req-36e80b63-6123-42bc-910e-07993578c521 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.019084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-268fce3c-d4d2-4dc3-9f3b-af43de0483bc req-36e80b63-6123-42bc-910e-07993578c521 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.076604 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-268fce3c-d4d2-4dc3-9f3b-af43de0483bc req-36e80b63-6123-42bc-910e-07993578c521 service nova] Creating event network-changed:9e566964-3298-44a7-b47d-98307bc7f2c2 for instance 74f7bd88-2411-4b0f-983d-5ac89232233c on n-h2-843834-3 Jul 19 19:48:51.093077 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-268fce3c-d4d2-4dc3-9f3b-af43de0483bc req-36e80b63-6123-42bc-910e-07993578c521 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130211 Jul 19 19:48:51.094076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1033/2069] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:51.116095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:51.116892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:51.140009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.140407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.141195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:51.141630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:51.565635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:51.578020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:51.579569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:51.580710 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-017ceec9-f9c8-4c3d-ab12-a77a7a513c9e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1331 microversion: 2.20 time: 0.482493 Jul 19 19:48:51.596258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1034/2070] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:51 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1331 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:51.608103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a49e9a6e-c2c4-4ac5-a38f-ba62c720fe1c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '.version_select at 0x7f23ef3b3a60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:54.781627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:54.782631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:54.783481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:54.783929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:54.784292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:54.805127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.807319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.808234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.811273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.851590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Getting quotas for project d6cfe7341f7e409f9b88e9906bb81ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:54.863016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Getting quotas for user 47f24facdac944688d5dd210b0e525ca and project d6cfe7341f7e409f9b88e9906bb81ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:54.875583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:54.878273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:54.952247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf20ff82-d94b-4d61-bd4f-6dffa6b85910 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.637115 Jul 19 19:48:54.953489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1037/2071] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:54.959199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:54.960102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:54.972015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.973164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:54.974196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:54.974858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.135883 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a49e9a6e-c2c4-4ac5-a38f-ba62c720fe1c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/97369c15-cc41-4b0f-a160-02a181c0746a" status: 202 len: 0 microversion: 2.1 time: 3.538368 Jul 19 19:48:55.136498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1035/2072] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:48:51 2022] DELETE /compute/v2.1/os-floating-ips/97369c15-cc41-4b0f-a160-02a181c0746a => generated 0 bytes in 3540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:48:55.141510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:55.147685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:55.157240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.160040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.161055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.161710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.330253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:55.350832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f26b4bff-6ffc-49d8-8d42-48045f1bd22c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1395 microversion: 2.1 time: 0.395340 Jul 19 19:48:55.364407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1038/2073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:54 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1395 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:55.380835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3395979c-1f69-4ab7-ab8a-97e21b5d657d req-511c6d8f-6cf4-4ff5-a4dc-941fecb065b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4902e252-a7e8-4567-967d-cb20e9b87cf4", "tag": "e1246f38-d592-48c4-a3ef-82e7209ab654"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:55.415635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3395979c-1f69-4ab7-ab8a-97e21b5d657d req-511c6d8f-6cf4-4ff5-a4dc-941fecb065b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.417537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3395979c-1f69-4ab7-ab8a-97e21b5d657d req-511c6d8f-6cf4-4ff5-a4dc-941fecb065b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.453730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3395979c-1f69-4ab7-ab8a-97e21b5d657d req-511c6d8f-6cf4-4ff5-a4dc-941fecb065b2 service nova] Creating event network-changed:e1246f38-d592-48c4-a3ef-82e7209ab654 for instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 on n-h2-843834-3 Jul 19 19:48:55.467599 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3395979c-1f69-4ab7-ab8a-97e21b5d657d req-511c6d8f-6cf4-4ff5-a4dc-941fecb065b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098254 Jul 19 19:48:55.468439 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1039/2074] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:55.475903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:55.477170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:55.484334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.485001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.485619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.486060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.698950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:55.723889 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27bc692a-b0c3-48ae-9054-51218acf4d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1502 microversion: 2.1 time: 0.586276 Jul 19 19:48:55.727367 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1036/2075] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:55 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1502 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:55.735700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a0c5bccc-a69f-4966-b5a3-9aca6cfdf25b req-5e12644a-4ac2-40c5-b6b0-1f75eba747ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-plugged", "status": "completed", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:55.756469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a0c5bccc-a69f-4966-b5a3-9aca6cfdf25b req-5e12644a-4ac2-40c5-b6b0-1f75eba747ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.757637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a0c5bccc-a69f-4966-b5a3-9aca6cfdf25b req-5e12644a-4ac2-40c5-b6b0-1f75eba747ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.774838 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a0c5bccc-a69f-4966-b5a3-9aca6cfdf25b req-5e12644a-4ac2-40c5-b6b0-1f75eba747ce service nova] Creating event network-vif-plugged:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:48:55.782454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a0c5bccc-a69f-4966-b5a3-9aca6cfdf25b req-5e12644a-4ac2-40c5-b6b0-1f75eba747ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051960 Jul 19 19:48:55.784088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1037/2076] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:55.790402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:55.791601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:55.804293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.805046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:55.806103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:55.806973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.200632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.204762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:56.218851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d18ce6e7-c5f3-494f-88d4-461a62577730 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.748970 Jul 19 19:48:56.220366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1040/2077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:55 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:56.227725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.228555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.241388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.242033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.243690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.244785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.262769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.278254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.283088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.284300 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d7a63ad-cad8-41ca-b243-21481af4cf83 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 0.498856 Jul 19 19:48:56.284893 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1038/2078] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:55 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:56.300783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d7fb39f-23de-4dea-a057-8b0ad9499506 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d7fb39f-23de-4dea-a057-8b0ad9499506 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Request method failure captured: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action HTTP/1.1 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 34 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wpsbGGWQnFtX6BVtFJebRT6uQOuGKWAVa-MIEWcksZExJ2RBaUgQwzaRf_0hrpjzRTAgCzKeBOE9QoPEfXpDR6NpTdsDbbez1ZW0ebdriNhKZBoW-PD_Emc7PeTmoPSAe1BU_onXp990VUOnQ-wu5YKt9PVtFBeWtskbIEr0HmgCKw Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 93f0a443d7144ae09a3d816e1dd9ea3b Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: {"addFloatingIp": {"address": ""}} Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '74f7bd88-2411-4b0f-983d-5ac89232233c', 'body': {'addFloatingIp': {'address': ''}}} Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '' Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:48:56.304273 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d7fb39f-23de-4dea-a057-8b0ad9499506 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:56.310472 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d7fb39f-23de-4dea-a057-8b0ad9499506 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 400 len: 142 microversion: 2.1 time: 0.021425 Jul 19 19:48:56.313315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1039/2079] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:56 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:48:56.321854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.322571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.330107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.330773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.332098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.332953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.350236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:56.361571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:56.366956 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad853dc7-9935-4317-9126-0504566d6381 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1265 microversion: 2.1 time: 0.139700 Jul 19 19:48:56.369066 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1041/2080] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:56.380416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:56.381902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.400649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.404300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.405467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.407048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.475185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Acquired lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:48:56.526098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4bd5259-5cff-4147-8046-add5369ac2fe tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 204 len: 0 microversion: 2.1 time: 0.211291 Jul 19 19:48:56.527089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1040/2081] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:56 2022] DELETE /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:56.533663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.534798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.544154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.545000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.545980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.546712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.788775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Releasing lock "refresh_cache-74f7bd88-2411-4b0f-983d-5ac89232233c" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:48:56.789752 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] HTTP exception thrown: floating IP not found Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Request method failure captured: Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action HTTP/1.1 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 41 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpsbGGWQnFtX6BVtFJebRT6uQOuGKWAVa-MIEWcksZExJ2RBaUgQwzaRf_0hrpjzRTAgCzKeBOE9QoPEfXpDR6NpTdsDbbez1ZW0ebdriNhKZBoW-PD_Emc7PeTmoPSAe1BU_onXp990VUOnQ-wu5YKt9PVtFBeWtskbIEr0HmgCKw Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 93f0a443d7144ae09a3d816e1dd9ea3b Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: exception: floating IP not found Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '74f7bd88-2411-4b0f-983d-5ac89232233c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 19 19:48:56.792426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 19 19:48:56.796550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:48:56.808290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Returning 404 to user: floating IP not found {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:56.809466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b29ed331-893c-4983-beec-6b098c6cd65c tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 404 len: 67 microversion: 2.1 time: 0.439283 Jul 19 19:48:56.810412 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1042/2082] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:56 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 67 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:56.817664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:56.818481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:56.825888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.826545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:56.827669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:56.828255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.054662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.064921 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f80b4b9-63a9-42b4-8508-16ee7cd7a206 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1395 microversion: 2.1 time: 0.536231 Jul 19 19:48:57.075828 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1041/2083] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1395 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.081531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33afc753-ad59-4d24-8a28-d35cba75aaf7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:57.162488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-33afc753-ad59-4d24-8a28-d35cba75aaf7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33afc753-ad59-4d24-8a28-d35cba75aaf7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Request method failure captured: Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action HTTP/1.1 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 44 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wpsbGGWQnFtX6BVtFJebRT6uQOuGKWAVa-MIEWcksZExJ2RBaUgQwzaRf_0hrpjzRTAgCzKeBOE9QoPEfXpDR6NpTdsDbbez1ZW0ebdriNhKZBoW-PD_Emc7PeTmoPSAe1BU_onXp990VUOnQ-wu5YKt9PVtFBeWtskbIEr0HmgCKw Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 93f0a443d7144ae09a3d816e1dd9ea3b Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: exception: Floating IP not found for address 0.0.0.0. Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '74f7bd88-2411-4b0f-983d-5ac89232233c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 19 19:48:57.164548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33afc753-ad59-4d24-8a28-d35cba75aaf7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-33afc753-ad59-4d24-8a28-d35cba75aaf7 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action" status: 404 len: 88 microversion: 2.1 time: 0.088364 Jul 19 19:48:57.169520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1042/2084] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:48:57 2022] POST /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c/action => generated 88 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:48:57.177841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.178416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.185672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.186129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.187202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.187858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.223384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:48:57.241203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.250029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-99e56868-79ba-4547-a48f-92e5f7fc27d9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1508 microversion: 2.1 time: 0.438152 Jul 19 19:48:57.250629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1043/2085] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:56 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1508 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.258669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.260548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.284044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.284800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.285991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.286618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.352724 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09f6aaee-09de-4f63-af4a-848ca4dc1d5a tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 204 len: 0 microversion: 2.1 time: 0.179268 Jul 19 19:48:57.353297 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1043/2086] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:48:57 2022] DELETE /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:48:57.360417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.360912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.367662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.368705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.370088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.370786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.633876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.650006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c71d5c0-3078-48bb-82e4-b7fe5f7b894a tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.397479 Jul 19 19:48:57.651171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1044/2087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.658397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.659346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.668362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.668890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.669981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.670488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.708448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.718197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.720354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.721623 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-db644364-3df5-4275-bb02-5949f61046fb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 0.366670 Jul 19 19:48:57.722687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1044/2088] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:48:57.727377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:57.728132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:57.734642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.735196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.736444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:57.737467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:57.921154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:57.928992 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-08826bbd-7144-4500-a9ed-61033af5ed55 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1541 microversion: 2.1 time: 0.275937 Jul 19 19:48:57.929567 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1045/2089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1541 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:57.934058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-86738996", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fb087bda-9d04-4001-99de-3fb667d5f62c"}], "block_device_mapping_v2": [{"uuid": "7f2c8781-2afa-40e5-a1ee-ead3ddbafb81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:58.003303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:58.012456 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4fad874b-1b2f-4d69-a471-927d9945cd5c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1313 microversion: 2.1 time: 0.288374 Jul 19 19:48:58.013189 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1045/2090] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:57 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:58.015498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] validate_networks() for [('fb087bda-9d04-4001-99de-3fb667d5f62c', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:48:58.019768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-796debee-549d-4f90-84d5-1aa76ce764f4 req-267fb359-3a57-44c9-9dfe-a0ddfff3c869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4902e252-a7e8-4567-967d-cb20e9b87cf4", "name": "network-vif-plugged", "status": "completed", "tag": "e1246f38-d592-48c4-a3ef-82e7209ab654"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:58.030068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-796debee-549d-4f90-84d5-1aa76ce764f4 req-267fb359-3a57-44c9-9dfe-a0ddfff3c869 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.030511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-796debee-549d-4f90-84d5-1aa76ce764f4 req-267fb359-3a57-44c9-9dfe-a0ddfff3c869 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.043948 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-796debee-549d-4f90-84d5-1aa76ce764f4 req-267fb359-3a57-44c9-9dfe-a0ddfff3c869 service nova] Creating event network-vif-plugged:e1246f38-d592-48c4-a3ef-82e7209ab654 for instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 on n-h2-843834-3 Jul 19 19:48:58.049999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-796debee-549d-4f90-84d5-1aa76ce764f4 req-267fb359-3a57-44c9-9dfe-a0ddfff3c869 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Jul 19 19:48:58.050618 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1046/2091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:58.055693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-418fa892-281e-401f-ae81-e1a4a533c3fb req-bf98960d-eb88-40c8-a0c1-5c2e1b7beb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:48:58.064774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-418fa892-281e-401f-ae81-e1a4a533c3fb req-bf98960d-eb88-40c8-a0c1-5c2e1b7beb00 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.065233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-418fa892-281e-401f-ae81-e1a4a533c3fb req-bf98960d-eb88-40c8-a0c1-5c2e1b7beb00 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.069836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:48:58.079180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-418fa892-281e-401f-ae81-e1a4a533c3fb req-bf98960d-eb88-40c8-a0c1-5c2e1b7beb00 service nova] Creating event network-changed:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h1-843834-3 Jul 19 19:48:58.084819 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-418fa892-281e-401f-ae81-e1a4a533c3fb req-bf98960d-eb88-40c8-a0c1-5c2e1b7beb00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 Jul 19 19:48:58.085426 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1047/2092] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:48:58.091301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.091898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.100797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.101241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.102013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.102440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.335900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:58.344084 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2faf5d11-97ae-49cf-b3a3-3fe6c316b29d tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1395 microversion: 2.1 time: 0.257364 Jul 19 19:48:58.344655 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1048/2093] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1395 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:58.349277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.349882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.356074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.356665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.357282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.357720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.614271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:48:58.614861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:48:58.615269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:48:58.615705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:48:58.616142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:48:58.620660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:58.629023 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-642cb100-5494-460e-bc16-7d91828522f7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1508 microversion: 2.1 time: 0.283202 Jul 19 19:48:58.630048 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1049/2094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:48:58.631960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.632656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.634282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.634946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.658124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:48:58.666311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Getting quotas for user a15f9dbf22624cb49d4d817fed35e3b5 and project ee5ff129d1794456ad8c9c6ab8a1e22d. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:48:58.671675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:58.673647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:58.685617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.686484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.687529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:58.688350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:58.913432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:48:58.916802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f2c8781-2afa-40e5-a1ee-ead3ddbafb81',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:48:59.012753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:48:59.025319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-665e7d5f-5e8d-429a-9829-5a069a789176 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1478 microversion: 2.1 time: 0.361046 Jul 19 19:48:59.027060 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1050/2095] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:58 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1478 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:48:59.036114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:59.046469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:59.056984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.063446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.066596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.066818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.162723 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc1d6d13-5c20-41eb-91f3-107f3d115cec tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232033 Jul 19 19:48:59.169283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1046/2096] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:48:59.176938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:48:59.177729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:48:59.187995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.188448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:48:59.189241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:48:59.189730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.081235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.092389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f0a443d7144ae09a3d816e1dd9ea3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4b47c0607141a1ad7273d10ad1583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.098077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.101880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.104785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1312b9b1-a30c-4d78-929f-ed940633aa73 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 1.076151 Jul 19 19:49:00.106086 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1051/2097] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:48:59 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:00.113628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.115482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.124331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.125157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.126239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.126434 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1a68fd09-87c6-4e67-8ce0-18e8d6697544 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 200 len: 1541 microversion: 2.1 time: 0.956370 Jul 19 19:49:00.127073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.127660 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1047/2098] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:48:59 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 1541 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.132517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.133822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.150955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.151896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.152892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.155544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.294586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.303745 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2eab25d-6871-40cf-85f8-0aeeab5f7c4b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1149 microversion: 2.1 time: 0.174927 Jul 19 19:49:00.304892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1048/2099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1149 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.309899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.310808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.317838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.318369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.319569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.320648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.641599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.689187 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb587b31-f91f-4e1c-89bd-997d92740af1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.575171 Jul 19 19:49:00.690588 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1052/2100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.707128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.707982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.718480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.719065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.719937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.723626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.887468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:00.898663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d7ec58df-979a-445b-90f4-da693aa62e50 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1575 microversion: 2.1 time: 0.592437 Jul 19 19:49:00.902359 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1049/2101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1575 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:00.917359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:00.918525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:00.933324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.934139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:00.935351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:00.936478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.049910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:01.097532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12489d50-4670-44e8-bcb7-fa2f0e621a95 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 200 len: 1466 microversion: 2.1 time: 0.402134 Jul 19 19:49:01.102288 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1053/2102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 1466 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:01.126559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.127155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.129284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:01.149833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.150295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.151132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.151573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.394801 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81f905c1-e239-41a3-9340-a6a4d9775de2 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291051 Jul 19 19:49:01.395479 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1054/2103] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:01.400444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-234f0c4f-18b3-4d31-a620-5e9de33ec771 req-ceef47f8-5d08-405c-b55d-e99becc8b7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "tag": "fa07bd2d-872d-46e8-bb78-8d9e17feaae7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:01.415052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-234f0c4f-18b3-4d31-a620-5e9de33ec771 req-ceef47f8-5d08-405c-b55d-e99becc8b7a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.415750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-234f0c4f-18b3-4d31-a620-5e9de33ec771 req-ceef47f8-5d08-405c-b55d-e99becc8b7a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.433650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-234f0c4f-18b3-4d31-a620-5e9de33ec771 req-ceef47f8-5d08-405c-b55d-e99becc8b7a8 service nova] Creating event network-changed:fa07bd2d-872d-46e8-bb78-8d9e17feaae7 for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:01.439426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-234f0c4f-18b3-4d31-a620-5e9de33ec771 req-ceef47f8-5d08-405c-b55d-e99becc8b7a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042458 Jul 19 19:49:01.440509 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1055/2104] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:01.446212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.448172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.469894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.470738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.471734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.472956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.765246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:01.773397 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7eb7bee0-15bd-4a69-93e9-f7e177fe36dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1463 microversion: 2.1 time: 0.868805 Jul 19 19:49:01.779900 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1050/2105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:00 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1463 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:01.784948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.793818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] [instance: 74f7bd88-2411-4b0f-983d-5ac89232233c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.811323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.811811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.813854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.814372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.852903 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] HTTP exception thrown: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Request method failure captured: Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c HTTP/1.1 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wpsbGGWQnFtX6BVtFJebRT6uQOuGKWAVa-MIEWcksZExJ2RBaUgQwzaRf_0hrpjzRTAgCzKeBOE9QoPEfXpDR6NpTdsDbbez1ZW0ebdriNhKZBoW-PD_Emc7PeTmoPSAe1BU_onXp990VUOnQ-wu5YKt9PVtFBeWtskbIEr0HmgCKw Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4b47c0607141a1ad7273d10ad1583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1c4b47c0607141a1ad7273d10ad1583b Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 93f0a443d7144ae09a3d816e1dd9ea3b Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '74f7bd88-2411-4b0f-983d-5ac89232233c'} Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. Jul 19 19:49:01.854848 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] Returning 404 to user: Instance 74f7bd88-2411-4b0f-983d-5ac89232233c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae9e9f53-3fc0-4dcc-b5fe-87b37ea6c85d tempest-FloatingIPsAssociationNegativeTestJSON-1973047211 tempest-FloatingIPsAssociationNegativeTestJSON-1973047211-project] 10.222.0.23 "GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c" status: 404 len: 111 microversion: 2.1 time: 0.075470 Jul 19 19:49:01.861491 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1051/2106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/74f7bd88-2411-4b0f-983d-5ac89232233c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:01.866218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-287e489e-0c89-4b5b-9ddd-2098920d0e24 req-9cbc32ba-f8a3-44b0-bbb1-260401853c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f7bd88-2411-4b0f-983d-5ac89232233c", "name": "network-vif-deleted", "tag": "9e566964-3298-44a7-b47d-98307bc7f2c2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:01.876875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:01.879362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-287e489e-0c89-4b5b-9ddd-2098920d0e24 req-9cbc32ba-f8a3-44b0-bbb1-260401853c11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.880153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-287e489e-0c89-4b5b-9ddd-2098920d0e24 req-9cbc32ba-f8a3-44b0-bbb1-260401853c11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.898528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-287e489e-0c89-4b5b-9ddd-2098920d0e24 req-9cbc32ba-f8a3-44b0-bbb1-260401853c11 service nova] Creating event network-vif-deleted:9e566964-3298-44a7-b47d-98307bc7f2c2 for instance 74f7bd88-2411-4b0f-983d-5ac89232233c on n-h2-843834-3 Jul 19 19:49:01.904556 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-287e489e-0c89-4b5b-9ddd-2098920d0e24 req-9cbc32ba-f8a3-44b0-bbb1-260401853c11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044520 Jul 19 19:49:01.905606 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1052/2107] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:01.913075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:01.913909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:01.922003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.922547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:01.923461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:01.924542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.441750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:02.457372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:02.460738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:02.461970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24c7380b-28ca-4126-bc7a-7f7d624ee3f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 1.020350 Jul 19 19:49:02.472587 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1056/2108] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:02.477829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:02.478457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:02.486377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.486862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.487694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.490243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.794836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:02.809269 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a79c5791-b44d-4c6c-8a4f-aa915c996dc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1209 microversion: 2.1 time: 0.901216 Jul 19 19:49:02.810170 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1053/2109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:01 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1209 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:02.821867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:02.823182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:02.851261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.852094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.853138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.854549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.956264 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b193a4f9-8720-496a-b033-32658fab29d7 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 0 microversion: 2.1 time: 0.144588 Jul 19 19:49:02.959689 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1054/2110] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:02 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:02.971358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:02.973058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:02.981026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.981875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:02.983372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:02.983988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.001588 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d HTTP/1.1 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '72c062a9-d5b3-4ce8-b1b4-e2db78787c3d'} Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:03.005500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:03.010207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4881c95-6463-4dc4-b031-bc519c64d58f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 404 len: 111 microversion: 2.1 time: 0.046624 Jul 19 19:49:03.018583 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1055/2111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:02 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:03.025314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:03.025939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:03.034045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.034526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.035437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.035870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.077994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:03.078700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:03.079387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lazy-loading 'fault' on Instance uuid f06951cb-806f-4404-aecb-382385611932 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:03.741074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:03.760203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3c36d12-5db0-460e-aa4b-757a3d5009a7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 1.285954 Jul 19 19:49:03.760812 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1057/2112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:02 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:03.775098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1931186622", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:03.890249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:03.995818 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2593e21-65d2-4119-b811-c42713745793 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1597 microversion: 2.1 time: 0.975981 Jul 19 19:49:03.999272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1056/2113] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:03 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1597 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:04.015425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-04b10be8-447c-47f7-a84f-b9b92457a43c req-ccb65af6-9e3e-427f-a3d2-a2c1b44e5546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "tag": "a6f1fe5b-d85e-4e07-8933-76a8bdf400af"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:04.038958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-04b10be8-447c-47f7-a84f-b9b92457a43c req-ccb65af6-9e3e-427f-a3d2-a2c1b44e5546 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.039412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-04b10be8-447c-47f7-a84f-b9b92457a43c req-ccb65af6-9e3e-427f-a3d2-a2c1b44e5546 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:04.057161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-04b10be8-447c-47f7-a84f-b9b92457a43c req-ccb65af6-9e3e-427f-a3d2-a2c1b44e5546 service nova] Creating event network-changed:a6f1fe5b-d85e-4e07-8933-76a8bdf400af for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:04.075692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-04b10be8-447c-47f7-a84f-b9b92457a43c req-ccb65af6-9e3e-427f-a3d2-a2c1b44e5546 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074335 Jul 19 19:49:04.076310 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1057/2114] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:04.082359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:04.082885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:04.100363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.100817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:04.101602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:04.102040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:05.438877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:05.450123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:05.452059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:05.453224 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e655cc1-f43f-4681-9575-79ed69771fc7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 1.375150 Jul 19 19:49:05.453939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1058/2115] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:49:04 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:05.459889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:05.460847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:05.467752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:05.468423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:05.469208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:05.469645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:05.474551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:06.398673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:06.411879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-feb65b7b-e92e-4cfd-9439-b4c199c526c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1209 microversion: 2.1 time: 0.954608 Jul 19 19:49:06.415259 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1059/2116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:05 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1209 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:06.421194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:06.422385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:06.429188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.429778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.430802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.431599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.511294 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a72e7cf2-4e1e-4d79-abe8-94a3773e8080 tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action" status: 202 len: 0 microversion: 2.1 time: 0.094065 Jul 19 19:49:06.515904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1060/2117] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:06 2022] POST /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:06.516982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:06.517635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:06.518459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:06.519364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:06.520028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:06.521859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-55c8a4b2-c0a5-4bd5-bde6-1b84efd9ca42 req-c7fd969e-80d3-4faf-8285-731e22d34a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c062a9-d5b3-4ce8-b1b4-e2db78787c3d", "name": "network-vif-deleted", "tag": "542025ec-8f77-4e63-8b11-5fa14f60cf00"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:06.531020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55c8a4b2-c0a5-4bd5-bde6-1b84efd9ca42 req-c7fd969e-80d3-4faf-8285-731e22d34a6f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.531456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55c8a4b2-c0a5-4bd5-bde6-1b84efd9ca42 req-c7fd969e-80d3-4faf-8285-731e22d34a6f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.536031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.537962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.539228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.539973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.545031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-55c8a4b2-c0a5-4bd5-bde6-1b84efd9ca42 req-c7fd969e-80d3-4faf-8285-731e22d34a6f service nova] Creating event network-vif-deleted:542025ec-8f77-4e63-8b11-5fa14f60cf00 for instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d on n-h1-843834-3 Jul 19 19:49:06.550785 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-55c8a4b2-c0a5-4bd5-bde6-1b84efd9ca42 req-c7fd969e-80d3-4faf-8285-731e22d34a6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033091 Jul 19 19:49:06.551766 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1061/2118] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:06.557216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:06.557978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:06.565863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.565863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.566211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.566515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.570948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:06.579925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:06.596514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:06.599699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:06.659247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85f11438-ba48-417b-8a0e-91a86f232a4b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886682 Jul 19 19:49:06.664760 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1058/2119] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:06.665830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}, {"name": "network-changed", "server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "tag": "6bab8edc-2a50-4431-a76f-7a6347cb4b4c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:06.675971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.676809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.694600 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] Creating event network-changed:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h1-843834-3 Jul 19 19:49:06.695198 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] Creating event network-changed:6bab8edc-2a50-4431-a76f-7a6347cb4b4c for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:06.705766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-89a07f10-9c25-4ef4-8717-713f494901f0 req-a44c80e0-3158-4e90-a7cd-7de4bd5de616 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044246 Jul 19 19:49:06.706905 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1059/2120] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:06.714086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1d7b25d1-b4ed-483c-b601-5a3ba2a64208 req-7b006539-a123-4499-bbdf-c05d630a1078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "name": "network-vif-plugged", "status": "completed", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:06.723773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1d7b25d1-b4ed-483c-b601-5a3ba2a64208 req-7b006539-a123-4499-bbdf-c05d630a1078 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.724232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1d7b25d1-b4ed-483c-b601-5a3ba2a64208 req-7b006539-a123-4499-bbdf-c05d630a1078 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.738198 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1d7b25d1-b4ed-483c-b601-5a3ba2a64208 req-7b006539-a123-4499-bbdf-c05d630a1078 service nova] Creating event network-vif-plugged:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h1-843834-3 Jul 19 19:49:06.744511 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1d7b25d1-b4ed-483c-b601-5a3ba2a64208 req-7b006539-a123-4499-bbdf-c05d630a1078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035239 Jul 19 19:49:06.745971 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1060/2121] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:06.752853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:06.753845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:06.761968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.762587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:06.763620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:06.765131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.188261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:07.204341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da6cd7f6-6535-473e-b5eb-44565a80cfe1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.650061 Jul 19 19:49:07.205323 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1062/2122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:06 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:07.211037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:07.211910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:07.219332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.219966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.220974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.221590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.330932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:07.341401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:07.343377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:07.345073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27a18b94-1afb-45d7-9789-bc450bfb9187 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 0.597686 Jul 19 19:49:07.345884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1061/2123] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:49:06 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:07.352099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:07.353113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:07.361801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.362434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.363450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.364384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.564955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:07.575854 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ffdb2ae0-f0b5-4df4-b35b-625a18ec3d69 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1211 microversion: 2.1 time: 0.228572 Jul 19 19:49:07.576983 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1062/2124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:07 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1211 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:07.592873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:07.593692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:07.600708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.601378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.602306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.602888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.834550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b7c5c3f-dc0c-4118-b953-9e64b1c5e82e tempest-ServersAdminTestJSON-410396684 tempest-ServersAdminTestJSON-410396684-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1614 microversion: 2.1 time: 0.627844 Jul 19 19:49:07.847403 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1063/2125] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:07 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1614 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:07.852974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:07.853788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:07.860814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.861473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:07.862424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:07.863278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.054295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:08.065583 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-747bf025-dc55-42c1-aafb-c9f1bbd222aa tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.478446 Jul 19 19:49:08.072004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1063/2126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:07 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:08.096851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:08.097789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:08.107749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.109157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.110184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.110810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.156464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:08.257043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-63cccb1b-64d5-4cb4-96ef-659a73f2869b tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 204 len: 0 microversion: 2.1 time: 0.182288 Jul 19 19:49:08.259003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1064/2127] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:08 2022] DELETE /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:08.264972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:08.266261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:08.273204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.273997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.275051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.275666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.645190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:08.681537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:08.697943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:08.723299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1c6a08c3-4b45-4f2f-b22c-f4039c1f409b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1575 microversion: 2.1 time: 0.873907 Jul 19 19:49:08.725611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1064/2128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:07 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1575 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:08.754846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:08.755886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:08.777671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.778855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:08.780586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:08.781768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.143192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.148935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:09.159364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcec7ecf-35c1-41e6-98ef-d4882fd31557 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.898380 Jul 19 19:49:09.161570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1065/2129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:08 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:09.175019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:09.176090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:09.186117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.187022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.188191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.190310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.329310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.338253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3a1b0c53-9853-4a80-be22-751a9a4fa9b5 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1468 microversion: 2.1 time: 0.610867 Jul 19 19:49:09.344276 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1065/2130] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:08 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1468 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:09.345540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d9aee495-db8e-4ab5-a1c1-aa6c966d30a4 req-384acc7c-19b6-426b-b983-dbcc437dff87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4902e252-a7e8-4567-967d-cb20e9b87cf4", "tag": "e1246f38-d592-48c4-a3ef-82e7209ab654"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:09.363487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d9aee495-db8e-4ab5-a1c1-aa6c966d30a4 req-384acc7c-19b6-426b-b983-dbcc437dff87 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.364231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d9aee495-db8e-4ab5-a1c1-aa6c966d30a4 req-384acc7c-19b6-426b-b983-dbcc437dff87 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.376868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d9aee495-db8e-4ab5-a1c1-aa6c966d30a4 req-384acc7c-19b6-426b-b983-dbcc437dff87 service nova] Creating event network-changed:e1246f38-d592-48c4-a3ef-82e7209ab654 for instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 on n-h2-843834-3 Jul 19 19:49:09.383096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d9aee495-db8e-4ab5-a1c1-aa6c966d30a4 req-384acc7c-19b6-426b-b983-dbcc437dff87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042740 Jul 19 19:49:09.383898 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1066/2131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:09.396026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:09.396994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:09.411497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.412038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.412840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.413279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.622772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.634295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.636438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.638465 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1892904b-62d8-43e7-a098-3896e4641922 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1404 microversion: 2.20 time: 0.475771 Jul 19 19:49:09.639414 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1066/2132] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:49:09 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:09.647190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:09.647925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:09.662748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.664428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.665458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:09.666175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:09.990159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:09.998454 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e212212f-3f6f-478e-b4da-5ebbea93e191 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1315 microversion: 2.1 time: 0.612934 Jul 19 19:49:10.010767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1067/2133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:09 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:10.017143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-64ef3431-51bd-45b6-8f17-a0f3c7a4eeaf req-b7a76bb7-3460-4b81-ab93-2620cf5ae0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ad89d6-fc11-41ff-a00b-f8b53b5d538d", "tag": "5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:10.027225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-64ef3431-51bd-45b6-8f17-a0f3c7a4eeaf req-b7a76bb7-3460-4b81-ab93-2620cf5ae0e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.027977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-64ef3431-51bd-45b6-8f17-a0f3c7a4eeaf req-b7a76bb7-3460-4b81-ab93-2620cf5ae0e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.044488 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-64ef3431-51bd-45b6-8f17-a0f3c7a4eeaf req-b7a76bb7-3460-4b81-ab93-2620cf5ae0e3 service nova] Creating event network-changed:5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb for instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d on n-h2-843834-3 Jul 19 19:49:10.055408 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-64ef3431-51bd-45b6-8f17-a0f3c7a4eeaf req-b7a76bb7-3460-4b81-ab93-2620cf5ae0e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039776 Jul 19 19:49:10.056249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1068/2134] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:10.177714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:10.178606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:10.185619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.186511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.187550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.188355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.255074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:10.263463 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e04523e-1781-46d0-8027-fbafeaa4a379 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.623027 Jul 19 19:49:10.264073 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1067/2135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:09 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:10.356414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:10.357061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:10.363676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.364142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.364949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.365389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.799976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:10.808424 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60a4fc0e-699a-4e3b-a093-9017b22f6237 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.634853 Jul 19 19:49:10.809135 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1069/2136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:10 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:10.814833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:10.815902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:10.823964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.824661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.825945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:10.826438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:10.940602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:10.954654 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5843ecd2-b04d-4f20-ac3c-ba54be4f0c90 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 200 len: 1468 microversion: 2.1 time: 0.602329 Jul 19 19:49:10.966377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1068/2137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:10 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 1468 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:11.020067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:11.020453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:11.027374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:11.031468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:11.032465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:11.033015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.023870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.032797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.041454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.043327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f90311d5-98a4-4739-ba8c-e0e8ba154500 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1596 microversion: 2.20 time: 1.232986 Jul 19 19:49:12.043883 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1070/2138] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:49:10 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1596 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:49:12.049026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.049988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.056944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.057502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.058402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.058944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.267283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.276549 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34c63af1-bd89-4442-825e-c9d9b0541fbb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1315 microversion: 2.1 time: 1.262781 Jul 19 19:49:12.278958 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1069/2139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:11 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1315 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:12.282198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.282809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.289032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.289493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.290266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.290701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.634588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.642437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac9abde4-312d-406f-8322-6a06b3abfb92 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.596994 Jul 19 19:49:12.643024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1071/2140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:12.647460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.648063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 316b88da-4255-4d00-a46a-5e853820f529] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.654067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.654527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.655347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.655785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.672095 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] HTTP exception thrown: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Request method failure captured: Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 HTTP/1.1 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1woLPJd-FZUidQardDgEnzr9UCzFyES0_lQIgU5sONCgMEZKYp-IaMIPcbHLTbYvPlsofGsWNLNS5m-mz_IivcV3oEF_1rw1UXRfVaIXARtvdoCFlZBaRhWa58h8rinbNo26h8ujy6SGRTWa6HRdFueM5MiwfdaiBcTcS-hieI2qth0 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 56b5e75a70bd48c392b0bede39f69e8c Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '316b88da-4255-4d00-a46a-5e853820f529'} Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:12.673873 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Returning 404 to user: Instance 316b88da-4255-4d00-a46a-5e853820f529 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-acef7e66-76e6-4be0-8177-a8367deb69aa tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529" status: 404 len: 111 microversion: 2.1 time: 0.031497 Jul 19 19:49:12.677471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1072/2141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/316b88da-4255-4d00-a46a-5e853820f529 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:12.683390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.683888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.690257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.690692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.691541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.691982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.875165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:12.884180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b6b455c8-8c1e-4e79-97f2-ba3621e40f27 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.605287 Jul 19 19:49:12.884718 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1070/2142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:12.890312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-bca82a3b-99a2-4f09-b564-181c9ca342bc req-c4605b36-2d62-4eb1-929d-4fc2c1856191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316b88da-4255-4d00-a46a-5e853820f529", "name": "network-vif-deleted", "tag": "234c4074-29a5-4379-a013-b7d22774c044"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:12.892542 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-961e6525-38d5-4108-b62f-23de083a92c7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.215064 Jul 19 19:49:12.893227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1073/2143] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:49:12 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:49:12.898513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:12.905101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bca82a3b-99a2-4f09-b564-181c9ca342bc req-c4605b36-2d62-4eb1-929d-4fc2c1856191 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.905551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bca82a3b-99a2-4f09-b564-181c9ca342bc req-c4605b36-2d62-4eb1-929d-4fc2c1856191 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.912635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:12.916726 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bca82a3b-99a2-4f09-b564-181c9ca342bc req-c4605b36-2d62-4eb1-929d-4fc2c1856191 service nova] Creating event network-vif-deleted:234c4074-29a5-4379-a013-b7d22774c044 for instance 316b88da-4255-4d00-a46a-5e853820f529 on n-h1-843834-3 Jul 19 19:49:12.921970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.922139 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-bca82a3b-99a2-4f09-b564-181c9ca342bc req-c4605b36-2d62-4eb1-929d-4fc2c1856191 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Jul 19 19:49:12.922990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.923112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1071/2144] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:12.923908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:12.924442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:12.954609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:13.033307 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28ddd306-ccf0-444b-bbae-f7e7d739a191 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 204 len: 0 microversion: 2.1 time: 0.138541 Jul 19 19:49:13.034199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1074/2145] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:12 2022] DELETE /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:13.043418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.044571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.051392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.051952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.052920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.053393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.294326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.294971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.302243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.302713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.303510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.304697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.412681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:13.420789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb986e9d-1e3a-441a-a4b3-f858e882da36 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1468 microversion: 2.1 time: 0.382229 Jul 19 19:49:13.421616 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1072/2146] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:13.637592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:13.643867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:13.674317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.675652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.690858 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d5884af-6ffa-4312-b737-ef012a627133 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1315 microversion: 2.1 time: 0.397193 Jul 19 19:49:13.695293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.697651 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1075/2147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:13.697929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.699125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.700481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.783883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-47d5ad78-e349-4573-85a5-d75763d4701e req-c22435f6-e3ea-4984-baae-c11912e43698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ad89d6-fc11-41ff-a00b-f8b53b5d538d", "name": "network-vif-plugged", "status": "completed", "tag": "5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:13.797637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-47d5ad78-e349-4573-85a5-d75763d4701e req-c22435f6-e3ea-4984-baae-c11912e43698 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.798491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-47d5ad78-e349-4573-85a5-d75763d4701e req-c22435f6-e3ea-4984-baae-c11912e43698 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.812803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-47d5ad78-e349-4573-85a5-d75763d4701e req-c22435f6-e3ea-4984-baae-c11912e43698 service nova] Creating event network-vif-plugged:5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb for instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d on n-h2-843834-3 Jul 19 19:49:13.821068 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-47d5ad78-e349-4573-85a5-d75763d4701e req-c22435f6-e3ea-4984-baae-c11912e43698 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043318 Jul 19 19:49:13.824275 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1076/2148] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:13.901110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:13.902104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:13.910494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.910992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:13.912005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:13.912592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.147195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:14.156461 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e885925b-9aa1-4737-9e8d-5da618941541 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.500508 Jul 19 19:49:14.166427 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1073/2149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:14.449827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:14.452615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:14.466433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.467537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.472247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.473175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.574599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:14.584445 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ffcbd16-53c7-4be3-b0c4-f6260ca20b62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.687554 Jul 19 19:49:14.594346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1077/2150] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:13 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:14.712053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:14.712703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:14.719563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.720245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.721030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.721627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.867020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:14.876293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e22fdbf3-a142-491a-8b27-04923390601e tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1468 microversion: 2.1 time: 0.439659 Jul 19 19:49:14.886037 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1074/2151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:14 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:14.960774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ca463386-a4fa-4b0d-9378-c87829ea62b0 req-37ebb70f-988d-4d13-acb8-aa17dafc637a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:14.970628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ca463386-a4fa-4b0d-9378-c87829ea62b0 req-37ebb70f-988d-4d13-acb8-aa17dafc637a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:14.970881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ca463386-a4fa-4b0d-9378-c87829ea62b0 req-37ebb70f-988d-4d13-acb8-aa17dafc637a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:14.982538 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ca463386-a4fa-4b0d-9378-c87829ea62b0 req-37ebb70f-988d-4d13-acb8-aa17dafc637a service nova] Creating event network-changed:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h1-843834-3 Jul 19 19:49:14.988292 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ca463386-a4fa-4b0d-9378-c87829ea62b0 req-37ebb70f-988d-4d13-acb8-aa17dafc637a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030931 Jul 19 19:49:14.988929 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1075/2152] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:15.111396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:15.119497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-47c53075-d3e4-42f4-a2c2-d4be6b076a11 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1315 microversion: 2.1 time: 0.411312 Jul 19 19:49:15.136607 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1078/2153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:14 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:15.175305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:15.176412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:15.197769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.199135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.201004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.201636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.602631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:15.603283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:15.610507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.610982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.611789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.621412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.902269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:15.931387 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6da7f02-55c2-40ce-8362-37fd3a4c7c2d tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.757714 Jul 19 19:49:15.932030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1076/2154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:15 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:15.943709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:15.944884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:15.951856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.952557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:15.953521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:15.954117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.235313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:16.248430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:16.260414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-112d5257-bc88-4089-996b-45303b4d39d8 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 200 len: 1426 microversion: 2.1 time: 0.327012 Jul 19 19:49:16.261204 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a64d7ab2-e574-4a75-9017-f9a361e0e733 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.661112 Jul 19 19:49:16.262830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1079/2155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:15 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:16.266113 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1077/2156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:15 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 1426 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:16.270706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:16.271955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:16.280741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.281410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.282532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.283330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.837267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:16.848551 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9101cfd6-0610-42bc-b0f3-d7439e29a8a1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1315 microversion: 2.1 time: 0.584294 Jul 19 19:49:16.849514 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1080/2157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:16 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:16.953163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:16.954445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:16.969599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:16.972456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:16.975872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.978047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:16.979950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:16.983391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.009278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8198f798-2921-4aa8-9746-34a5263cd266 req-1d861205-9993-4dfb-a236-3b859a85d245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602ff957-ac05-42f0-9642-43ae5f9f01ce", "name": "network-vif-deleted", "tag": "e14abde6-a20f-4e64-b446-f9681dcb0a1d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:17.026109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8198f798-2921-4aa8-9746-34a5263cd266 req-1d861205-9993-4dfb-a236-3b859a85d245 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.026666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8198f798-2921-4aa8-9746-34a5263cd266 req-1d861205-9993-4dfb-a236-3b859a85d245 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.070268 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8198f798-2921-4aa8-9746-34a5263cd266 req-1d861205-9993-4dfb-a236-3b859a85d245 service nova] Creating event network-vif-deleted:e14abde6-a20f-4e64-b446-f9681dcb0a1d for instance 602ff957-ac05-42f0-9642-43ae5f9f01ce on n-h2-843834-3 Jul 19 19:49:17.077737 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8198f798-2921-4aa8-9746-34a5263cd266 req-1d861205-9993-4dfb-a236-3b859a85d245 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072765 Jul 19 19:49:17.079540 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1081/2158] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:17.279335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.280064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.289706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.290660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.291843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.292575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.726039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:17.735979 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8271268-90f9-4b65-af81-7c9e1ab9dbda tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.791338 Jul 19 19:49:17.745531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1078/2159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:16 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:17.754888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.755812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: 602ff957-ac05-42f0-9642-43ae5f9f01ce] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.768838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.769608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.770583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.771228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.789096 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] HTTP exception thrown: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Request method failure captured: Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce HTTP/1.1 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1woLPJd-FZUidQardDgEnzr9UCzFyES0_lQIgU5sONCgMEZKYp-IaMIPcbHLTbYvPlsofGsWNLNS5m-mz_IivcV3oEF_1rw1UXRfVaIXARtvdoCFlZBaRhWa58h8rinbNo26h8ujy6SGRTWa6HRdFueM5MiwfdaiBcTcS-hieI2qth0 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 56b5e75a70bd48c392b0bede39f69e8c Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '602ff957-ac05-42f0-9642-43ae5f9f01ce'} Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:17.791419 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. Jul 19 19:49:17.796562 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:17.798288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Returning 404 to user: Instance 602ff957-ac05-42f0-9642-43ae5f9f01ce could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:17.799898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0168a25f-f901-4244-8890-5f0827b1c4dd tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce" status: 404 len: 111 microversion: 2.1 time: 0.053002 Jul 19 19:49:17.804146 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1079/2160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:17 2022] GET /compute/v2.1/servers/602ff957-ac05-42f0-9642-43ae5f9f01ce => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:17.811018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.812029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.820175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.820892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.821852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:17.822539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:17.861911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:17.981344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e799614c-06fc-4d21-9a07-772a1ef5e2fc tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 204 len: 0 microversion: 2.1 time: 0.174612 Jul 19 19:49:17.983083 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1080/2161] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:17 2022] DELETE /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:17.991333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:17.992684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:17.999014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:18.002168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.002769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.004341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.005219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.008610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-847dfa62-cb2f-4447-b632-d0f61c07a15e tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.734294 Jul 19 19:49:18.015382 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1082/2162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:17 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:18.028892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:18.029786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:18.040241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.040971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.042372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.043158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.276189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:18.283489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:18.285483 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e865b47e-f276-40b8-9749-3f6365398492 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1502 microversion: 2.1 time: 0.301053 Jul 19 19:49:18.286510 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1081/2163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:17 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:18.307698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba942186-c25b-435e-a162-c651cd7c24f7 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1469 microversion: 2.1 time: 0.284996 Jul 19 19:49:18.308292 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1083/2164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:18 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:18.753078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:18.754466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:18.763880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.764201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:18.765341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:18.766542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.029438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:19.030435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:19.036279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.037876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.038520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.039503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.040086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.043360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:19.051520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe882ccd-fa9c-4bee-bce8-17926771e83a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.302741 Jul 19 19:49:19.052657 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1082/2165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:18 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:19.268105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.282140 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8bd7bee7-3821-4cb2-b4f4-f28fbc873b90 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.255989 Jul 19 19:49:19.283529 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1084/2166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:19 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:19.327649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:19.328380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:19.344263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.344802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.345721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.346158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.570049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:19.585907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e211489a-c92d-4dd8-92f3-b12dc02225c6 req-ae67cb7b-9e10-4b64-a87a-dd64d80afdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "name": "network-vif-plugged", "status": "completed", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:19.593363 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-605e5726-6ade-42f6-a955-4de26f276d44 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1469 microversion: 2.1 time: 0.271459 Jul 19 19:49:19.593992 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1083/2167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:19 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:19.600291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e211489a-c92d-4dd8-92f3-b12dc02225c6 req-ae67cb7b-9e10-4b64-a87a-dd64d80afdf7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.601335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e211489a-c92d-4dd8-92f3-b12dc02225c6 req-ae67cb7b-9e10-4b64-a87a-dd64d80afdf7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.618813 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e211489a-c92d-4dd8-92f3-b12dc02225c6 req-ae67cb7b-9e10-4b64-a87a-dd64d80afdf7 service nova] Creating event network-vif-plugged:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h1-843834-3 Jul 19 19:49:19.626520 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e211489a-c92d-4dd8-92f3-b12dc02225c6 req-ae67cb7b-9e10-4b64-a87a-dd64d80afdf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045020 Jul 19 19:49:19.628695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1085/2168] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:19.784253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0792361a-19c3-4e3b-90aa-5f26edfceb5b"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:19.787464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:19.809227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.812414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:19.814429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:19.817909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.075759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.077329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:20.089996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.091456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.094110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.095096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.174879 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca61ab86-780c-41b0-8884-0d4b380adf15 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396703 Jul 19 19:49:20.177035 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1084/2169] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 19:49:19 2022] POST /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:20.307319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.309362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:20.342791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.344044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.346620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.349433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.437660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:20.450670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29b3b287-9dd5-42a5-bb07-5a5d558d9ca2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.380821 Jul 19 19:49:20.455333 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1086/2170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:20.598685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:20.611050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:20.611672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:20.620123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.620572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.628760 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04623d05-b510-431b-8b11-94001d2f28e2 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.330100 Jul 19 19:49:20.629936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:20.630400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:20.633325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1085/2171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:20.879763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:20.892821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71a55559-5634-46ef-a57a-1e11e2d6e535 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1469 microversion: 2.1 time: 0.285309 Jul 19 19:49:20.904444 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1087/2172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:20 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:21.481738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:21.484837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:21.500013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.500713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.519023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.520378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.648096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:21.649402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:21.669432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.672914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:21.675210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:21.677621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.073403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:22.086450 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e214124-f357-41ef-aa37-f979944e6cc8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1197 microversion: 2.1 time: 0.614213 Jul 19 19:49:22.088887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1086/2173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:21 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1197 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:22.108544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-plugged", "status": "completed", "tag": "fa07bd2d-872d-46e8-bb78-8d9e17feaae7"}, {"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-plugged", "status": "completed", "tag": "6bab8edc-2a50-4431-a76f-7a6347cb4b4c"}, {"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-plugged", "status": "completed", "tag": "a6f1fe5b-d85e-4e07-8933-76a8bdf400af"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:22.128740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.133006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.163872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:22.176044 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Creating event network-vif-plugged:fa07bd2d-872d-46e8-bb78-8d9e17feaae7 for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:22.177851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc70eecc-b3b6-4a95-bb6e-7130984b0189 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.534006 Jul 19 19:49:22.178817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Creating event network-vif-plugged:6bab8edc-2a50-4431-a76f-7a6347cb4b4c for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:22.179557 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] Creating event network-vif-plugged:a6f1fe5b-d85e-4e07-8933-76a8bdf400af for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:22.180383 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1088/2174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:21 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:22.188358 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-65f1330f-c017-4208-9d64-c7b2cf1cdf13 req-13deaf3f-a7a6-4916-b5be-883dfa1281b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.097269 Jul 19 19:49:22.189530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1087/2175] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:22.193552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4ada1bb6-3c93-458c-a1eb-4913f0c81590 req-73b6ffcc-84df-47f6-b97b-7016687b02a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06951cb-806f-4404-aecb-382385611932", "name": "network-vif-deleted", "tag": "4de30de6-3236-438c-bb3e-49e9a3e1a9a9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:22.210226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:22.211367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:22.215878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ada1bb6-3c93-458c-a1eb-4913f0c81590 req-73b6ffcc-84df-47f6-b97b-7016687b02a6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.216841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ada1bb6-3c93-458c-a1eb-4913f0c81590 req-73b6ffcc-84df-47f6-b97b-7016687b02a6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.231642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.233771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.234785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.238536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.250003 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4ada1bb6-3c93-458c-a1eb-4913f0c81590 req-73b6ffcc-84df-47f6-b97b-7016687b02a6 service nova] Creating event network-vif-deleted:4de30de6-3236-438c-bb3e-49e9a3e1a9a9 for instance f06951cb-806f-4404-aecb-382385611932 on n-h1-843834-3 Jul 19 19:49:22.261645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4ada1bb6-3c93-458c-a1eb-4913f0c81590 req-73b6ffcc-84df-47f6-b97b-7016687b02a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075686 Jul 19 19:49:22.266131 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1089/2176] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:22.296652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:22.297468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:22.298177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lazy-loading 'fault' on Instance uuid f06951cb-806f-4404-aecb-382385611932 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:22.386042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b5e75a70bd48c392b0bede39f69e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a326f8bda43bb8a2d351bbe1d7127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:22.400092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23dfed4b-ddb4-43e3-9f57-ca0c8036f23d tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 200 len: 1303 microversion: 2.1 time: 0.201576 Jul 19 19:49:22.403770 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1088/2177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:22 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:23.109826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.112620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.129939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.130726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.131782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.132443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.197340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.211543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.234120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.234578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.235398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.235838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.566232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:23.580218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae6dee1f-7336-4dea-be72-e3f25e9c798b tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1380 microversion: 2.1 time: 0.476669 Jul 19 19:49:23.581491 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1090/2178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1380 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:23.588548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.597933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] [instance: f06951cb-806f-4404-aecb-382385611932] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.610709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.611886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.613199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.613652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.627269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:23.630681 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] HTTP exception thrown: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Request method failure captured: Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 HTTP/1.1 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1woLPJd-FZUidQardDgEnzr9UCzFyES0_lQIgU5sONCgMEZKYp-IaMIPcbHLTbYvPlsofGsWNLNS5m-mz_IivcV3oEF_1rw1UXRfVaIXARtvdoCFlZBaRhWa58h8rinbNo26h8ujy6SGRTWa6HRdFueM5MiwfdaiBcTcS-hieI2qth0 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da4a326f8bda43bb8a2d351bbe1d7127"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: da4a326f8bda43bb8a2d351bbe1d7127 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminTestJSON-1263212056 Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 56b5e75a70bd48c392b0bede39f69e8c Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminTestJSON-1263212056-project Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f06951cb-806f-4404-aecb-382385611932'} Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:23.633877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. Jul 19 19:49:23.639906 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:23.640932 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd539645-d4b1-4a54-9ca4-d15fce66aebe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1355 microversion: 2.1 time: 0.444958 Jul 19 19:49:23.640932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1089/2179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:23.645546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.646366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.649114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:23.655481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] Returning 404 to user: Instance f06951cb-806f-4404-aecb-382385611932 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:23.656068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.656928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.658068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.658810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.659230 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14c8a5e4-9b0d-4ef0-a8e7-5402186e96e3 tempest-ServersAdminTestJSON-1263212056 tempest-ServersAdminTestJSON-1263212056-project] 10.222.0.23 "GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932" status: 404 len: 111 microversion: 2.1 time: 0.073606 Jul 19 19:49:23.662372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1091/2180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/f06951cb-806f-4404-aecb-382385611932 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:23.898289 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfecf3e1-74e9-4178-bcfa-d59da9f144e4 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1531 microversion: 2.1 time: 0.256210 Jul 19 19:49:23.899801 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1090/2181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1531 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:23.921835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:23.922743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:23.939534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.940201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:23.941867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:23.942483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.191104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4060a4c-698a-4166-a90a-86bfd7cf2e2d tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1531 microversion: 2.1 time: 0.278059 Jul 19 19:49:24.192834 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1092/2182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:23 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1531 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:24.208986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:24.211000 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:24.211000 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:49:24.212575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.213192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.214506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.215139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.254735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e57fbf84-2deb-4c00-8bd7-6c61b599f25c tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046378 Jul 19 19:49:24.256501 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1091/2183] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 19:49:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:24.269127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843834-3", "block_migration": false, "disk_over_commit": false}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:24.273000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.283377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.285836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.287777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.288881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.320205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lazy-loading 'flavor' on Instance uuid 365f9b62-43ce-40c1-9698-73742bad2cda {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:24.336452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Going to try to live migrate instance to n-h2-843834-3 {{(pid=131229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 19:49:24.428138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:24.656791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:24.657420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:24.680864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.681462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:24.682262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:24.682701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.108463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:25.118398 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9e71212-9ede-47cf-acd7-3a7752ef66b4 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1805 microversion: 2.1 time: 0.466100 Jul 19 19:49:25.122325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1092/2184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:24 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1805 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:25.147154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.149749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.170467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.174321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.175914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.176542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.212156 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5eadbd9-2e58-45a4-acec-10735fc57cd3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071/ips" status: 200 len: 218 microversion: 2.1 time: 0.076860 Jul 19 19:49:25.215831 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1093/2185] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:49:25 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071/ips => generated 218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:25.235235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:25.236839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:25.254939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.256440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.258452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:25.259229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:25.304987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:25.428365 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01eadbf2-7779-4c6c-9992-589b0adaaec7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 204 len: 0 microversion: 2.1 time: 0.200196 Jul 19 19:49:25.430116 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1094/2186] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:25 2022] DELETE /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:25.920503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-061283f4-4423-4d58-bd67-4778f50a98f5 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Action: 'create', calling method: .version_select at 0x7f23ef4b5ee0>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:27.940371 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-061283f4-4423-4d58-bd67-4778f50a98f5 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.508089 Jul 19 19:49:27.941066 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1095/2187] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:49:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:27.946726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:27.947819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:27.956314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.956836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:27.957875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:27.958377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.267574 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6ac2e4d-7551-470a-b762-320a2c99a94b tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda/action" status: 202 len: 0 microversion: 2.1 time: 4.003155 Jul 19 19:49:28.269498 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1093/2188] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:49:24 2022] POST /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda/action => generated 0 bytes in 4006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:28.298823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:28.316204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f906f3e-481c-4142-a344-bb3897b6f4fc tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1811 microversion: 2.1 time: 0.372826 Jul 19 19:49:28.329677 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1096/2189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:27 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1811 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:28.366241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0e339fa-1282-4f44-ae4e-5811e5a5d8ef tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Action: 'create', calling method: .version_select at 0x7f23ef4eac10>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:28.430578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:28.432485 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:28.432485 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:28.438359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.439171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.441949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.442488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.507167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9615b9d-de45-42aa-acd4-113f50cbd356 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.235639 Jul 19 19:49:28.508385 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1094/2190] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:28.515766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:28.516856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:28.524378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.525585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:28.526671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:28.527358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.437532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:29.448367 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74f8db1c-6da2-46b1-8dc5-4645e4ac7016 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.938623 Jul 19 19:49:29.454986 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1095/2191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:28 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:29.475933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c1b0169f-524a-4024-8aab-16b4144ad9b5 req-17c17c6c-7903-4fa9-a386-6a3630ab3936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-deleted", "tag": "6bab8edc-2a50-4431-a76f-7a6347cb4b4c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:29.480942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:29.498393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c1b0169f-524a-4024-8aab-16b4144ad9b5 req-17c17c6c-7903-4fa9-a386-6a3630ab3936 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.500714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c1b0169f-524a-4024-8aab-16b4144ad9b5 req-17c17c6c-7903-4fa9-a386-6a3630ab3936 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.524267 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c1b0169f-524a-4024-8aab-16b4144ad9b5 req-17c17c6c-7903-4fa9-a386-6a3630ab3936 service nova] Creating event network-vif-deleted:6bab8edc-2a50-4431-a76f-7a6347cb4b4c for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:29.545538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c1b0169f-524a-4024-8aab-16b4144ad9b5 req-17c17c6c-7903-4fa9-a386-6a3630ab3936 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088721 Jul 19 19:49:29.546293 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1096/2192] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:29.554560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:29.556424 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:29.556424 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:29.558068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.558744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.559878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.560559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.595454 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f9ebe11-b523-4b01-afd2-d399e0ae79fc tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047643 Jul 19 19:49:29.596632 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1097/2193] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:49:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:29.601961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:29.602934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:29.612106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.612814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:29.614177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:29.615055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.150804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:30.168933 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51c518e9-096e-44af-a060-71eced19cf7f tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1676 microversion: 2.1 time: 0.570895 Jul 19 19:49:30.175028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1098/2194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:29 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1676 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:30.179877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.185252 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:30.185252 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:30.193575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.194811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.196195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.196806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.246131 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bb34995-c4ea-46fa-a330-fc1596cf5eb7 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069287 Jul 19 19:49:30.247461 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1099/2195] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:30.265215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-eee0ae66-7de7-4dea-9072-c198c1bf4bc6 req-92142620-1677-4690-b458-f36d4c0b4f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-unplugged", "status": "completed", "tag": "fa07bd2d-872d-46e8-bb78-8d9e17feaae7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:30.290442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eee0ae66-7de7-4dea-9072-c198c1bf4bc6 req-92142620-1677-4690-b458-f36d4c0b4f74 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.290684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eee0ae66-7de7-4dea-9072-c198c1bf4bc6 req-92142620-1677-4690-b458-f36d4c0b4f74 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.340707 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-eee0ae66-7de7-4dea-9072-c198c1bf4bc6 req-92142620-1677-4690-b458-f36d4c0b4f74 service nova] Creating event network-vif-unplugged:fa07bd2d-872d-46e8-bb78-8d9e17feaae7 for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:30.349484 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-eee0ae66-7de7-4dea-9072-c198c1bf4bc6 req-92142620-1677-4690-b458-f36d4c0b4f74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100555 Jul 19 19:49:30.350117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1100/2196] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:30.376233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.378017 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:30.378017 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:30.380211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.380932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.381987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.382615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.418104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc74b361-c01c-41b8-94e1-63f8daa3e1a0 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-843834-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.055486 Jul 19 19:49:30.419013 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1101/2197] 10.222.0.23 () {58 vars in 1193 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/os-services?host=n-d-843834-3&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:49:30.432111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.434079 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:30.434079 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:30.435727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.437605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.438957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.439400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.467924 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58a5717e-9504-4626-8d7f-43ad8f894bf4 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.040364 Jul 19 19:49:30.468549 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1102/2198] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:30.479749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.481097 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:30.481097 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:30.482457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.483135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.484179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.484783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.513467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4b79f82b-4034-4567-899e-89a699ef0f64 tempest-ServicesAdminNegativeTestJSON-1427836969 tempest-ServicesAdminNegativeTestJSON-1427836969-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038009 Jul 19 19:49:30.521131 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1103/2199] 10.222.0.23 () {58 vars in 1197 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:49:30.529194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:30.530003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:30.536890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.537712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.538563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:30.539120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:30.818343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:30.848217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b98c10a8-7c60-42e0-85c7-b3132579f07f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.324907 Jul 19 19:49:30.860672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1104/2200] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:31.054902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c49b4e81-3e4c-47e3-b167-d8e91db6fa2b tempest-ServicesAdminNegativeTestJSON-1899690679 tempest-ServicesAdminNegativeTestJSON-1899690679-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:31.056301 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:49:31.056301 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:49:31.057944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c49b4e81-3e4c-47e3-b167-d8e91db6fa2b tempest-ServicesAdminNegativeTestJSON-1899690679 tempest-ServicesAdminNegativeTestJSON-1899690679-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd6c5ddef84b14ced905637c4006265b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa47aeb85ae344c880a20253d1509dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c49b4e81-3e4c-47e3-b167-d8e91db6fa2b tempest-ServicesAdminNegativeTestJSON-1899690679 tempest-ServicesAdminNegativeTestJSON-1899690679-project] Request method failure captured: Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wrGBkxyjKjAZzYjafPB81rv7XsgQQ1AozAkvwUK3GYIUIMSah44sk0fViWUqnJlJ0XlpkgamUH86NLS9maOEpiWCMyk7exkw5mB3a5mLu95vkmrJjkPQPBg0lHRGrlhO2oYBD91meiokx4IHpIGctioxjFGu2pIj5X-3X_I8C3Y6jI Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: fa47aeb85ae344c880a20253d1509dee Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1899690679 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa47aeb85ae344c880a20253d1509dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa47aeb85ae344c880a20253d1509dee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa47aeb85ae344c880a20253d1509dee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa47aeb85ae344c880a20253d1509dee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1899690679 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: fa47aeb85ae344c880a20253d1509dee Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1899690679 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServicesAdminNegativeTestJSON-1899690679-project Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d6c5ddef84b14ced905637c4006265b4 Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1899690679-project Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:49:31.060536 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 19:49:31.065001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:31.065996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c49b4e81-3e4c-47e3-b167-d8e91db6fa2b tempest-ServicesAdminNegativeTestJSON-1899690679 tempest-ServicesAdminNegativeTestJSON-1899690679-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:31.067215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c49b4e81-3e4c-47e3-b167-d8e91db6fa2b tempest-ServicesAdminNegativeTestJSON-1899690679 tempest-ServicesAdminNegativeTestJSON-1899690679-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.214564 Jul 19 19:49:31.068559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1105/2201] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:31.191288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:31.191921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:31.200425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.200876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.208672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.209143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.384117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:31.397934 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0624f65b-0e26-4ce1-8220-d997e9f064c1 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 200 len: 1613 microversion: 2.1 time: 0.210564 Jul 19 19:49:31.399522 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1106/2202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:31 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 1613 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:31.708146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-deleted", "tag": "a6f1fe5b-d85e-4e07-8933-76a8bdf400af"}, {"server_uuid": "6a84776e-3e7d-4617-a489-60c86e098071", "name": "network-vif-deleted", "tag": "fa07bd2d-872d-46e8-bb78-8d9e17feaae7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:31.724802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.725821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.742387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] Creating event network-vif-deleted:a6f1fe5b-d85e-4e07-8933-76a8bdf400af for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:31.743225 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] Creating event network-vif-deleted:fa07bd2d-872d-46e8-bb78-8d9e17feaae7 for instance 6a84776e-3e7d-4617-a489-60c86e098071 on n-h2-843834-3 Jul 19 19:49:31.749915 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1008cb83-e0a6-4352-b828-f15650d76bd0 req-7e0715fa-701b-4860-95dd-a044314e67c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047995 Jul 19 19:49:31.751378 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1107/2203] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:31.809892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0e339fa-1282-4f44-ae4e-5811e5a5d8ef tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.476412 Jul 19 19:49:31.811126 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1097/2204] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:49:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:31.840959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a53a1ec0-30f6-4e4f-aca5-b08b542d5560 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Action: 'create', calling method: .version_select at 0x7f23eefa9160>, body: {"pool": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:31.870226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:31.871610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:31.880568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.881679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:31.883048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:31.884984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.208131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:32.239512 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2faeff1c-9fff-4d2e-8b88-ffe6ac203c69 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.374982 Jul 19 19:49:32.252117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1098/2205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:31 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:32.417879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:32.418717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:32.429494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.430443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.431261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:32.431849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:32.452655 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 HTTP/1.1 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6a84776e-3e7d-4617-a489-60c86e098071'} Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:32.454852 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1e2470b-3116-4b4e-941a-e209e4703b41 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 404 len: 111 microversion: 2.1 time: 0.044440 Jul 19 19:49:32.458421 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1099/2206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:32 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:49:33.265276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:33.266495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:33.282072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.285778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.286663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:33.287175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:33.327642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:33.810132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:33.822950 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f78fb40-3b04-43e8-9034-d606f54e2745 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.565375 Jul 19 19:49:33.823842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1100/2207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:33 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:34.067953 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a53a1ec0-30f6-4e4f-aca5-b08b542d5560 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.230752 Jul 19 19:49:34.078543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1108/2208] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:49:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:34.083441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fa95be7-949a-46a4-a957-bb5e5bf742b2 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Action: 'create', calling method: .version_select at 0x7f23ef3f59d0>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:34.221637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:34.826898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:34.828142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:34.838583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.839062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.839848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:34.840279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:34.892841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:35.077997 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b32ee7dd-678a-4475-8c5e-111dfae3443c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 204 len: 0 microversion: 2.1 time: 0.255560 Jul 19 19:49:35.079060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1109/2209] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:34 2022] DELETE /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:49:35.091911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:35.094364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:35.107662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.108378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.109406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.110071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.594439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:35.605471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d1d8821-b800-4882-aba5-c36fa900f782 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.523883 Jul 19 19:49:35.606736 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1110/2210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:35 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:35.613445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:35.614476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:35.622882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.623486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:35.624591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:35.625259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.010012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:36.019070 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04faf91c-d51f-4e60-ade5-1fafafb01195 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1554 microversion: 2.1 time: 0.410871 Jul 19 19:49:36.024316 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1111/2211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:35 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1554 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:36.622000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:36.622614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:36.640461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.641184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.642118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:36.642612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:36.923336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:36.933531 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a427ef28-0824-4e22-8cae-6e6b42ea1519 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.315641 Jul 19 19:49:36.934141 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1112/2212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:36 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:37.046834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.047908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:37.064164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.065021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.066451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.067257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.552733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:37.571216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7faee911-0211-49c4-b5c0-453cdafdb7bb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1554 microversion: 2.1 time: 0.537392 Jul 19 19:49:37.585304 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1113/2213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1554 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:37.710322 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fa95be7-949a-46a4-a957-bb5e5bf742b2 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.630984 Jul 19 19:49:37.715863 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1101/2214] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:49:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:37.724768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-feedb575-f7c9-4b02-8bd3-d3c7f92c53e8 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23eef578b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.958097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:37.958884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:37.969164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.970270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:37.972194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:37.973789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.027023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-feedb575-f7c9-4b02-8bd3-d3c7f92c53e8 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/602498d9-4870-4548-b807-ef22523eb70e" status: 200 len: 142 microversion: 2.1 time: 0.308017 Jul 19 19:49:38.028386 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1114/2215] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/os-floating-ips/602498d9-4870-4548-b807-ef22523eb70e => generated 142 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:49:38.331474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3876e686-9338-4b32-84cb-066a04f84b14 req-d58cac4d-b238-4a12-88ae-638c9e9544ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ad89d6-fc11-41ff-a00b-f8b53b5d538d", "name": "network-vif-deleted", "tag": "5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:38.349469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3876e686-9338-4b32-84cb-066a04f84b14 req-d58cac4d-b238-4a12-88ae-638c9e9544ba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.353770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3876e686-9338-4b32-84cb-066a04f84b14 req-d58cac4d-b238-4a12-88ae-638c9e9544ba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.380589 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3876e686-9338-4b32-84cb-066a04f84b14 req-d58cac4d-b238-4a12-88ae-638c9e9544ba service nova] Creating event network-vif-deleted:5a8a14e2-5fa6-4b0f-9c9f-30613f7bfccb for instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d on n-h2-843834-3 Jul 19 19:49:38.394600 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3876e686-9338-4b32-84cb-066a04f84b14 req-d58cac4d-b238-4a12-88ae-638c9e9544ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363454 Jul 19 19:49:38.396912 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1115/2216] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:38.410521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6782b7ec-07ad-4890-a8c1-9c729e050427 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23eef43280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:38.523003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:38.532231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-daefbcaf-04a3-420e-ab3f-c619eb90cb1f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.585133 Jul 19 19:49:38.533215 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1102/2217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:37 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:38.592175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:38.593065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:38.603808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.606533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.607431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:38.607891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:38.869021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:38.880960 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecf5abb7-a4b6-4013-bd1f-bccbed923525 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1346 microversion: 2.1 time: 0.293108 Jul 19 19:49:38.890546 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1103/2218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:38 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1346 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:49:39.551401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:39.552820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:39.564545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.565421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:39.576342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:39.577052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.036218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.050486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d04f9363-8bbc-498f-b653-fea5c26e216a tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.503186 Jul 19 19:49:40.051704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1104/2219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:39 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.067054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:40.067929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:40.082750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.084832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.086586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:40.092179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:40.232313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:40.241849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-58f92134-90bc-45c6-a3a2-92a4f48f7b25 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1346 microversion: 2.1 time: 0.188930 Jul 19 19:49:40.247698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1105/2220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:40.493914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:40.863096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6782b7ec-07ad-4890-a8c1-9c729e050427 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/602498d9-4870-4548-b807-ef22523eb70e" status: 202 len: 0 microversion: 2.1 time: 2.464422 Jul 19 19:49:40.863695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1116/2221] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:49:38 2022] DELETE /compute/v2.1/os-floating-ips/602498d9-4870-4548-b807-ef22523eb70e => generated 0 bytes in 2466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:40.874265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3b9b5e3-2d78-4554-90a1-6e13c88257dd tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23ef3f5670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.068483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.070068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.103317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.103718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.104530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.104960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.311192 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3b9b5e3-2d78-4554-90a1-6e13c88257dd tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.441137 Jul 19 19:49:41.314935 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1106/2222] 10.222.0.23 () {58 vars in 1163 bytes} [Tue Jul 19 19:49:40 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:49:41.317978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-82339967", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "9b4d5d46-425d-418f-82bb-e12e96d1f662"}, {"uuid": "eb95d773-97bb-4170-9848-2f53ec80391f"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:41.427107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] validate_networks() for [('9b4d5d46-425d-418f-82bb-e12e96d1f662', None, None, None, None, None), ('eb95d773-97bb-4170-9848-2f53ec80391f', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:41.473466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.491649 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8298e613-c514-4776-9431-b89f594b66e7 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.427067 Jul 19 19:49:41.494583 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1117/2223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.503505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:41.504737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:41.533158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.534480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.539026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:41.540058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:41.719949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:41.743370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12d109c3-dec3-4497-9838-616dabd63fad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1346 microversion: 2.1 time: 0.246723 Jul 19 19:49:41.754420 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1118/2224] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1346 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:41.770027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad42feeb-bb95-4cb8-a8ad-b7e3efbfb5d3 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23eefa3700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.387115 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad42feeb-bb95-4cb8-a8ad-b7e3efbfb5d3 tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.630879 Jul 19 19:49:42.388400 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1119/2225] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:49:41 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:42.397230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:42.400957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:42.402891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Searching by: {'deleted': False, 'project_id': 'd3247cd3d0104132aaa309e86515ccae'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:49:42.414564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.415059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.415875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:42.416321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:42.563322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:42.569062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:49:42.647521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a26d130e-e7d8-4b5e-af59-bf09bf9a88df tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.257579 Jul 19 19:49:42.655139 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1120/2226] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:49:42 2022] GET /compute/v2.1/servers => generated 333 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:42.661738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-402ba6a2-c2a1-4aba-90eb-e394bf5ff1ca tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23eefba670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:43.470439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:43.472463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:43.474412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:43.475294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:43.475875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:43.494652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.495853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.497285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.497974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.535234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Getting quotas for project d6cfe7341f7e409f9b88e9906bb81ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:43.545891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Getting quotas for user 47f24facdac944688d5dd210b0e525ca and project d6cfe7341f7e409f9b88e9906bb81ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:43.568533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:43.572290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:43.656276 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ee551b9f-83d7-4f14-a929-db094d1320e3 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340144 Jul 19 19:49:43.659532 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1107/2227] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:43.678648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:43.681027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:43.707095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.710069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:43.722462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:43.725125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.490592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.512113 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-333f89b0-c7a2-4309-ac89-c7438a49e3ca tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.850217 Jul 19 19:49:44.516914 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1108/2228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:43 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:44.533660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:44.547469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.553816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Searching by: {'deleted': False, 'project_id': 'd3247cd3d0104132aaa309e86515ccae'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:49:44.583355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:44.583689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.598861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:44.599641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:44.715054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:49:44.847358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:44.861501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:44.864341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.502552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48f2a712-c689-4476-a1a8-a0810539a0f1 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.984282 Jul 19 19:49:45.515096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1109/2229] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:49:44 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:45.520968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.521591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.546472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.561907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.562841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.563299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.593319 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-402ba6a2-c2a1-4aba-90eb-e394bf5ff1ca tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/6270957e-4c3c-4e3b-b2e4-442640747e29" status: 202 len: 0 microversion: 2.1 time: 2.936608 Jul 19 19:49:45.593984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1121/2230] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:49:42 2022] DELETE /compute/v2.1/os-floating-ips/6270957e-4c3c-4e3b-b2e4-442640747e29 => generated 0 bytes in 2938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:45.600915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.601957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.726989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:45.736396 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0c231cc-c838-49c3-af10-709ed589e416 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 200 len: 1346 microversion: 2.1 time: 0.220047 Jul 19 19:49:45.755387 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1110/2231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 1346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:45.760549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c42a195a-197b-4945-81eb-d507de15e32e req-f69802ba-433c-4fa0-a218-52daf8f1a5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "name": "network-vif-unplugged", "status": "completed", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:45.796840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c42a195a-197b-4945-81eb-d507de15e32e req-f69802ba-433c-4fa0-a218-52daf8f1a5a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.800188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c42a195a-197b-4945-81eb-d507de15e32e req-f69802ba-433c-4fa0-a218-52daf8f1a5a8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.839361 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c42a195a-197b-4945-81eb-d507de15e32e req-f69802ba-433c-4fa0-a218-52daf8f1a5a8 service nova] Creating event network-vif-unplugged:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h1-843834-3 Jul 19 19:49:45.865083 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c42a195a-197b-4945-81eb-d507de15e32e req-f69802ba-433c-4fa0-a218-52daf8f1a5a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108042 Jul 19 19:49:45.871296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1111/2232] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:45.879305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8f3f757-ddd7-48e3-8c05-570f6633031e tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.907730 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8f3f757-ddd7-48e3-8c05-570f6633031e tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032178 Jul 19 19:49:45.912570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1112/2233] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:45.932476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:45.933599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:45.947853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.951703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:45.954832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:45.955572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.412421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.413144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.414235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:46.414829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:46.707542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:46.719759 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06b29ddb-ea9b-493c-810c-1dfcc6422e76 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1281 microversion: 2.1 time: 1.124322 Jul 19 19:49:46.736618 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1122/2234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1281 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:46.757910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26005d1a-f08f-41fe-bee0-0781d0ece7af tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23eefa91f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.267462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:47.300972 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c0b4030-5575-4f33-9ab5-e5c97ec497b0 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 1.375901 Jul 19 19:49:47.302747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1113/2235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:45 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:47.352425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.353691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:47.370136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.370757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.371989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.374306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.457566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:47.650880 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1bb2ad72-de8b-4add-bf35-d153dcdb274c tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 204 len: 0 microversion: 2.1 time: 0.345255 Jul 19 19:49:47.652285 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1114/2236] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:47 2022] DELETE /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:47.661903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.663856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:47.673350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.674099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.675189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.675937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.698881 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d HTTP/1.1 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '74ad89d6-fc11-41ff-a00b-f8b53b5d538d'} Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:47.702331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:47.709233 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:47.713241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:47.716340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-18f8f827-63fa-433f-8841-1c54a075351f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 404 len: 111 microversion: 2.1 time: 0.061240 Jul 19 19:49:47.717168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1115/2237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:47 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:47.740059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:47.746437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:47.764552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.766498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:47.767890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:47.769962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.123862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.145539 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec4e1ad3-566b-4226-88d9-20946ca26a7a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1700 microversion: 2.1 time: 0.427085 Jul 19 19:49:48.146149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1116/2238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:47 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1700 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.163966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.164589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.177710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.178604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.179607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.180734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.341919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:48.373732 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-484c7876-25c1-447c-b844-bdd78c0021bb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1269 microversion: 2.1 time: 0.216124 Jul 19 19:49:48.376007 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1117/2239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:48.395220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.398307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.405821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.407379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.408462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.409195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.431759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d/os-volume_attachments HTTP/1.1 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '74ad89d6-fc11-41ff-a00b-f8b53b5d538d'} Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:48.443448 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:49:48.448203 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:49:48.450561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:48.451848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4009842-971d-4a04-bc06-10598c2d981c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064519 Jul 19 19:49:48.457207 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1118/2240] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:48.468180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8c1f8615-18a8-41cd-a3f2-5d9cf5526c25 req-a031bbad-36a7-42f0-95aa-919047d6753f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:48.486247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c1f8615-18a8-41cd-a3f2-5d9cf5526c25 req-a031bbad-36a7-42f0-95aa-919047d6753f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.487462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c1f8615-18a8-41cd-a3f2-5d9cf5526c25 req-a031bbad-36a7-42f0-95aa-919047d6753f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.515923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8c1f8615-18a8-41cd-a3f2-5d9cf5526c25 req-a031bbad-36a7-42f0-95aa-919047d6753f service nova] Creating event network-changed:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h1-843834-3 Jul 19 19:49:48.523505 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8c1f8615-18a8-41cd-a3f2-5d9cf5526c25 req-a031bbad-36a7-42f0-95aa-919047d6753f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062973 Jul 19 19:49:48.524808 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1119/2241] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:48.553425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:48.554281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:48.563973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.564583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:48.565537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:48.566033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:49.669736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:49.679048 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f90606b-db61-41fc-8825-d8af9d30d2ad tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 1.152593 Jul 19 19:49:49.691362 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1120/2242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:48 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:49.697164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1433170113", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:49.804972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:52.481529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26005d1a-f08f-41fe-bee0-0781d0ece7af tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/95469ea2-ee80-4d6e-9c7b-41f36c0b1a09" status: 202 len: 0 microversion: 2.1 time: 5.743192 Jul 19 19:49:52.482830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1123/2243] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:49:46 2022] DELETE /compute/v2.1/os-floating-ips/95469ea2-ee80-4d6e-9c7b-41f36c0b1a09 => generated 0 bytes in 5745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:52.488845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:52.491742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:52.512167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.512868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.521059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:52.522029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:52.522960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:53.086798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.105494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b1ffc9c-ccd2-48e1-b4c0-64e3ab9309a6 tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1700 microversion: 2.1 time: 0.621130 Jul 19 19:49:53.108996 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1124/2244] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:52 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1700 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:53.123821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.125809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.138809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.139430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.140367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.140893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.254479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:49:53.255762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:49:53.256481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:49:53.257107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:49:53.258321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:49:53.293050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.293707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.294653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.295303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.320350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:53.366775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:53.375375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:53.403842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:49:53.407395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:49:53.499725 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52b4731d-4360-456d-a76e-eccf0ef0240a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.814788 Jul 19 19:49:53.516755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1121/2245] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:49:53.542219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.548537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.552983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:53.561878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.562753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.563908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.565766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.626555 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d31a9e6-01bf-4ff1-9b72-e98952f96f8d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/ips" status: 200 len: 152 microversion: 2.20 time: 0.100683 Jul 19 19:49:53.627381 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1122/2246] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/ips => generated 152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:49:53.637687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:53.638679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:53.651260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.652197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.653435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:53.654105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:53.709690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:53.728726 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-efa2ec84-02f4-48f8-990a-2d2bc970091c tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1311 microversion: 2.1 time: 0.611954 Jul 19 19:49:53.730272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1125/2247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1311 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.210484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d19d0ff0-2020-4c99-a9d0-31133cf693a8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Action: 'create', calling method: .version_select at 0x7f23eefba3a0>, body: {"keypair": {"name": "tempest-keypair-740790480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+2qV0ZcQNx7PFypKOnpzzZ6P9451RC2AMN48qfhU2P8YQHo3N/N64Ybsi3b4uf0eP0NCe88ZOSO9qQ473SdjTnNLMyuMAsRSCSxYK1NstpjG6fJRtR56Vxl4ZLcT9mtQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:54.253303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d19d0ff0-2020-4c99-a9d0-31133cf693a8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:49:54.281904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d19d0ff0-2020-4c99-a9d0-31133cf693a8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for user 0170aafaff4847149210c7b6b73862cf and project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:49:54.296562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:54.316400 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0657894-3efe-485c-8cca-009f4c350b2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.683155 Jul 19 19:49:54.324732 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1123/2248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:53 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.336513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b223ec4-a553-420d-a206-383c68329c3b tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] Calling method '.version_select at 0x7f23ef4d5670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.380192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d19d0ff0-2020-4c99-a9d0-31133cf693a8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.644045 Jul 19 19:49:54.383573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1126/2249] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:49:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:54.398529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da0c68f5-b731-454a-9070-f93cbf8ff1a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.400345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-da0c68f5-b731-454a-9070-f93cbf8ff1a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.932900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-da0c68f5-b731-454a-9070-f93cbf8ff1a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:54.944283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da0c68f5-b731-454a-9070-f93cbf8ff1a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1215 microversion: 2.1 time: 0.557967 Jul 19 19:49:54.948007 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1127/2250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1215 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:54.961015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:54.962995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:54.977819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.981461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:54.985459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:54.986203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.136944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:55.138774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:55.141152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lazy-loading 'fault' on Instance uuid 4902e252-a7e8-4567-967d-cb20e9b87cf4 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:56.146768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e2529545b4a778238fe8bcc7a0fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3247cd3d0104132aaa309e86515ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:56.166617 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7bb371a-9726-4e90-b32c-274c7251b04b tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 200 len: 1359 microversion: 2.1 time: 1.213019 Jul 19 19:49:56.170287 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1128/2251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:54 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 1359 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:56.189928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-74f0feb2-9c99-4ebf-8ea6-0199d53a69c5 req-a565cfd6-1040-461a-99a0-8fe89a5f3a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4902e252-a7e8-4567-967d-cb20e9b87cf4", "name": "network-vif-deleted", "tag": "e1246f38-d592-48c4-a3ef-82e7209ab654"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:56.202367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-74f0feb2-9c99-4ebf-8ea6-0199d53a69c5 req-a565cfd6-1040-461a-99a0-8fe89a5f3a65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.203174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-74f0feb2-9c99-4ebf-8ea6-0199d53a69c5 req-a565cfd6-1040-461a-99a0-8fe89a5f3a65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.232590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-74f0feb2-9c99-4ebf-8ea6-0199d53a69c5 req-a565cfd6-1040-461a-99a0-8fe89a5f3a65 service nova] Creating event network-vif-deleted:e1246f38-d592-48c4-a3ef-82e7209ab654 for instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 on n-h2-843834-3 Jul 19 19:49:56.239941 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-74f0feb2-9c99-4ebf-8ea6-0199d53a69c5 req-a565cfd6-1040-461a-99a0-8fe89a5f3a65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064370 Jul 19 19:49:56.241307 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1129/2252] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:56.255372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:56.260788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:56.283634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.284768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:56.286747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:56.290483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.329961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:57.338247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee5e0cf4-3ea1-4326-b30c-97f68035d2d9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 1.095266 Jul 19 19:49:57.339632 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1130/2253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:56 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:57.478204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7e7cc214-d050-495b-b783-07f9c420cd0a req-89c999a3-d961-4be0-9164-7f1e9ac1f0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "name": "network-vif-unplugged", "status": "completed", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:57.487621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7e7cc214-d050-495b-b783-07f9c420cd0a req-89c999a3-d961-4be0-9164-7f1e9ac1f0cc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.488401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7e7cc214-d050-495b-b783-07f9c420cd0a req-89c999a3-d961-4be0-9164-7f1e9ac1f0cc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.515958 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7e7cc214-d050-495b-b783-07f9c420cd0a req-89c999a3-d961-4be0-9164-7f1e9ac1f0cc service nova] Creating event network-vif-unplugged:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h1-843834-3 Jul 19 19:49:57.521795 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7e7cc214-d050-495b-b783-07f9c420cd0a req-89c999a3-d961-4be0-9164-7f1e9ac1f0cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180739 Jul 19 19:49:57.522495 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1131/2254] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:49:57.530286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:57.531192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:57.540963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.541663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.542669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.543384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.610764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:49:57.759470 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-135879e6-b7f9-48b9-94c9-037dc51f7ad7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 204 len: 0 microversion: 2.1 time: 0.235033 Jul 19 19:49:57.760882 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1132/2255] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:49:57 2022] DELETE /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:57.769569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:57.770629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:57.780296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.781351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:57.782692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:57.783536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.468695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:58.482866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44a12892-1f32-4134-a57e-1495c5ab994f tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1390 microversion: 2.1 time: 0.719769 Jul 19 19:49:58.484569 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1133/2256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:57 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1390 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:58.496771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:58.497287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] [instance: 4902e252-a7e8-4567-967d-cb20e9b87cf4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.504863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.505876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.507071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.507659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.522768 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] HTTP exception thrown: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Request method failure captured: Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 HTTP/1.1 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqWaPPRVPKsbIq1SQ3VH8CHwqR_5oYlYKl-H8PJ575mjfioCVnMXqjckyCDknVqNGtH9_cbzXsB25USw8dRgRen10N0Me850Zr2jykpsTt0seG4Tkb2NzOuV_VXzf9JnxajQHUrvePpgWaYwiZ_xHnJ24Veev99YUOZzR4hFdIro9g Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d3247cd3d0104132aaa309e86515ccae Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-517887530 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3247cd3d0104132aaa309e86515ccae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3247cd3d0104132aaa309e86515ccae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3247cd3d0104132aaa309e86515ccae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3247cd3d0104132aaa309e86515ccae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-517887530 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d3247cd3d0104132aaa309e86515ccae Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-517887530 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-517887530-project Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 2d0e2529545b4a778238fe8bcc7a0fd0 Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-517887530-project Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '4902e252-a7e8-4567-967d-cb20e9b87cf4'} Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:58.524725 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. Jul 19 19:49:58.528866 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:49:58.530765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Returning 404 to user: Instance 4902e252-a7e8-4567-967d-cb20e9b87cf4 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:49:58.531815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97f4bafb-2b0b-4934-92a3-f04e7c6399aa tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4" status: 404 len: 111 microversion: 2.1 time: 0.046107 Jul 19 19:49:58.532852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1134/2257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:58 2022] GET /compute/v2.1/servers/4902e252-a7e8-4567-967d-cb20e9b87cf4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:49:58.537776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:58.538524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:58.541769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:49:58.548993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.549604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.550873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:58.551475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:58.588240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lazy-loading 'flavor' on Instance uuid 7b46ac79-be21-4f59-b714-0d63bcf29ce7 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:49:59.017095 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa4e95d7-8f76-494f-a236-3d0dd297c83f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/action" status: 202 len: 0 microversion: 2.20 time: 0.482754 Jul 19 19:49:59.018591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1135/2258] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:49:58 2022] POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:49:59.029266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1880837089", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "37635a60-68cb-4791-83ae-ac3a6be38a37"}], "security_groups": [{"name": "tempest-securitygroup--1879525524"}], "key_name": "tempest-keypair-740790480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:49:59.033115 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b223ec4-a553-420d-a206-383c68329c3b tempest-FloatingIPDetailsTestJSON-1835074372 tempest-FloatingIPDetailsTestJSON-1835074372-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/8431438f-2c97-40c5-91d4-d400693ce829" status: 202 len: 0 microversion: 2.1 time: 4.706593 Jul 19 19:49:59.034360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1124/2259] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:49:54 2022] DELETE /compute/v2.1/os-floating-ips/8431438f-2c97-40c5-91d4-d400693ce829 => generated 0 bytes in 4708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:49:59.039358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.042930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.063182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.065315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.067540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.071552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.720964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] validate_networks() for [('37635a60-68cb-4791-83ae-ac3a6be38a37', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:49:59.948367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:49:59.958386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7a99e50-fc69-490e-bc54-bbb9f95febad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.922872 Jul 19 19:49:59.959174 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1125/2260] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:49:59.964754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:49:59.965718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:49:59.971796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.972251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:49:59.973026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:49:59.973464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.533977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:00.547830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0802b8cb-df3c-4a8c-96dd-737fefd37c62 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.587505 Jul 19 19:50:00.548755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1126/2261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:49:59 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:00.554663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68f3cb42-ea94-45f0-be92-8488ad3b589a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] Calling method '.version_select at 0x7f23ef72d280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.603810 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68f3cb42-ea94-45f0-be92-8488ad3b589a tempest-ServersTestJSON-517887530 tempest-ServersTestJSON-517887530-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932459534" status: 202 len: 0 microversion: 2.1 time: 0.053805 Jul 19 19:50:00.604451 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1127/2262] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932459534 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:00.610117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:00.624097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:00.639276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.640369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:00.641509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:00.642741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.507093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.516692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.519066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:01.521050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cfc17137-24e2-4b59-aef5-323b12a8426e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.914910 Jul 19 19:50:01.533552 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1128/2263] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:00 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:01.538687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:01.540024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:01.546386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.546934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.547866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.548496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.600631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:01.601580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:01.602198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:01.603383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:01.604095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:01.613947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.614615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.615735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.616573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.636877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:01.642568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for user 0170aafaff4847149210c7b6b73862cf and project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:01.660855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:01.663678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:01.741279 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3a6d082f-0928-4699-b23d-742b70a76783 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.720853 Jul 19 19:50:01.747118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1136/2264] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:49:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:01.768751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0cd787d0-1c40-4f01-9866-d7bc5b42e000 req-65c8bcff-8267-4c66-846f-530c56939cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "tag": "f1a4bed6-e5ea-4144-83e0-5086cb196cb6"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:01.787937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0cd787d0-1c40-4f01-9866-d7bc5b42e000 req-65c8bcff-8267-4c66-846f-530c56939cd7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.788304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0cd787d0-1c40-4f01-9866-d7bc5b42e000 req-65c8bcff-8267-4c66-846f-530c56939cd7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.819638 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0cd787d0-1c40-4f01-9866-d7bc5b42e000 req-65c8bcff-8267-4c66-846f-530c56939cd7 service nova] Creating event network-changed:f1a4bed6-e5ea-4144-83e0-5086cb196cb6 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:01.825369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0cd787d0-1c40-4f01-9866-d7bc5b42e000 req-65c8bcff-8267-4c66-846f-530c56939cd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077084 Jul 19 19:50:01.826598 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1137/2265] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:01.832543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:01.833432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:01.842800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.843948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:01.845235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:01.845907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.187737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:02.199489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b06810e-d23e-48d7-8ed8-fcd409c32c05 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1380 microversion: 2.1 time: 0.664444 Jul 19 19:50:02.202491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1129/2266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:01 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1380 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.210399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.211527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.219814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.220492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.221683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.222356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.537994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:02.549481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e96ad1cd-0211-4443-b93d-b7db29d95774 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.721154 Jul 19 19:50:02.550200 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1138/2267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:01 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.556267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.557770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.566742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.568398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.570150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.570870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.776130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:02.785724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-66888e06-e3c8-453c-9f33-e253ceb026b1 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1293 microversion: 2.1 time: 0.233974 Jul 19 19:50:02.786563 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1139/2268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1293 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.792008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aab14077-7369-4537-b4e5-d54afd6d7d28 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '.version_select at 0x7f23eefa3e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.795143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab14077-7369-4537-b4e5-d54afd6d7d28 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.795766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aab14077-7369-4537-b4e5-d54afd6d7d28 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.808622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:02.824729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aab14077-7369-4537-b4e5-d54afd6d7d28 tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1555 microversion: 2.1 time: 0.036793 Jul 19 19:50:02.826416 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1140/2269] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/os-migrations => generated 1555 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.838160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.841834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:02.843308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.852636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.853126 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9eca5f36-3500-435f-8c82-ce5c02422900 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.647813 Jul 19 19:50:02.853599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.860003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.863043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.864320 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1130/2270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:02.878609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:02.879259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:02.894937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.895405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:02.896471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:02.896964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.322168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:03.393255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:03.879067 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28d16c13-17cc-457a-9ae8-0115c6845d4f tempest-LiveMigrationTest-1643441222 tempest-LiveMigrationTest-1643441222-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1531 microversion: 2.1 time: 1.013488 Jul 19 19:50:03.880150 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1131/2271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1531 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:03.886808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:03.888088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:03.899775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:03.913573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:03.917196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:03.918354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.920540 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc2d26f8-c1a6-4661-9b57-71663ad56ab8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 1.089642 Jul 19 19:50:03.920794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.921809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.931296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.933523 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1141/2272] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:02 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:03.939469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:03.941700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:03.955881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.956726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:03.957749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:03.958382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.168272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:04.176576 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5ecc8f8-0c3a-4280-ad68-ee0814e9da4b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1299 microversion: 2.1 time: 0.241567 Jul 19 19:50:04.186498 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1142/2273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:03 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:04.192439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.193109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.201049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.201643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.202435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.202938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.598349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:04.610804 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19e44d49-47ba-4109-a685-4bb8f6c341dd tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.422810 Jul 19 19:50:04.613417 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1143/2274] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:04 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:04.635631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.636942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.654262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.655108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.657281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.658148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.683584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:04.697445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57609c56-ad25-45f1-bbdd-2f105662cc28 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.815934 Jul 19 19:50:04.698065 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1132/2275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:03 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:04.712220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9c67d675-38b2-44b4-ad8b-38165eb5044b req-5cfd5fee-ea3f-42f9-9537-b74f5c390d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c29567f-8e52-4670-8590-fef766eb4309", "tag": "cd441f07-0d23-4594-b703-1ac281daa825"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:04.736573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:04.752935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9c67d675-38b2-44b4-ad8b-38165eb5044b req-5cfd5fee-ea3f-42f9-9537-b74f5c390d78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.753414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9c67d675-38b2-44b4-ad8b-38165eb5044b req-5cfd5fee-ea3f-42f9-9537-b74f5c390d78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.788628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9c67d675-38b2-44b4-ad8b-38165eb5044b req-5cfd5fee-ea3f-42f9-9537-b74f5c390d78 service nova] Creating event network-changed:cd441f07-0d23-4594-b703-1ac281daa825 for instance 8c29567f-8e52-4670-8590-fef766eb4309 on n-h2-843834-3 Jul 19 19:50:04.800060 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9c67d675-38b2-44b4-ad8b-38165eb5044b req-5cfd5fee-ea3f-42f9-9537-b74f5c390d78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089758 Jul 19 19:50:04.801805 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1133/2276] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:04.880593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca357ca1-6488-430f-b97f-8eda4d5c36c2 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 204 len: 0 microversion: 2.1 time: 0.262590 Jul 19 19:50:04.881254 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1144/2277] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:04 2022] DELETE /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:04.889993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.891395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.913456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.917004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.918050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.918706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.948730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:04.950079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:04.959541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.960164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:04.965923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:04.966380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.576917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.588810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.591641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.597210 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55723229-b72b-4c15-9a9b-350e336d78d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.653557 Jul 19 19:50:05.601979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:05.604887 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1145/2278] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:04 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:05.617522 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91e920b2-a54b-4f2f-8b34-ef00c9079a0c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1386 microversion: 2.1 time: 0.731622 Jul 19 19:50:05.627506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1134/2279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:04 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1386 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:05.629638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.632169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.635573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:05.641571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:05.655667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.656882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.657070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.658972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.659595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.660637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:05.661151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:05.661702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.680908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.688242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:06.698219 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cedf9c36-96ed-4fe7-a232-bf103d26fc91 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 1.070909 Jul 19 19:50:06.707048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b4b2268-312c-4438-bbd2-88d209f5e7ea tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 1.100823 Jul 19 19:50:06.707904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1146/2280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:05 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:06.710015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1135/2281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:05 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:06.722807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.723704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.730805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.731568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.732547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.733127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.734256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-fb6398c7-3b4d-4db6-ab82-523c3e5294ef req-486aca5b-43f1-44f0-bda6-c7c2abe4ed7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63896c76-b7b6-43ca-8b9d-ed5d38a91c15", "tag": "ab753503-9da1-460d-bf01-3c93dd1ecd3b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:06.758499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fb6398c7-3b4d-4db6-ab82-523c3e5294ef req-486aca5b-43f1-44f0-bda6-c7c2abe4ed7a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.759789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fb6398c7-3b4d-4db6-ab82-523c3e5294ef req-486aca5b-43f1-44f0-bda6-c7c2abe4ed7a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.786940 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-fb6398c7-3b4d-4db6-ab82-523c3e5294ef req-486aca5b-43f1-44f0-bda6-c7c2abe4ed7a service nova] Creating event network-changed:ab753503-9da1-460d-bf01-3c93dd1ecd3b for instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 on n-h2-843834-3 Jul 19 19:50:06.793813 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-fb6398c7-3b4d-4db6-ab82-523c3e5294ef req-486aca5b-43f1-44f0-bda6-c7c2abe4ed7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082181 Jul 19 19:50:06.795035 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1136/2282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:06.803981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:06.804938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:06.814017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.815307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:06.816295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:06.816889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.508388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.518719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a48b750-09a2-4acf-a7b1-ee19dbdcd2e6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.809276 Jul 19 19:50:07.530199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1147/2283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:07.535519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.536378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.544306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.545070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.546044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.546634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.557522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.571416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.573469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:07.575275 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1aa21261-8d3d-4009-81d7-bbbd627fc109 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.777483 Jul 19 19:50:07.587909 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1137/2284] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:06 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:07.593111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3269fc41-d180-4f57-ba29-b53f16160b40 req-87a6d0e5-f498-43ce-8d6b-f57078ae3001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "tag": "fc27859b-1d1b-4178-b567-f705e4eae269"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:07.603726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3269fc41-d180-4f57-ba29-b53f16160b40 req-87a6d0e5-f498-43ce-8d6b-f57078ae3001 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.604440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3269fc41-d180-4f57-ba29-b53f16160b40 req-87a6d0e5-f498-43ce-8d6b-f57078ae3001 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.632737 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3269fc41-d180-4f57-ba29-b53f16160b40 req-87a6d0e5-f498-43ce-8d6b-f57078ae3001 service nova] Creating event network-changed:fc27859b-1d1b-4178-b567-f705e4eae269 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:07.638491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3269fc41-d180-4f57-ba29-b53f16160b40 req-87a6d0e5-f498-43ce-8d6b-f57078ae3001 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048880 Jul 19 19:50:07.651388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1138/2285] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:07.940112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:07.941674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:07.951299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.951983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:07.953598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:07.954193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.004064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:08.175350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd1af25a-3372-408b-9540-d82cb67fe373 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 204 len: 0 microversion: 2.42 time: 0.517402 Jul 19 19:50:08.176160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1139/2286] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:50:07 2022] DELETE /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:50:08.187726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.192877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.211664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.212238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.213196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.213734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.536440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:08.551558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6cca0ea5-c812-45ba-b97e-d896f2d43430 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1386 microversion: 2.1 time: 1.019953 Jul 19 19:50:08.552480 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1148/2287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:07 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1386 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:08.557166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:08.567849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:08.575820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.576263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:08.577055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:08.577497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.264012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.272260 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-877807bd-982d-4ef5-9ac1-456f5db79ee9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 1.091697 Jul 19 19:50:09.272768 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1140/2288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:09.288220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.288806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.314296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.319143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.321323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.322037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.343952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:09.386328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.398250 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-810c6899-bc9c-40ef-b268-936c06906bcb tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.844613 Jul 19 19:50:09.398852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1149/2289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:08 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:09.404138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.404949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.412559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.413196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.414147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.415367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.743004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.751437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.767040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.769479 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9ff5e04-bea2-4f59-bca6-406abfe33ef4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.369114 Jul 19 19:50:09.771189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:09.772488 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1150/2290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:09.776180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4f59c2f6-581c-47f5-a525-6df9ccef6069 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2960 microversion: 2.42 time: 0.495419 Jul 19 19:50:09.779772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1141/2291] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2960 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:09.785137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.785979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.804848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:09.805515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:09.812706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.813209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.814047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.814524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.824321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.829972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:09.831682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:09.832690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.020465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.035765 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7baa0b0-0b93-4319-9060-dee330370cc1 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1182 microversion: 2.1 time: 0.253027 Jul 19 19:50:10.036729 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1142/2292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1182 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:10.051511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-65e8d06e-674c-4512-acc0-9708e9b88fc8 req-3c5504ca-d91b-436a-906c-6ef56fdd3f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f9b62-43ce-40c1-9698-73742bad2cda", "name": "network-vif-deleted", "tag": "1c8d4ce4-5040-475d-8ccc-73deabd1f566"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:10.061522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65e8d06e-674c-4512-acc0-9708e9b88fc8 req-3c5504ca-d91b-436a-906c-6ef56fdd3f8f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.062439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65e8d06e-674c-4512-acc0-9708e9b88fc8 req-3c5504ca-d91b-436a-906c-6ef56fdd3f8f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.081930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-65e8d06e-674c-4512-acc0-9708e9b88fc8 req-3c5504ca-d91b-436a-906c-6ef56fdd3f8f service nova] Creating event network-vif-deleted:1c8d4ce4-5040-475d-8ccc-73deabd1f566 for instance 365f9b62-43ce-40c1-9698-73742bad2cda on n-h2-843834-3 Jul 19 19:50:10.091549 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-65e8d06e-674c-4512-acc0-9708e9b88fc8 req-3c5504ca-d91b-436a-906c-6ef56fdd3f8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043639 Jul 19 19:50:10.093408 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1143/2293] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:10.130176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.142157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.145869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.148228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6131cde5-2508-492f-a32d-36ccfa73bd55 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.373420 Jul 19 19:50:10.149400 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1151/2294] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:09 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:10.291904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:10.294293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:10.314214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.316245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.321927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.322765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.415313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:10.417186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:10.429767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.433803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.435217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.441743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.921815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:10.940781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60a4bce2-c36d-466e-b528-0ab2c9104249 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 0.654464 Jul 19 19:50:10.942297 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1144/2295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:10 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:10.950772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b8abc3c5-f718-40e5-ae76-0dccfefa7a8b req-78e04c8f-c87f-4599-baee-81afde818342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c29567f-8e52-4670-8590-fef766eb4309", "name": "network-vif-plugged", "status": "completed", "tag": "cd441f07-0d23-4594-b703-1ac281daa825"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:10.963219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8abc3c5-f718-40e5-ae76-0dccfefa7a8b req-78e04c8f-c87f-4599-baee-81afde818342 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:10.963953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8abc3c5-f718-40e5-ae76-0dccfefa7a8b req-78e04c8f-c87f-4599-baee-81afde818342 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:10.979742 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b8abc3c5-f718-40e5-ae76-0dccfefa7a8b req-78e04c8f-c87f-4599-baee-81afde818342 service nova] Creating event network-vif-plugged:cd441f07-0d23-4594-b703-1ac281daa825 for instance 8c29567f-8e52-4670-8590-fef766eb4309 on n-h2-843834-3 Jul 19 19:50:10.986043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b8abc3c5-f718-40e5-ae76-0dccfefa7a8b req-78e04c8f-c87f-4599-baee-81afde818342 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042186 Jul 19 19:50:11.002134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.017899 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1145/2296] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:11.066370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.068230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.072528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ec7754a-1739-4ddf-bfd8-1be7318c47d7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.662167 Jul 19 19:50:11.081005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1152/2297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:10 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:11.089073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.091093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.091919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.102460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.102623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.103439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.104565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.105529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.105787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.107067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.626614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:11.652987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:11.690842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.699459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.711519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35ba54eb-385c-454c-8bb5-f552720cf152 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.688022 Jul 19 19:50:11.718377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1146/2298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:11.726992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.729304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.731698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:11.734314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.740966 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c76cfb61-e072-426a-87a4-622b1ed677c8 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2960 microversion: 2.42 time: 0.658804 Jul 19 19:50:11.741855 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1153/2299] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2960 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:11.749521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:11.751591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.752102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.753340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:11.753785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.754390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.768632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.773662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:11.774811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:11.775859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.120652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.134415 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23a5899b-83fa-43db-947a-6bbf09edafdd tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1182 microversion: 2.1 time: 0.414151 Jul 19 19:50:12.142944 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1147/2300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1182 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:12.147652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:12.147787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:12.158061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.158543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.159417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.183569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.518619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.529842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.535531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.538120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c838cb1-0b91-4130-bc3e-95785fe2672f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.794802 Jul 19 19:50:12.538718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1154/2301] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:11 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:12.552457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:12.553693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:12.603339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.607194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.612488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:12.613350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:12.668911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:12.678394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-45f5cca7-3265-4a4c-af54-e255ab1e7ca9 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 0.541987 Jul 19 19:50:12.681588 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1148/2302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:12 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:12.923109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-629047552", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:12.981085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:14.225856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:14.228767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:14.242617 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45ed98d8-fb99-4063-9707-ce6245480ad5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 1.693890 Jul 19 19:50:14.244480 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1155/2303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:12 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:14.258808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:14.262733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:14.280305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.280788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.286584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.287384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.714008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:14.724543 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebe044cf-f8a9-4eb7-b02f-2266db766e70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1315 microversion: 2.1 time: 0.478627 Jul 19 19:50:14.729073 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1156/2304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:14 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:14.734498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:14.743921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:14.754671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.755560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.756542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.761279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.873853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:14.874799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:14.875453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:14.876011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:14.879445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:14.904706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.905160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.905973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:14.906409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:14.961310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Getting quotas for project d1f434859ea049848dc1ed47fc05cb60. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:14.969467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Getting quotas for user 882f7f3c47fa4ab19c97916f9d2961a7 and project d1f434859ea049848dc1ed47fc05cb60. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:14.996606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:14.998969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:15.092689 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27ac84b7-f368-4d87-9968-27eb8cb48d2c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.398137 Jul 19 19:50:15.093411 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1149/2305] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:15.133056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.133993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.146807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.150577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.153628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.155565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.333068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.344054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.347504 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4cd8317-2bc6-4967-a5a7-988f0dd3f500 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 200 len: 1182 microversion: 2.1 time: 0.245080 Jul 19 19:50:15.356118 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1150/2306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 1182 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:15.361368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.365547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:15.369060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee52ac3a-9ebd-454e-8f33-4772f7fabb5e tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2960 microversion: 2.42 time: 0.636563 Jul 19 19:50:15.375562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.378503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.382818 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1157/2307] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:14 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2960 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:15.396758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:15.397377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:15.406717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.408525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.410608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.411227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.413196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.413562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:15.414043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:15.417492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.334405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.352637 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e015f743-ca76-473c-bbda-1c28b10caa2b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 0.968596 Jul 19 19:50:16.354903 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1158/2308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:16.362063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2cd4ee93-c46c-43c0-ab6d-6ee4077c8736 req-fd44d5f1-dcc5-48ca-9c4b-bbcadf9f505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "38d23398-5706-4a45-866a-d09a387294c0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:16.388393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2cd4ee93-c46c-43c0-ab6d-6ee4077c8736 req-fd44d5f1-dcc5-48ca-9c4b-bbcadf9f505a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.389277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2cd4ee93-c46c-43c0-ab6d-6ee4077c8736 req-fd44d5f1-dcc5-48ca-9c4b-bbcadf9f505a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.414428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2cd4ee93-c46c-43c0-ab6d-6ee4077c8736 req-fd44d5f1-dcc5-48ca-9c4b-bbcadf9f505a service nova] Creating event network-vif-unplugged:38d23398-5706-4a45-866a-d09a387294c0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:16.420749 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2cd4ee93-c46c-43c0-ab6d-6ee4077c8736 req-fd44d5f1-dcc5-48ca-9c4b-bbcadf9f505a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064349 Jul 19 19:50:16.422182 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1159/2309] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:16.442221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.443522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:16.451481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.452473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.455024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.455751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.473297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.491236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.499002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.503724 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fae29925-4475-4827-a7f6-9df8911f3f3a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 1.144734 Jul 19 19:50:16.508834 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1151/2310] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:15 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:16.522637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.523691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:16.531399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.532196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.533420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.534127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.799487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:16.810336 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bfe193e5-9d51-43b8-b544-fd2f7c932306 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1212 microversion: 2.1 time: 0.384590 Jul 19 19:50:16.816943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1160/2311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:16 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1212 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:16.823338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:16.831307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:16.847634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.848477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.850055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:16.851024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:16.990471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:17.004161 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7675f6a3-acc3-4a90-b0e4-cd97a89a200a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.492590 Jul 19 19:50:17.004803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1152/2312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:16 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:17.009791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6e84eb55-d748-4035-b99f-d6d037cf6f5c req-65775fb3-a7e5-403b-a2a1-62d0d6ed1a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c29567f-8e52-4670-8590-fef766eb4309", "name": "network-vif-deleted", "tag": "cd441f07-0d23-4594-b703-1ac281daa825"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:17.037991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6e84eb55-d748-4035-b99f-d6d037cf6f5c req-65775fb3-a7e5-403b-a2a1-62d0d6ed1a53 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.038689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6e84eb55-d748-4035-b99f-d6d037cf6f5c req-65775fb3-a7e5-403b-a2a1-62d0d6ed1a53 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.063707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6e84eb55-d748-4035-b99f-d6d037cf6f5c req-65775fb3-a7e5-403b-a2a1-62d0d6ed1a53 service nova] Creating event network-vif-deleted:cd441f07-0d23-4594-b703-1ac281daa825 for instance 8c29567f-8e52-4670-8590-fef766eb4309 on n-h2-843834-3 Jul 19 19:50:17.076412 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6e84eb55-d748-4035-b99f-d6d037cf6f5c req-65775fb3-a7e5-403b-a2a1-62d0d6ed1a53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070353 Jul 19 19:50:17.078207 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1153/2313] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:17.087541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.088383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 365f9b62-43ce-40c1-9698-73742bad2cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.104204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.106451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.107527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.113359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.143806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] HTTP exception thrown: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. Jul 19 19:50:17.148400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Request method failure captured: Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda HTTP/1.1 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wlvA-ms7dgXHRjaFYpm_R9ma7rUy54f5nZgouuPUAfYkkxzF9rDr9JtNteRt06PwQPmjnqAhTl0dE_ytLzD2MyqbQY9eD_bsNWpH-gre0M2bfdESgivhQpp0c9eavEK9WoaWgd8eO58KioA9GRaotcWj-q_tkRpLIgJGsZvQDB7RVc Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a15f9dbf22624cb49d4d817fed35e3b5 Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '365f9b62-43ce-40c1-9698-73742bad2cda'} Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:17.149241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Returning 404 to user: Instance 365f9b62-43ce-40c1-9698-73742bad2cda could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:17.155015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cd82b75-3eb6-469e-9738-1a8751fbba2c tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda" status: 404 len: 111 microversion: 2.1 time: 0.073992 Jul 19 19:50:17.160082 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1154/2314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/365f9b62-43ce-40c1-9698-73742bad2cda => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:17.168207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.176302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.186343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be48f446-3387-49e5-9874-cac14d11df37 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1294 microversion: 2.1 time: 0.365836 Jul 19 19:50:17.189187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.189316 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1161/2315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:16 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1294 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:17.189938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.190949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.192650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.371992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:17.372619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:17.388928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.388928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:17.388928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:17.388928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.922800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:18.944413 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-69fdd4bf-e76d-43ba-9fce-c5d506d8f7d8 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 1.576893 Jul 19 19:50:18.946328 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1162/2316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:18.963533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:18.965045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:18.984338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.985209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:18.986292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:18.986938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.212144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.239201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.242134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.244349 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9322184b-2db9-4554-882d-c69df767a7fe tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2939 microversion: 2.42 time: 2.082988 Jul 19 19:50:19.247824 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1155/2317] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:17 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2939 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:19.258989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.259915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.284006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.285566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.293923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.297049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.602307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:19.612840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-86313fef-2937-4569-a787-3250d959d4f7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1274 microversion: 2.1 time: 0.362910 Jul 19 19:50:19.614429 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1156/2318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:19 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1274 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:19.628246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:19.632367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:19.646834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.652917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:19.654437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:19.655190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.245827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.279187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.280998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.282437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97fb49fb-b635-497e-9982-0aa2c7e5eedb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 1.333955 Jul 19 19:50:20.299060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1163/2319] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:18 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:20.308359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:20.309374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:20.316611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.317874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.319636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.320574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.382122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:20.387758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:20.388549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lazy-loading 'fault' on Instance uuid 8c29567f-8e52-4670-8590-fef766eb4309 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:20.981489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:20.991720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62e1c0ff-122b-4bc8-84e3-4a3d58e35851 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 1.374429 Jul 19 19:50:20.993949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1157/2320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:19 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:21.007617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "7168f45a-88d6-4b33-8b84-0152aeee34d0"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "b2de3852-6a7d-42da-8fb1-52ee4948ff67"}, {"server_uuid": "63896c76-b7b6-43ca-8b9d-ed5d38a91c15", "name": "network-vif-plugged", "status": "completed", "tag": "ab753503-9da1-460d-bf01-3c93dd1ecd3b"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "5911f022-61d0-4f7e-b597-1a2a6e26d952"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "eb5c3e1a-e4db-4ce9-b757-7d758d2f333c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:21.032955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.035533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.084939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:21.097419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Creating event network-vif-unplugged:7168f45a-88d6-4b33-8b84-0152aeee34d0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:21.099119 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b5d8df9d-2bb2-4c27-89b1-db4a016d481c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 200 len: 1305 microversion: 2.1 time: 0.796249 Jul 19 19:50:21.101641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Creating event network-vif-unplugged:b2de3852-6a7d-42da-8fb1-52ee4948ff67 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:21.104982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1164/2321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:20 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 1305 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:21.105829 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Creating event network-vif-plugged:ab753503-9da1-460d-bf01-3c93dd1ecd3b for instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 on n-h2-843834-3 Jul 19 19:50:21.107158 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Creating event network-vif-unplugged:5911f022-61d0-4f7e-b597-1a2a6e26d952 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:21.109230 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] Creating event network-vif-unplugged:eb5c3e1a-e4db-4ce9-b757-7d758d2f333c for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:21.125235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:21.130100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:21.147913 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-846483d7-d45b-49d4-9d6a-a20a23503554 req-82c30c18-fa7c-4224-94b6-ffb835d2bb67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.151641 Jul 19 19:50:21.148544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1158/2322] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:21.151709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.157235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.158337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.161637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:21.163205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.168844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:21.195326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.195780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:21.196556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:21.215105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.741828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.756888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.762404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.774261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e0226e5-15e9-4c17-801d-7a21b8b185a7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1367 microversion: 2.1 time: 1.662990 Jul 19 19:50:22.782402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:22.787284 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1165/2323] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:21 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1367 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:22.794839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8522c73b-f9b8-4db6-8000-335646909835 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2918 microversion: 2.42 time: 1.636612 Jul 19 19:50:22.797227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:22.798759 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1159/2324] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:21 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2918 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:22.802261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:22.814720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:22.824943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:22.826866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.829307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.833191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.833941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.852456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.852922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:22.864663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:22.866517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.245245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:24.261687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:24.275123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:24.280393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac7fb062-2a3d-417e-b665-3f8f4c7d14e4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 1.480466 Jul 19 19:50:24.284042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1160/2325] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:22 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:24.304230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.304856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:24.318498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:24.331573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.332429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.333413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.334022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.608097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:24.625354 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b6440da-96b7-49da-83de-5f9843355597 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 1.836521 Jul 19 19:50:24.634548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1166/2326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:22 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:24.638972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.647449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:24.711218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.712402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.718036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.719194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.780660 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 HTTP/1.1 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8c29567f-8e52-4670-8590-fef766eb4309'} Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:24.787069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:50:24.791036 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:24.795704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:24.797837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6117c9af-9c45-4359-a499-ad5aefec86b6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 404 len: 111 microversion: 2.1 time: 0.170936 Jul 19 19:50:24.799630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1167/2327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:24.818375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "f3487fb2-62f8-4a73-8c6a-542f7178db5a"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "e7f8c7bc-de24-488d-9351-3eb0517f2947"}, {"server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "name": "network-vif-plugged", "status": "completed", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}, {"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-plugged", "status": "completed", "tag": "f1a4bed6-e5ea-4144-83e0-5086cb196cb6"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:24.850100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.856464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.911350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Creating event network-vif-unplugged:f3487fb2-62f8-4a73-8c6a-542f7178db5a for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:24.912772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Creating event network-vif-unplugged:e7f8c7bc-de24-488d-9351-3eb0517f2947 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:24.918523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Creating event network-vif-plugged:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h1-843834-3 Jul 19 19:50:24.919583 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] Creating event network-vif-plugged:f1a4bed6-e5ea-4144-83e0-5086cb196cb6 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:24.925993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:24.940086 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c003c74e-10c6-4bfb-9838-d4c63ffea4d5 req-505eff04-d442-49a2-aa6f-686f362b3df7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.136132 Jul 19 19:50:24.944012 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1168/2328] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:24.961016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:24.962038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:24.977448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.980499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.982315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:24.983281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:24.986669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:25.250927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.254484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:25.263720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-194493d3-fa84-4c1e-9d37-ff76dbb47d84 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.975461 Jul 19 19:50:25.267747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1161/2329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:25.277720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:25.281971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:25.298854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.301322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.302351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.306804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.707817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.720122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fab8f320-bf30-4956-a19b-ae37170a05a3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1557 microversion: 2.1 time: 0.772576 Jul 19 19:50:25.721681 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1169/2330] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:24 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1557 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:25.734579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:25.736457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:25.751594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.753829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.754948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:25.758104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:25.821092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.825034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:25.836330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.853972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:25.858684 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9bb2eba3-c913-47cc-9965-88b978b5be0c tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2918 microversion: 2.42 time: 0.589523 Jul 19 19:50:25.860942 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1162/2331] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:25 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2918 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:25.872707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1485365703", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:25.972758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:50:26.030053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90b6a311-81f6-471a-988c-df783e3afac5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 204 len: 0 microversion: 2.1 time: 0.304040 Jul 19 19:50:26.033550 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1170/2332] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:25 2022] DELETE /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:26.045361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.051771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.061365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:26.071144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.085133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.086348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.087025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.717892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:26.728361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:26.733394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:26.734690 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40526bc0-fbd4-4cfb-bc5b-16f3e63e7114 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.699571 Jul 19 19:50:26.739107 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1171/2333] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:26.748151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:26.748784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:26.769323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.770298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.771159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:26.774131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:26.819859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:27.597591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:27.606136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf63c1bb-0630-4dff-86c7-4bd7636077bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 0.865343 Jul 19 19:50:27.607375 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1172/2334] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:26 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:27.615400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:27.616335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:27.632967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.634437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:27.636956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:27.637797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.578260 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41d04712-d049-46bb-a70b-1947d5d8dfd4 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.969400 Jul 19 19:50:28.579081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1173/2335] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:50:27 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-interface => generated 285 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:28.594465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:28.595163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:28.615416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.615873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.616671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.631454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.941672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:50:28.942835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:50:28.943556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:50:28.944347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:50:28.944979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:50:28.965436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.970666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:28.975442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:28.976518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.021487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:29.036186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:29.068054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:50:29.071115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:50:29.147393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19b6c79c-4a0d-4645-a550-ce4205f83551 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.284753 Jul 19 19:50:29.151807 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1163/2336] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:50:29.161645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:29.166361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:29.181915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.182841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.189816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.194867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.635527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:29.644534 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-075adcf2-7a20-4b70-b19d-d474d3992cd8 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1664 microversion: 2.1 time: 1.063880 Jul 19 19:50:29.655703 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1174/2337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:28 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1664 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:29.667581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:29.679267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:29.701199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.702645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:29.705103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:29.705632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.299820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:30.312550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f09ee4c-f8da-4955-8efd-80ddfd4d5ee0 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 1.159030 Jul 19 19:50:30.327894 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1164/2338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:29 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:30.364088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7e3a10e7-a17c-4362-b230-b5a49229689a req-9f6c5d02-8978-46db-afbc-1d39cc8d9e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-plugged", "status": "completed", "tag": "fc27859b-1d1b-4178-b567-f705e4eae269"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:30.407533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7e3a10e7-a17c-4362-b230-b5a49229689a req-9f6c5d02-8978-46db-afbc-1d39cc8d9e78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.408577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7e3a10e7-a17c-4362-b230-b5a49229689a req-9f6c5d02-8978-46db-afbc-1d39cc8d9e78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.464055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7e3a10e7-a17c-4362-b230-b5a49229689a req-9f6c5d02-8978-46db-afbc-1d39cc8d9e78 service nova] Creating event network-vif-plugged:fc27859b-1d1b-4178-b567-f705e4eae269 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:30.482579 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7e3a10e7-a17c-4362-b230-b5a49229689a req-9f6c5d02-8978-46db-afbc-1d39cc8d9e78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149473 Jul 19 19:50:30.499167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1165/2339] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:30.544730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-80f4d528-0bcb-46c8-8540-e1161fb93a5b req-99fd918f-1ea5-4fc5-a370-40490410ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-deleted", "tag": "5911f022-61d0-4f7e-b597-1a2a6e26d952"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:30.587666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-80f4d528-0bcb-46c8-8540-e1161fb93a5b req-99fd918f-1ea5-4fc5-a370-40490410ce85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.594354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-80f4d528-0bcb-46c8-8540-e1161fb93a5b req-99fd918f-1ea5-4fc5-a370-40490410ce85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.678844 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-80f4d528-0bcb-46c8-8540-e1161fb93a5b req-99fd918f-1ea5-4fc5-a370-40490410ce85 service nova] Creating event network-vif-deleted:5911f022-61d0-4f7e-b597-1a2a6e26d952 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:30.691066 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-80f4d528-0bcb-46c8-8540-e1161fb93a5b req-99fd918f-1ea5-4fc5-a370-40490410ce85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187349 Jul 19 19:50:30.692090 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1166/2340] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:30.719851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:30.722027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:30.735590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.736093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:30.736934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:30.737374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.328814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.343568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.352018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.353455 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2c599cc-adee-4db4-b856-9294b41b2ec4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2824 microversion: 2.42 time: 1.694273 Jul 19 19:50:31.354200 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1175/2341] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:29 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2824 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:31.370521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.371433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.384916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.385499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.388757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.389359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.671583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.683400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.685008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.694885 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1174af7d-40e4-408e-b8a3-5c34ad188aa6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.998227 Jul 19 19:50:31.695882 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1167/2342] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:30 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:31.704467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.708252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.721743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.723282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.725065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.726803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.864694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:31.876789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a5e49a5-1266-4309-b99d-5bb0545225b7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1267 microversion: 2.1 time: 0.177499 Jul 19 19:50:31.878018 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1168/2343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:31 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:31.882955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:31.883756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:31.892156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.892843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:31.893776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:31.894362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.009010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:32.011793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:32.017054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be82c904-b250-4d88-b7ca-1968a8005549 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 0.661610 Jul 19 19:50:32.026530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72e61c24-264f-4cee-af53-2d7f1d99c313 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 200 len: 1597 microversion: 2.1 time: 0.141454 Jul 19 19:50:32.026530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1169/2344] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:31 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 1597 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:32.027474 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1176/2345] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:31 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:32.029906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:32.030526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:32.037840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.038462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.039670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.040257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.251308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:32.262375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f885e289-891f-489d-a772-1d1e6dbac07b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1332 microversion: 2.1 time: 0.236322 Jul 19 19:50:32.263357 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1170/2346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:32 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:32.374084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:32.374704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:32.384530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.384999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.385779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.395178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.656653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-11cd0fdf-4564-4ebb-89a4-699664c07aa4 req-e0d5e06b-042f-4e56-b874-1c60861c0c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d531e1d-a523-45e5-a5b1-146c736db29a", "name": "network-vif-deleted", "tag": "5d300a49-8a9a-4e62-8366-0fc25b22c989"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:32.692410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-11cd0fdf-4564-4ebb-89a4-699664c07aa4 req-e0d5e06b-042f-4e56-b874-1c60861c0c0c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.703129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-11cd0fdf-4564-4ebb-89a4-699664c07aa4 req-e0d5e06b-042f-4e56-b874-1c60861c0c0c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.757033 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-11cd0fdf-4564-4ebb-89a4-699664c07aa4 req-e0d5e06b-042f-4e56-b874-1c60861c0c0c service nova] Creating event network-vif-deleted:5d300a49-8a9a-4e62-8366-0fc25b22c989 for instance 7d531e1d-a523-45e5-a5b1-146c736db29a on n-h1-843834-3 Jul 19 19:50:32.790481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-11cd0fdf-4564-4ebb-89a4-699664c07aa4 req-e0d5e06b-042f-4e56-b874-1c60861c0c0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.528514 Jul 19 19:50:32.792144 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1177/2347] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:50:32.824730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:32.830338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:32.861601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.864648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:32.866328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:32.869872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.338175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.353710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.357888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.362573 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7af6b2ac-fdb9-44ed-b359-0d7d0915b788 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.566861 Jul 19 19:50:33.363874 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1178/2348] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:32 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:33.375108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:33.375999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:33.387521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.392526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.393650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.394311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.436143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.453808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.456324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:33.457901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c857388-1062-4952-bfcd-720898d8905a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2484 microversion: 2.42 time: 1.088069 Jul 19 19:50:33.470503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1171/2349] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:32 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2484 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:33.476500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:33.478006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:33.484969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.485773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:33.486822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:33.487544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.004483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:34.023815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-47462908-77db-407e-a7e8-3daed9fe94d4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1273 microversion: 2.1 time: 0.653091 Jul 19 19:50:34.027489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1179/2350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1273 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:34.053548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.054227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: 7d531e1d-a523-45e5-a5b1-146c736db29a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:34.093702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.093852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.095675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.098078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.155009 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] HTTP exception thrown: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Request method failure captured: Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a HTTP/1.1 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlvA-ms7dgXHRjaFYpm_R9ma7rUy54f5nZgouuPUAfYkkxzF9rDr9JtNteRt06PwQPmjnqAhTl0dE_ytLzD2MyqbQY9eD_bsNWpH-gre0M2bfdESgivhQpp0c9eavEK9WoaWgd8eO58KioA9GRaotcWj-q_tkRpLIgJGsZvQDB7RVc Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a15f9dbf22624cb49d4d817fed35e3b5 Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7d531e1d-a523-45e5-a5b1-146c736db29a'} Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:34.161117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:34.165883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Returning 404 to user: Instance 7d531e1d-a523-45e5-a5b1-146c736db29a could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:34.166802 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dae93eb9-65b1-4c1f-9aa1-38e7f9880fc9 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a" status: 404 len: 111 microversion: 2.1 time: 0.138289 Jul 19 19:50:34.179092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:34 2022] GET /compute/v2.1/servers/7d531e1d-a523-45e5-a5b1-146c736db29a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:34.184212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-deleted", "tag": "38d23398-5706-4a45-866a-d09a387294c0"}, {"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-deleted", "tag": "e7f8c7bc-de24-488d-9351-3eb0517f2947"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:34.223732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.224185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.256030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Creating event network-changed:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:50:34.257001 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Creating event network-vif-deleted:38d23398-5706-4a45-866a-d09a387294c0 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:34.257871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] Creating event network-vif-deleted:e7f8c7bc-de24-488d-9351-3eb0517f2947 for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:34.269308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c3fb26be-c42b-4a1c-bc22-95635d3162ec req-4f4028ef-634c-4444-b901-bba8eff0e7ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.088829 Jul 19 19:50:34.270384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1181/2352] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:34.276211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.277386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:34.285074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.285871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.286943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.287727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.436616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:34.450215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4d2ae69-637d-4ec2-9a88-5288f631b36a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 0.977021 Jul 19 19:50:34.452650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1172/2353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:33 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:34.466512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b640f8f1-e3a9-4dd2-9263-4edd955ff868 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '.version_select at 0x7f23ef4d5670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.509749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b640f8f1-e3a9-4dd2-9263-4edd955ff868 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18681195" status: 202 len: 0 microversion: 2.1 time: 0.054588 Jul 19 19:50:34.517556 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1173/2354] 10.222.0.23 () {58 vars in 1214 bytes} [Tue Jul 19 19:50:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18681195 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:34.539752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:34.545059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:34.573305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.577139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:34.584951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:34.587173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.060712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.071977 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e57a1c7c-7e10-43cb-b248-9faa68edff08 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1667 microversion: 2.1 time: 0.800009 Jul 19 19:50:35.079965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1182/2355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:34 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1667 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:35.089193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:35.089807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:35.139538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.151284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.155248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.155865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.482269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.495523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.497495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:35.505049 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4adf1ed5-ffa3-4ffc-a671-fc15d75d2719 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.985141 Jul 19 19:50:35.506323 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1174/2356] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:34 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:35.517376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d91bf113-a471-43a8-a80f-a2b63186df9f req-5d639b44-235a-45fe-b7b3-cc0566d371d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63896c76-b7b6-43ca-8b9d-ed5d38a91c15", "tag": "ab753503-9da1-460d-bf01-3c93dd1ecd3b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:35.548271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d91bf113-a471-43a8-a80f-a2b63186df9f req-5d639b44-235a-45fe-b7b3-cc0566d371d8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.548988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d91bf113-a471-43a8-a80f-a2b63186df9f req-5d639b44-235a-45fe-b7b3-cc0566d371d8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.580666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d91bf113-a471-43a8-a80f-a2b63186df9f req-5d639b44-235a-45fe-b7b3-cc0566d371d8 service nova] Creating event network-changed:ab753503-9da1-460d-bf01-3c93dd1ecd3b for instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 on n-h2-843834-3 Jul 19 19:50:35.594324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d91bf113-a471-43a8-a80f-a2b63186df9f req-5d639b44-235a-45fe-b7b3-cc0566d371d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086469 Jul 19 19:50:35.599149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1175/2357] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:35.620995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:35.624407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:35.643106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.643747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:35.644708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:35.645289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.019660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.031079 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc15313e-7118-4924-9baa-30bd5661f8fd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 0.429624 Jul 19 19:50:36.032746 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1176/2358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:35 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:36.046578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.052425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.075625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.076148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.077202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.077733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.191443 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd36ce45-2786-4fc6-85fd-447aa46827e9 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208/ips" status: 200 len: 179 microversion: 2.1 time: 0.157346 Jul 19 19:50:36.197935 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1177/2359] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:50:36 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208/ips => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:36.203135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.203770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.210570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.211052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.212499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.212939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.555187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.571453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.577600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:36.582382 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-063261ff-8d97-4683-b04c-778fdc12ad91 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2437 microversion: 2.42 time: 1.500119 Jul 19 19:50:36.583489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1183/2360] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:35 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2437 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:36.593899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.595909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.612279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.615466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.621767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.622445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.695097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:36.857253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6851643d-9531-4751-a396-0286900c2907 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 204 len: 0 microversion: 2.1 time: 0.271343 Jul 19 19:50:36.858630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1184/2361] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:36 2022] DELETE /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:36.865702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e4039018-bdff-411d-9ec7-b04436651322 req-b2c91fbe-f70c-418c-abaa-40a9825120ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-deleted", "tag": "eb5c3e1a-e4db-4ce9-b757-7d758d2f333c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:36.876640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e4039018-bdff-411d-9ec7-b04436651322 req-b2c91fbe-f70c-418c-abaa-40a9825120ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.877471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e4039018-bdff-411d-9ec7-b04436651322 req-b2c91fbe-f70c-418c-abaa-40a9825120ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.894582 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e4039018-bdff-411d-9ec7-b04436651322 req-b2c91fbe-f70c-418c-abaa-40a9825120ef service nova] Creating event network-vif-deleted:eb5c3e1a-e4db-4ce9-b757-7d758d2f333c for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:36.908035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e4039018-bdff-411d-9ec7-b04436651322 req-b2c91fbe-f70c-418c-abaa-40a9825120ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040758 Jul 19 19:50:36.909943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1185/2362] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:36.916721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:36.917635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:36.928259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.928259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:36.928259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:36.928259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.081838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.091632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41f66d13-88ec-4624-add2-1d961481f9c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 0.892395 Jul 19 19:50:37.111335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1178/2363] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:36 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:37.116511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.119393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.135073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.135783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.140698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.141765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.482891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.503572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.508167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.517230 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41a0a203-378a-4fb1-9538-e45d457ac4cd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.605346 Jul 19 19:50:37.518311 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1186/2364] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:36 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:37.523616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.530355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.546352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.547631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.551500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.552163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.694635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.704519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd1943e8-ba01-4e02-9d6b-33f4e74d0be5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1673 microversion: 2.1 time: 0.591838 Jul 19 19:50:37.711524 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1179/2365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1673 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:37.727119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:37.728016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:37.738243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.743573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.744849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.745491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:37.853274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.863800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.873101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:37.876771 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-491dca84-8ec8-4a49-8d15-8e17aec9506f tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 2141 microversion: 2.42 time: 0.161354 Jul 19 19:50:37.879227 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1180/2366] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 2141 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:37.950798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-def821a8-5d30-403a-8ade-fa737260c57a req-c6a57ef4-989d-4e3b-834a-6ca219434df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-plugged", "status": "completed", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:37.962776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-def821a8-5d30-403a-8ade-fa737260c57a req-c6a57ef4-989d-4e3b-834a-6ca219434df5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:37.969303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-def821a8-5d30-403a-8ade-fa737260c57a req-c6a57ef4-989d-4e3b-834a-6ca219434df5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.013175 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-def821a8-5d30-403a-8ade-fa737260c57a req-c6a57ef4-989d-4e3b-834a-6ca219434df5 service nova] Creating event network-vif-plugged:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:50:38.026514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-def821a8-5d30-403a-8ade-fa737260c57a req-c6a57ef4-989d-4e3b-834a-6ca219434df5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079000 Jul 19 19:50:38.028435 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1181/2367] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:38.040547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:38.051612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-facdf51c-09c1-427c-94e8-5e0f24646284 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 0.531990 Jul 19 19:50:38.061113 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1187/2368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:37 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:38.121094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.122723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.142675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.145604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.146645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.150898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.337955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.338628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.360278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.362461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.363715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.368843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.448127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:38.531243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:38.617693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c06efccd-4085-4159-9511-69243c6ac019 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 204 len: 0 microversion: 2.1 time: 0.283612 Jul 19 19:50:38.618959 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1188/2369] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:38 2022] DELETE /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:50:38.630463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:38.632565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:38.643133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.643842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.645058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:38.645724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:38.997070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:39.060813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:39.095308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:39.105431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e84a6b75-2ab1-4f55-883c-02c741e2adf3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1316 microversion: 2.1 time: 0.989591 Jul 19 19:50:39.111348 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1182/2370] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:38 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:39.129425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:39.130780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:39.149439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.150256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.151234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:39.151828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:39.169750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:40.532163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.543599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.553612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.558936 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16c8e760-fb6c-4741-a16f-980605294ecc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 1.938348 Jul 19 19:50:40.562742 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1189/2371] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:38 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:40.575582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:40.580068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.580775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:40.595261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.596157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.599669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.600423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.606791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-faebac5d-9033-442a-8e24-b22250c6b3ee tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1484 microversion: 2.1 time: 1.487449 Jul 19 19:50:40.607950 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1183/2372] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:39 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1484 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:40.625563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:40.626464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:40.636435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.640647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.647151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.648947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.855620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.867809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.876725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:40.878594 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-436d77cf-ebfa-4e12-8fa6-9de9abeee9ad tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1984 microversion: 2.42 time: 0.257343 Jul 19 19:50:40.898726 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1184/2373] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:40 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1984 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:40.903924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:40.904536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:40.940754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.941223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:40.942021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:40.942460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.558771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:41.566589 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-595ec9c6-1422-4e69-aff8-d7a4cf51d14d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 0.666696 Jul 19 19:50:41.582945 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1185/2374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:40 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:41.588565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4f27aac4-8a5c-419d-a10a-17f8f8e30cfd req-6760f8ce-7d6c-4c04-b180-cd8829cbc1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527bde2-8bb1-4b77-b5b4-5552f70dad1c", "name": "network-vif-deleted", "tag": "f3487fb2-62f8-4a73-8c6a-542f7178db5a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:41.613675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4f27aac4-8a5c-419d-a10a-17f8f8e30cfd req-6760f8ce-7d6c-4c04-b180-cd8829cbc1f5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.614398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4f27aac4-8a5c-419d-a10a-17f8f8e30cfd req-6760f8ce-7d6c-4c04-b180-cd8829cbc1f5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.640315 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4f27aac4-8a5c-419d-a10a-17f8f8e30cfd req-6760f8ce-7d6c-4c04-b180-cd8829cbc1f5 service nova] Creating event network-vif-deleted:f3487fb2-62f8-4a73-8c6a-542f7178db5a for instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c on n-h1-843834-3 Jul 19 19:50:41.653165 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4f27aac4-8a5c-419d-a10a-17f8f8e30cfd req-6760f8ce-7d6c-4c04-b180-cd8829cbc1f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068079 Jul 19 19:50:41.655263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1186/2375] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:41.669649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:41.681350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f015c552-0435-4b46-9b1d-4633472b0a4b tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1673 microversion: 2.1 time: 1.116090 Jul 19 19:50:41.683032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-fa352539-bc47-4cc6-8d6b-97c2bb57552c req-993a12ae-d7b5-4b42-acfc-019da3b39c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc67e86-3d69-45a9-89b5-59268d316af5", "tag": "6028b624-621c-46c8-bd63-8e48ae214571"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:41.699432 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1190/2376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:40 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1673 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:41.712064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:41.720164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:41.730124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fa352539-bc47-4cc6-8d6b-97c2bb57552c req-993a12ae-d7b5-4b42-acfc-019da3b39c2c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.732190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fa352539-bc47-4cc6-8d6b-97c2bb57552c req-993a12ae-d7b5-4b42-acfc-019da3b39c2c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.745763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.762882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.764011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.764609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.771661 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-fa352539-bc47-4cc6-8d6b-97c2bb57552c req-993a12ae-d7b5-4b42-acfc-019da3b39c2c service nova] Creating event network-changed:6028b624-621c-46c8-bd63-8e48ae214571 for instance bbc67e86-3d69-45a9-89b5-59268d316af5 on n-h1-843834-3 Jul 19 19:50:41.798836 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-fa352539-bc47-4cc6-8d6b-97c2bb57552c req-993a12ae-d7b5-4b42-acfc-019da3b39c2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141953 Jul 19 19:50:41.799703 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1187/2377] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:41.814779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:41.830032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:41.843472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.845337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:41.846351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:41.848067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.413583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:42.431923 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-efa291a1-7553-48be-b3a4-c8da719a9be4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1465 microversion: 2.1 time: 0.729292 Jul 19 19:50:42.437555 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1191/2378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:41 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1465 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:42.470686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:42.476951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:42.494611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.504199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:42.508395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:42.509287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.057985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.068992 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb65277b-b526-4faa-8178-2c564179134e tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 200 len: 1484 microversion: 2.1 time: 0.627508 Jul 19 19:50:43.081298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1192/2379] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:42 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 1484 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:43.095585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:43.099401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.121230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.121871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.122856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.126559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.205150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.242046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.256737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.260825 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c8825d4-2a16-4849-b569-84f686cfae13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 1.457456 Jul 19 19:50:43.347071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1188/2380] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:41 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:43.347071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-034cee12-9fb8-4a6e-bd2e-e6d4485559c5 req-a63b9746-174b-4c24-a28b-763fc4b2d46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a4bed6-e5ea-4144-83e0-5086cb196cb6"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:43.347071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-034cee12-9fb8-4a6e-bd2e-e6d4485559c5 req-a63b9746-174b-4c24-a28b-763fc4b2d46a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.347071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-034cee12-9fb8-4a6e-bd2e-e6d4485559c5 req-a63b9746-174b-4c24-a28b-763fc4b2d46a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-034cee12-9fb8-4a6e-bd2e-e6d4485559c5 req-a63b9746-174b-4c24-a28b-763fc4b2d46a service nova] Creating event network-vif-unplugged:f1a4bed6-e5ea-4144-83e0-5086cb196cb6 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-034cee12-9fb8-4a6e-bd2e-e6d4485559c5 req-a63b9746-174b-4c24-a28b-763fc4b2d46a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119632 Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1189/2381] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-619031534", "metadata": {"image_type": "test"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.448056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.512722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.527717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.541956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:43.555931 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9a94a55-9c93-4094-9e6d-bfe58d906f07 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.466128 Jul 19 19:50:43.557830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1193/2382] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:43 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:43.564138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:43.569518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Getting quotas for project d1f434859ea049848dc1ed47fc05cb60. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:50:43.575374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:43.576883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Getting quotas for user 882f7f3c47fa4ab19c97916f9d2961a7 and project d1f434859ea049848dc1ed47fc05cb60. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:50:43.604476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.605216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:43.619900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:43.620668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.592316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:44.611172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9a69ddf-1e93-4360-ae3e-a6111740eba4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 1.047783 Jul 19 19:50:44.612393 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1194/2383] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:43 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:44.630122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:44.632706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:44.659780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.662372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:44.666808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:44.667302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.219067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.227856 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a738c24c-e0cc-47f5-b18a-a308a0806510 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1652 microversion: 2.1 time: 0.614163 Jul 19 19:50:45.232389 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1195/2384] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:44 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1652 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:45.239321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-81a8a12d-7233-410d-aab8-4e459c549066 req-9bd44130-771f-405f-aa49-0976439911c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1", "name": "network-vif-deleted", "tag": "0b026cdb-1244-44e3-860f-fc2e87e2f938"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:45.281734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-81a8a12d-7233-410d-aab8-4e459c549066 req-9bd44130-771f-405f-aa49-0976439911c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.283583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-81a8a12d-7233-410d-aab8-4e459c549066 req-9bd44130-771f-405f-aa49-0976439911c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.337950 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-81a8a12d-7233-410d-aab8-4e459c549066 req-9bd44130-771f-405f-aa49-0976439911c4 service nova] Creating event network-vif-deleted:0b026cdb-1244-44e3-860f-fc2e87e2f938 for instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 on n-h2-843834-3 Jul 19 19:50:45.370345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-81a8a12d-7233-410d-aab8-4e459c549066 req-9bd44130-771f-405f-aa49-0976439911c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134987 Jul 19 19:50:45.372850 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1196/2385] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:45.385780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.386488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.401734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.402182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.417841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.418422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.458590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] HTTP exception thrown: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Request method failure captured: Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 HTTP/1.1 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlvA-ms7dgXHRjaFYpm_R9ma7rUy54f5nZgouuPUAfYkkxzF9rDr9JtNteRt06PwQPmjnqAhTl0dE_ytLzD2MyqbQY9eD_bsNWpH-gre0M2bfdESgivhQpp0c9eavEK9WoaWgd8eO58KioA9GRaotcWj-q_tkRpLIgJGsZvQDB7RVc Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a15f9dbf22624cb49d4d817fed35e3b5 Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1'} Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:45.460318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Returning 404 to user: Instance b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-627db465-6f2c-4a64-89dc-7d396c6a5f98 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1" status: 404 len: 111 microversion: 2.1 time: 0.084976 Jul 19 19:50:45.464719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1197/2386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/b2a37c6f-a1a1-4d21-9de6-fc9d7097e0c1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:45.492682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:45.493293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:45.513708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.517018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.517992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:45.518348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:45.940351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.961153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.967249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:45.972237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a96f9221-7608-4b33-8448-9c657147ad43 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1737 microversion: 2.20 time: 0.506741 Jul 19 19:50:45.990354 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1198/2387] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1737 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:46.011148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.012263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:46.029872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.030770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.031914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.032628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.244596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:46.259957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:46.261849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:46.267657 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-558d5f50-3a06-4cd2-a00c-fb5ab4304b68 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.270802 Jul 19 19:50:46.269935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1199/2388] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:45 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:46.283439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0f7af0a7-32c6-42a0-97d8-b0901b4fdaad req-fbaa6f1f-0a42-4c19-a125-7a488c948adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-unplugged", "status": "completed", "tag": "fc27859b-1d1b-4178-b567-f705e4eae269"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:46.300449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0f7af0a7-32c6-42a0-97d8-b0901b4fdaad req-fbaa6f1f-0a42-4c19-a125-7a488c948adb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.300901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0f7af0a7-32c6-42a0-97d8-b0901b4fdaad req-fbaa6f1f-0a42-4c19-a125-7a488c948adb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.323993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0f7af0a7-32c6-42a0-97d8-b0901b4fdaad req-fbaa6f1f-0a42-4c19-a125-7a488c948adb service nova] Creating event network-vif-unplugged:fc27859b-1d1b-4178-b567-f705e4eae269 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:46.330796 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0f7af0a7-32c6-42a0-97d8-b0901b4fdaad req-fbaa6f1f-0a42-4c19-a125-7a488c948adb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059334 Jul 19 19:50:46.331984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1200/2389] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:46.337831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.338357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:46.346214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.348445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.350204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.356051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.409586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:46.571838 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f5e238e-a5aa-4cdc-aad3-be3f98dcacc5 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 204 len: 0 microversion: 2.1 time: 0.236671 Jul 19 19:50:46.571838 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1201/2390] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:46 2022] DELETE /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:46.577391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.578087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:46.589094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.589592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.590434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.590864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.742830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-520fddc2-26fa-4c45-a3b9-895aac87176f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "POST /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe/action" status: 202 len: 0 microversion: 2.1 time: 3.340683 Jul 19 19:50:46.758495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1190/2391] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:43 2022] POST /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe/action => generated 0 bytes in 3357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:50:46.774332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:46.776051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:46.795060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.797577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.800002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.801305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.876301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:46.876748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:46.879031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lazy-loading 'fault' on Instance uuid ef404e08-a230-4e54-b3d6-e66470993208 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:50:47.014365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f24facdac944688d5dd210b0e525ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cfe7341f7e409f9b88e9906bb81ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.023301 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-74ad1f7d-5fbe-4c85-a81e-aeaaca9311ea tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 200 len: 1301 microversion: 2.1 time: 0.260859 Jul 19 19:50:47.033325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1191/2392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:46 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 1301 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.052642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.055338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.059534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.076238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.076690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.077473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.077900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.078319 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-735927c1-a7cb-4a4b-953f-f3ceca0f41a6 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 0.503448 Jul 19 19:50:47.082128 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1202/2393] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:46 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.097204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-63bd6aae-df13-4ba7-a558-ea30020055a5 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef03c9d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.186669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-63bd6aae-df13-4ba7-a558-ea30020055a5 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.103411 Jul 19 19:50:47.188212 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1203/2394] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.197124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.198211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.208188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.208884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.209841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.210435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.635946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.647156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.649726 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f439543f-ee53-441b-891d-3f6e1ee1b698 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1498 microversion: 2.1 time: 0.615062 Jul 19 19:50:47.650931 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1192/2395] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1498 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:47.659710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:47.660904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:47.669103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.670599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.673720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.674431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.675775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.676046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e331cc97-2160-4408-8d07-9d5eb1e45039 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1719 microversion: 2.20 time: 0.486194 Jul 19 19:50:47.676640 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1204/2396] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1719 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:47.677010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.689581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-deleted", "tag": "f1a4bed6-e5ea-4144-83e0-5086cb196cb6"}, {"server_uuid": "ef404e08-a230-4e54-b3d6-e66470993208", "name": "network-vif-deleted", "tag": "fc27859b-1d1b-4178-b567-f705e4eae269"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:47.700993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:47.703461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:47.732053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] Creating event network-vif-deleted:f1a4bed6-e5ea-4144-83e0-5086cb196cb6 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:47.735577 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] Creating event network-vif-deleted:fc27859b-1d1b-4178-b567-f705e4eae269 for instance ef404e08-a230-4e54-b3d6-e66470993208 on n-h1-843834-3 Jul 19 19:50:47.740714 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-13e2b857-b476-4022-b0bb-b8979b81f648 req-cd8592f1-3683-4fea-91e6-4ec57890f716 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062803 Jul 19 19:50:47.741782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1205/2397] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:47.817868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.835605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.840820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:47.844007 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0564518d-2178-4fc6-be9c-8cef99635635 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.189920 Jul 19 19:50:47.847419 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1193/2398] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:47 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:48.056472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.057391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:48.069645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.070536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.071840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.072345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.097827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.103469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:48.109008 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 HTTP/1.1 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ef404e08-a230-4e54-b3d6-e66470993208'} Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:48.111052 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:48.115195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67cd8760-c08b-444c-81df-7d0a23f82dfe tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 404 len: 111 microversion: 2.1 time: 0.064739 Jul 19 19:50:48.118056 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1206/2399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:48.124670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.125258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.126128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.126580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.201347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-107557e4-8d1c-4c75-8307-126486813307 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f24008b4ee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.268116 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-107557e4-8d1c-4c75-8307-126486813307 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.071032 Jul 19 19:50:48.268724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1207/2400] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:48.367957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9a67cd51-f037-4bff-8526-5ef330663a85 req-c81a8dbe-74d6-4414-8fdd-7a17902a15aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc67e86-3d69-45a9-89b5-59268d316af5", "name": "network-vif-plugged", "status": "completed", "tag": "6028b624-621c-46c8-bd63-8e48ae214571"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:48.379519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9a67cd51-f037-4bff-8526-5ef330663a85 req-c81a8dbe-74d6-4414-8fdd-7a17902a15aa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.380140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9a67cd51-f037-4bff-8526-5ef330663a85 req-c81a8dbe-74d6-4414-8fdd-7a17902a15aa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.394987 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9a67cd51-f037-4bff-8526-5ef330663a85 req-c81a8dbe-74d6-4414-8fdd-7a17902a15aa service nova] Creating event network-vif-plugged:6028b624-621c-46c8-bd63-8e48ae214571 for instance bbc67e86-3d69-45a9-89b5-59268d316af5 on n-h1-843834-3 Jul 19 19:50:48.401184 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9a67cd51-f037-4bff-8526-5ef330663a85 req-c81a8dbe-74d6-4414-8fdd-7a17902a15aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Jul 19 19:50:48.402816 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1208/2401] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:50:48.671165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:48.671895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:48.699329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.701206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:48.702320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:48.702995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.305070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f9dbf22624cb49d4d817fed35e3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ff129d1794456ad8c9c6ab8a1e22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.309334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:49.324990 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bafd390f-0156-404b-9327-b9940e7640de tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 200 len: 1456 microversion: 2.1 time: 0.660194 Jul 19 19:50:49.325910 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1209/2402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 1456 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:49.335280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.341673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:49.350262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.364687 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f20e8cf7-b78b-4a57-9a85-d1721fbde048 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 1.270709 Jul 19 19:50:49.377790 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1194/2403] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:48 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:49.386214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.386717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.392039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.392506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.393397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.398656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:49.416670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.419317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.422481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.422936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.589850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.598656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.600192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.601556 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03086aa5-6006-4666-bc9b-cff91db39339 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.222558 Jul 19 19:50:49.602977 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1195/2404] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:49.610437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b29048f2-ea4d-4054-b57a-408fa8643f48 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23efb92e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:49.672513 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b29048f2-ea4d-4054-b57a-408fa8643f48 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.068405 Jul 19 19:50:49.679595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1196/2405] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:49.715102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.727524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.729093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:49.730325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a96cc30-97da-4508-bcc1-bc5ade3b4d57 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1719 microversion: 2.20 time: 0.403070 Jul 19 19:50:49.733719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1210/2406] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:49 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1719 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:49.787348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-015e253a-8c06-4779-b467-d6cfc4e394a3 req-0a61b5f8-418a-4d61-9616-04e9fa5ad209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5596707-8f32-4c72-a28a-789ec105689c", "name": "network-vif-deleted", "tag": "ad39d874-171d-4114-b4be-8181f08abe50"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:49.799917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-015e253a-8c06-4779-b467-d6cfc4e394a3 req-0a61b5f8-418a-4d61-9616-04e9fa5ad209 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:49.800389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-015e253a-8c06-4779-b467-d6cfc4e394a3 req-0a61b5f8-418a-4d61-9616-04e9fa5ad209 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:49.828422 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-015e253a-8c06-4779-b467-d6cfc4e394a3 req-0a61b5f8-418a-4d61-9616-04e9fa5ad209 service nova] Creating event network-vif-deleted:ad39d874-171d-4114-b4be-8181f08abe50 for instance e5596707-8f32-4c72-a28a-789ec105689c on n-h2-843834-3 Jul 19 19:50:49.836277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-015e253a-8c06-4779-b467-d6cfc4e394a3 req-0a61b5f8-418a-4d61-9616-04e9fa5ad209 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052854 Jul 19 19:50:49.837969 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1197/2407] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:50.342130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.343558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] [instance: e5596707-8f32-4c72-a28a-789ec105689c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.351151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.356141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.368206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.369026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.383783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.385345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.393385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.394274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.395384 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] HTTP exception thrown: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. Jul 19 19:50:50.395699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.396297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Request method failure captured: Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c HTTP/1.1 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wlvA-ms7dgXHRjaFYpm_R9ma7rUy54f5nZgouuPUAfYkkxzF9rDr9JtNteRt06PwQPmjnqAhTl0dE_ytLzD2MyqbQY9eD_bsNWpH-gre0M2bfdESgivhQpp0c9eavEK9WoaWgd8eO58KioA9GRaotcWj-q_tkRpLIgJGsZvQDB7RVc Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee5ff129d1794456ad8c9c6ab8a1e22d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ee5ff129d1794456ad8c9c6ab8a1e22d Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-LiveMigrationTest-1985018226 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a15f9dbf22624cb49d4d817fed35e3b5 Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-LiveMigrationTest-1985018226-project Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e5596707-8f32-4c72-a28a-789ec105689c'} Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:50.397426 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. Jul 19 19:50:50.402126 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:50.402763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] Returning 404 to user: Instance e5596707-8f32-4c72-a28a-789ec105689c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:50.403655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4de63526-fc72-4a5d-a2c0-b8c97314ef04 tempest-LiveMigrationTest-1985018226 tempest-LiveMigrationTest-1985018226-project] 10.222.0.23 "GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c" status: 404 len: 111 microversion: 2.1 time: 0.065853 Jul 19 19:50:50.404346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1211/2408] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/e5596707-8f32-4c72-a28a-789ec105689c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:50.622876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.623706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.629417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:50.632466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.633767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.636341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.638712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.641858 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b865325-8975-4ad8-b33e-3884bb6e7ce0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1315 microversion: 2.1 time: 0.263750 Jul 19 19:50:50.645027 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1198/2409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:50:50.690226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cbd26a02-274f-49f8-9b77-8bad4bdd07f4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef5971f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.796789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cbd26a02-274f-49f8-9b77-8bad4bdd07f4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.112262 Jul 19 19:50:50.797407 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1199/2410] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:50.816083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-87b00c45-7284-423e-a608-ccb0bd002b2a req-c544950f-660f-4ef0-a454-c3a8519aa63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-plugged", "status": "completed", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:50.834185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:50.844900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87b00c45-7284-423e-a608-ccb0bd002b2a req-c544950f-660f-4ef0-a454-c3a8519aa63f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.845449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87b00c45-7284-423e-a608-ccb0bd002b2a req-c544950f-660f-4ef0-a454-c3a8519aa63f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.878368 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-87b00c45-7284-423e-a608-ccb0bd002b2a req-c544950f-660f-4ef0-a454-c3a8519aa63f service nova] Creating event network-vif-plugged:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:50:50.885354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:50.890879 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-87b00c45-7284-423e-a608-ccb0bd002b2a req-c544950f-660f-4ef0-a454-c3a8519aa63f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086501 Jul 19 19:50:50.895845 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1200/2411] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:50:50.896599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:50.898549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:50.903658 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-771cc774-935c-4e25-acd1-49e7c605b27d tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.285836 Jul 19 19:50:50.908003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:50.911083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:50.916820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1212/2412] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:50:50.927653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.928145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:50.928957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:50.933458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.590848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:51.620399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:51.627859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:51.634600 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73bd7b3e-fafc-427c-a9b6-48eea16a37b1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1719 microversion: 2.20 time: 0.733249 Jul 19 19:50:51.635857 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1201/2413] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:50 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1719 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:51.663313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:51.664069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:51.684805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:51.684919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.685900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:51.686480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:51.810221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-466b4f63-2fc1-456e-8724-697bdfb701d2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400a7d430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.118622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.129583 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e93bebf5-af3f-4205-9558-317caf39fd63 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1503 microversion: 2.1 time: 0.471732 Jul 19 19:50:52.153833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1213/2414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:51 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:52.168336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.172114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.176900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:52.190931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.193999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.196768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.199532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.234297 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 HTTP/1.1 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ef404e08-a230-4e54-b3d6-e66470993208'} Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:52.242446 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.250265 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.254239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:52.256808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1b0a412-e051-4a65-a41c-f2216751e824 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 404 len: 111 microversion: 2.1 time: 0.101426 Jul 19 19:50:52.258799 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1214/2415] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:52 2022] DELETE /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:52.271543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.275689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.290769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.291295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.292142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.294591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.435061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.447226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.450887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:52.454205 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18416d8d-9702-4c3d-861f-44056d057f61 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.189673 Jul 19 19:50:52.455095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1215/2416] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:52.473197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:52.474128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.481117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.481871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.484131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.484831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.579901 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45645851-2216-4a85-8c23-157716b5eafc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5/action" status: 202 len: 0 microversion: 2.1 time: 0.110704 Jul 19 19:50:52.584196 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1216/2417] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:50:52 2022] POST /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:50:52.590358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.591303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: ef404e08-a230-4e54-b3d6-e66470993208] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.598312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.599019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.599990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.600587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.652093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 HTTP/1.1 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ef404e08-a230-4e54-b3d6-e66470993208'} Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:52.654159 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. Jul 19 19:50:52.659014 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:52.660559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance ef404e08-a230-4e54-b3d6-e66470993208 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:52.661651 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d5a35d8-95d9-401b-bfd4-51fddd3a2bd7 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208" status: 404 len: 111 microversion: 2.1 time: 0.076125 Jul 19 19:50:52.663041 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1217/2418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/ef404e08-a230-4e54-b3d6-e66470993208 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:52.672428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:52.673948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:52.689068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.696071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:52.698432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:52.699509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.194138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.244351 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b4a80ca3-4fc7-4fbb-9319-70127eb64a3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1508 microversion: 2.1 time: 0.579891 Jul 19 19:50:53.249429 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1218/2419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:52 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1508 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:53.280279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.284447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.318183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.319553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.320790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.323107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.709574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.718447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.725742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:53.727330 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0370ddf4-6059-4ec5-befa-19fa8b0df871 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1662 microversion: 2.20 time: 0.476385 Jul 19 19:50:53.730045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1219/2420] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1662 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:53.740651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.741416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.756045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.767670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.768879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.769473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.798950 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 HTTP/1.1 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6a84776e-3e7d-4617-a489-60c86e098071'} Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:53.808218 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:53.812631 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:53.814642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:53.816594 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-570b8505-b8a6-4f61-8e3e-150049806bc5 tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 404 len: 111 microversion: 2.1 time: 0.085082 Jul 19 19:50:53.821298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1220/2421] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:53 2022] DELETE /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:53.829245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1904eb9e-c63d-4430-8dee-76c2c18bc705 req-13d1cfbb-d644-4a56-b64b-9a720a20ad3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "name": "network-vif-unplugged", "status": "completed", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:53.842858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1904eb9e-c63d-4430-8dee-76c2c18bc705 req-13d1cfbb-d644-4a56-b64b-9a720a20ad3c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.843668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1904eb9e-c63d-4430-8dee-76c2c18bc705 req-13d1cfbb-d644-4a56-b64b-9a720a20ad3c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.859756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_external_events [req-1904eb9e-c63d-4430-8dee-76c2c18bc705 req-13d1cfbb-d644-4a56-b64b-9a720a20ad3c service nova] Unable to find a host for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7. Dropping event network-vif-unplugged {{(pid=131229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 19:50:53.861120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1904eb9e-c63d-4430-8dee-76c2c18bc705 req-13d1cfbb-d644-4a56-b64b-9a720a20ad3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038404 Jul 19 19:50:53.862260 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1221/2422] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 19:50:53.871784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:53.873094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:53.881972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.882764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:53.883796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:53.884832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.123142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.136089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.137677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:54.138896 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07a7bbeb-cf7e-409a-a3cf-a88b67bfe598 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.275484 Jul 19 19:50:54.156201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1222/2423] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:53 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:54.180220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d57531a-24b2-446e-ab4b-421c2904c12b"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:54.186551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.215709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.216220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.217896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.218342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.905590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d12fd440-9f63-41ed-93de-bdea1a86024a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.745264 Jul 19 19:50:54.907961 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1223/2424] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jul 19 19:50:54 2022] POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments => generated 188 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:50:54.921822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:54.924509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] [instance: 6a84776e-3e7d-4617-a489-60c86e098071] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:54.969976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.970577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:54.971537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:54.972568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.020447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] HTTP exception thrown: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Request method failure captured: Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 HTTP/1.1 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqbjpa4yZ6eDX8aNrX1XElAr9rW070hxgYHYvFA4TDhFWSXhp2sTn6zj5FG-g6CuXlDi0YbN2W6aHzPJKiN82DS-HJss8T_m7N8UhU26plIH8nkOhKdahOgB_DFdeHFb82v6iaZ5Hc5EbjgZ5TKuvbDgcEbIn_7nQHiow6oolbWUeY Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d6cfe7341f7e409f9b88e9906bb81ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d6cfe7341f7e409f9b88e9906bb81ceb Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestMultiNic-868092373 Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 47f24facdac944688d5dd210b0e525ca Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestMultiNic-868092373-project Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6a84776e-3e7d-4617-a489-60c86e098071'} Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:50:55.028001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. Jul 19 19:50:55.031745 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:50:55.042187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] Returning 404 to user: Instance 6a84776e-3e7d-4617-a489-60c86e098071 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:50:55.044917 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c218d0ba-5ba8-49b0-a63a-12a5321a456a tempest-ServersTestMultiNic-868092373 tempest-ServersTestMultiNic-868092373-project] 10.222.0.23 "GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071" status: 404 len: 111 microversion: 2.1 time: 0.135740 Jul 19 19:50:55.045766 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1224/2425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:54 2022] GET /compute/v2.1/servers/6a84776e-3e7d-4617-a489-60c86e098071 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:50:55.054569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.066806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.090581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.091322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.094576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.095972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.607894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.616894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a41f5878-5ab3-46df-b28f-ac01686a8c81 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1488 microversion: 2.1 time: 0.566114 Jul 19 19:50:55.622097 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1225/2426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1488 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:55.627628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:55.630304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.655300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.657444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.658655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.671565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.884544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.891679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:50:55.895385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.906329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:55.913697 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8a01e51-d024-4665-a139-64aa8274354a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.289994 Jul 19 19:50:55.916606 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1226/2427] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:55 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:55.929270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:50:55.936301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:55.955825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.956839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:55.959023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:55.960774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.120502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76fb1710-a7dc-4fa8-b448-4b3bb84cd967 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/action" status: 202 len: 0 microversion: 2.20 time: 0.200696 Jul 19 19:50:56.123264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1227/2428] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:50:55 2022] POST /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:56.149778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:56.150289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:56.163923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.164662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.165658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.166249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.234255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:50:56.486802 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-66836292-cb09-475a-95ce-7a4716499666 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 204 len: 0 microversion: 2.1 time: 0.357986 Jul 19 19:50:56.493543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1228/2429] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:50:56 2022] DELETE /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:50:56.516255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:56.516976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:56.545334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.546409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:56.548689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:56.549643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.499966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.511980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.513515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.517250 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fac92581-6679-4c1f-8654-6c71f0b05ade tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1748 microversion: 2.20 time: 1.019900 Jul 19 19:50:57.522017 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1229/2430] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:56 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1748 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:57.533894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.534516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:57.553811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.554279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.555083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:57.561884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:57.929751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:57.948757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d7f345e-d632-4ee2-a44e-3bf09a1a43a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1494 microversion: 2.1 time: 0.425476 Jul 19 19:50:57.949685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1230/2431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:57 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1494 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:50:57.956736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:57.980847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:58.001510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.002458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.003428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.003996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.312572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.342398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.346457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:58.352686 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76e9add2-f4e5-408d-8fad-42ab34d06271 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.401808 Jul 19 19:50:58.363883 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1231/2432] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:57 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:58.536746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:58.538235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:58.559400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.560855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.564520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:58.567606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:58.999885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.013732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.015289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:50:59.030956 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-628fbef8-0f82-414c-b775-2806968e99cc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1748 microversion: 2.20 time: 0.497721 Jul 19 19:50:59.032116 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1232/2433] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:50:58 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1748 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:50:59.039110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:50:59.040332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:50:59.053545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.055129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:50:59.056172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:50:59.056768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.514360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:00.529735 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4050345-7926-43dc-a115-ce288e88163e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 200 len: 1494 microversion: 2.1 time: 1.494884 Jul 19 19:51:00.532741 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1233/2434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:50:59 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 1494 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:00.545330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:00.547633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:00.568238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.569051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.571870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:00.573898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:00.948423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:01.119611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.162366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.172061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.182038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9fa59010-34a7-4e09-a2df-a6ed46529f8b tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.645886 Jul 19 19:51:01.185125 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1234/2435] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:00 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:01.208215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:01.212632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:01.221954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.223032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.224588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.225331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.620529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-466b4f63-2fc1-456e-8724-697bdfb701d2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 9.814350 Jul 19 19:51:01.626770 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1202/2436] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:50:51 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 9821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:01.629039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:01.636836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a575e936-5f37-4e92-b29d-2c29a93bfe8f req-8e947c2c-299c-4ad6-b9fb-f07f40542f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc67e86-3d69-45a9-89b5-59268d316af5", "name": "network-vif-deleted", "tag": "6028b624-621c-46c8-bd63-8e48ae214571"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:01.678531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a575e936-5f37-4e92-b29d-2c29a93bfe8f req-8e947c2c-299c-4ad6-b9fb-f07f40542f81 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.679060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a575e936-5f37-4e92-b29d-2c29a93bfe8f req-8e947c2c-299c-4ad6-b9fb-f07f40542f81 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.722930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a575e936-5f37-4e92-b29d-2c29a93bfe8f req-8e947c2c-299c-4ad6-b9fb-f07f40542f81 service nova] Creating event network-vif-deleted:6028b624-621c-46c8-bd63-8e48ae214571 for instance bbc67e86-3d69-45a9-89b5-59268d316af5 on n-h1-843834-3 Jul 19 19:51:01.744170 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a575e936-5f37-4e92-b29d-2c29a93bfe8f req-8e947c2c-299c-4ad6-b9fb-f07f40542f81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115625 Jul 19 19:51:01.745696 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1203/2437] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:01.751896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:01.759232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:01.784964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.787269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.789760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.793833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.806774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.821327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.823326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:01.826623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed6e2d95-4a14-48ed-b650-a415a5b21095 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1748 microversion: 2.20 time: 0.637235 Jul 19 19:51:01.835739 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1235/2438] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:01 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1748 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:01.845175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "348c02c9-4d13-47ba-9511-bf39b06503d6"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:01.851495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:01.864356 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:51:01.866178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 HTTP/1.1 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bbc67e86-3d69-45a9-89b5-59268d316af5'} Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:01.866330 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:01.871783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:01.872808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c0402bc-1292-47ef-b795-38c4ef6e7184 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 404 len: 111 microversion: 2.1 time: 0.125546 Jul 19 19:51:01.873624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.874651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:01.875306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:01.888599 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1204/2439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:01 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:51:01.953224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1410725843", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:02.118509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:02.506491 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca9110ee-6d2b-43b8-ba67-83c43dd6173d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "POST /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662597 Jul 19 19:51:02.520226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1236/2440] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 19:51:01 2022] POST /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:02.538529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:02.538754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:02.568400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.568868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:02.576024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:02.576483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.021100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.034257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.035867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.047213 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7bc5d210-3a88-4d8f-9e9f-a249dd7af58a tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.528209 Jul 19 19:51:03.067424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1237/2441] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:02 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:03.073276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-727199eb-dc12-4945-a935-e6fcc6dfbb57 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef8dfaf0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.151262 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-727199eb-dc12-4945-a935-e6fcc6dfbb57 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.082311 Jul 19 19:51:03.157846 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1238/2442] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:03.163826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:03.164628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:03.173614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.174372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.176782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:03.177431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:03.872662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.898007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.902968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:03.906294 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b8eade6-15ae-4c8d-b490-b82391568efd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1748 microversion: 2.20 time: 0.747012 Jul 19 19:51:03.909616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1239/2443] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:03 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1748 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:04.067329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:04.067959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:04.084293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.084757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.087706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:04.089932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:04.164991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:05.301496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.312992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.315443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.319059 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2bec1aaa-f474-4fc4-83e1-ba59197f4ec0 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 1.255193 Jul 19 19:51:05.320394 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1240/2444] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:04 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:05.334092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98b294f6-13dd-46c9-a30a-ddf9bd10035c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef8df310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.435445 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98b294f6-13dd-46c9-a30a-ddf9bd10035c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.110054 Jul 19 19:51:05.439009 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1241/2445] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:05.444211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.455823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:05.474665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.475427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.476401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.476998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.487561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:05.488069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:05.488438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:05.488845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:05.489264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:05.504799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.505244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.506032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:05.517754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:05.584771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:05.603309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:05.653579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:05.660243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:05.749028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.762482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.767157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:05.770491 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4022d2f6-7433-48c5-bc3b-c96b8750c4d5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.330287 Jul 19 19:51:05.784232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1242/2446] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:05.804571 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ef58e50-6ae0-4e68-bc80-03432a142ffb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.855514 Jul 19 19:51:05.807719 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1205/2447] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:51:05.818011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-206a568d-03d5-4bf0-b092-074f1c653015 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:05.819146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-206a568d-03d5-4bf0-b092-074f1c653015 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:06.033612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-206a568d-03d5-4bf0-b092-074f1c653015 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.042584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-206a568d-03d5-4bf0-b092-074f1c653015 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1215 microversion: 2.1 time: 0.228730 Jul 19 19:51:06.047900 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1243/2448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:05 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:06.346505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:06.350224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:06.376829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.379819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.381416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.389036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.451412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3cbf9224-af81-4215-b6fe-e10e086d8d3d tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef9243a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:06.547658 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3cbf9224-af81-4215-b6fe-e10e086d8d3d tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.101943 Jul 19 19:51:06.556090 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1244/2449] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:06.793255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:06.794266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:06.803918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.818047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.822531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.827661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:06.828506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:06.834270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.835881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b26d4f35890d4ed189dac8851965128f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2997249e341bc845c655354f66909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:06.837124 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ecb5a24-e131-4f67-9e64-dd0b84410336 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 200 len: 1871 microversion: 2.42 time: 0.502695 Jul 19 19:51:06.841932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1206/2450] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 1871 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:07.062175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:07.063004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:07.074058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.076495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.077541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.083724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.275795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.286864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c8b9e64-d7f8-4431-a546-d3de58e69905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1211 microversion: 2.1 time: 0.230758 Jul 19 19:51:07.288047 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1207/2451] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:07 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1211 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:07.317368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.330819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.337406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:07.339082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb2c1aa3-0c04-4645-a62d-cabdba5d1826 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.551470 Jul 19 19:51:07.350543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1245/2452] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:06 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:07.565513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e5a0f930-d970-4019-8367-6b0ae4bf512c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400aa2700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:07.695143 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e5a0f930-d970-4019-8367-6b0ae4bf512c tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.134151 Jul 19 19:51:07.700996 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1208/2453] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:07 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:07.860302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:07.860926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:07.882846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.891433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.892642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:07.895989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:07.947112 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] HTTP exception thrown: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Request method failure captured: Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c HTTP/1.1 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wmH9nccWPykDjTEgDFN6PwjyO7sS5CCB8fEacUlbXaZ8zfSkuhY9p8hl2GCR7TovpG6VV83tuo0e-VmaShfphmPOkXLK3vASODdTY_0O7P5DClG8mBU3I_pSWmTVkng97RHv8Xx0C3MeO0pPIfeoDJgTVP5id8Mb5hcJxcXn0-HJb0 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7de2997249e341bc845c655354f66909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7de2997249e341bc845c655354f66909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b26d4f35890d4ed189dac8851965128f Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'd527bde2-8bb1-4b77-b5b4-5552f70dad1c'} Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:07.980399 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:07.984477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:07.988647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Returning 404 to user: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:07.989671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90107d63-0f0e-4e06-a475-0959c6285204 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 404 len: 111 microversion: 2.42 time: 0.133702 Jul 19 19:51:07.995192 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1246/2454] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:07 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:51:08.004545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28b85464-7050-4f77-9ede-b0f4d1179eb4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '.version_select at 0x7f23ef2e1700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.064206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28b85464-7050-4f77-9ede-b0f4d1179eb4 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636491091" status: 204 len: 0 microversion: 2.42 time: 0.063876 Jul 19 19:51:08.068747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1209/2455] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jul 19 19:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636491091 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:51:08.304574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.305241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:08.323187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.326719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.331649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.332151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.360695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:08.361344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:08.389054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.389436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:08.390242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:08.390695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:09.259954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.277570 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e09bda2-6879-492c-abc9-afb99e32dcdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1285 microversion: 2.1 time: 0.977352 Jul 19 19:51:09.278653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1247/2456] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:08 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1285 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:09.291649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e8ccc59-050c-40e4-96d2-c234cbbd7455 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef85d280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:09.382871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e8ccc59-050c-40e4-96d2-c234cbbd7455 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.102861 Jul 19 19:51:09.383897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1248/2457] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:09 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:09.880442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.890222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.896704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:09.905755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7760215c-51e5-45cf-8b48-84439184a7d6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 1.549063 Jul 19 19:51:09.917859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1210/2458] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:08 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:10.296278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.297553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:10.315136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.321173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.326228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.330625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.399489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-89bd5e6c-49e4-4b7c-8fa9-c9d71851b584 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400a353a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.483741 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-89bd5e6c-49e4-4b7c-8fa9-c9d71851b584 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.088081 Jul 19 19:51:10.494093 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1211/2459] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:10.711562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:10.719591 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7457c513-f1df-4f25-b767-1c21bf921165 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1273 microversion: 2.1 time: 0.427908 Jul 19 19:51:10.720188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1249/2460] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1273 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:10.924644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:10.929497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:10.953728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.954558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:10.957060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:10.960307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.507050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2cbce9d-5877-4a51-9ba7-f838c74c132e tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef9949d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:11.564513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:11.590430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:11.592020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:11.593270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19b152f0-7de9-4a72-865e-12b9bf638bf5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.672688 Jul 19 19:51:11.593848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1212/2461] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:10 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:11.656511 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2cbce9d-5877-4a51-9ba7-f838c74c132e tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.154023 Jul 19 19:51:11.658335 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1250/2462] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:11 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:11.736997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:11.737613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:11.749994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.750527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:11.751385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:11.751850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.618888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:12.621133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:12.636394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.637201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.638220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:12.638815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:12.748270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:12.756894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4809dcd6-f4a1-454d-bea2-83066c7a9538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 1.023687 Jul 19 19:51:12.762000 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1213/2463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:11 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:12.767050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa2268d3-390b-421e-abba-2e313b350180 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef24f430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:12.885084 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa2268d3-390b-421e-abba-2e313b350180 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.121764 Jul 19 19:51:12.886088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1214/2464] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:12 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:13.631831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62c2d8e1-943b-487e-80cf-ffdd62f1a28f tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] Calling method '.version_select at 0x7f23efbaa820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:13.902263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:13.921952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:13.924584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:13.927209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64a96ab5-c747-4655-9e48-1260334ad8f5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 1.317447 Jul 19 19:51:13.931640 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1251/2465] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:12 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:13.938953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:13.939953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:13.952075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.953283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:13.954428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:13.955451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.543588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:14.559110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c4cbde5-d50e-414b-9a92-1e7bb8d94538 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.624232 Jul 19 19:51:14.560075 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1252/2466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:13 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:14.590088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8d37c56-b60d-4a93-9a9d-62d3d7c88051 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23efb173a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.692203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8d37c56-b60d-4a93-9a9d-62d3d7c88051 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.118140 Jul 19 19:51:14.692817 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1253/2467] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:14 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:14.951903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:14.953636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:14.969079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.971939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:14.975534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:14.977649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:15.074118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62c2d8e1-943b-487e-80cf-ffdd62f1a28f tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 8764 microversion: 2.1 time: 2.013083 Jul 19 19:51:15.075388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1215/2468] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:51:13 2022] GET /compute/v2.1/os-networks => generated 8764 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:15.084224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e9216e6-45b6-4ee0-a777-af446ff4708a tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] Calling method '.version_select at 0x7f23efcba670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:15.542183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:15.627213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:16.041727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:16.597402 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e9216e6-45b6-4ee0-a777-af446ff4708a tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/d24ebc78-568f-42c3-b67a-19b61dbb42d6" status: 200 len: 652 microversion: 2.1 time: 1.516778 Jul 19 19:51:16.598230 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1216/2469] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:51:15 2022] GET /compute/v2.1/os-networks/d24ebc78-568f-42c3-b67a-19b61dbb42d6 => generated 652 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:16.603747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:16.604773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:16.614243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.624903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.630694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:16.634115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.634584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.635436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:16.636016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67fdb6c9-d1c6-4b0b-a7e4-65d2616365bc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 1.690055 Jul 19 19:51:16.636142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:16.637003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1254/2470] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:14 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:51:16.658752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1393a663-fa60-4f3f-acb1-e43b77127fb1 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef84d940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:16.757245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1393a663-fa60-4f3f-acb1-e43b77127fb1 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.112734 Jul 19 19:51:16.763159 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1255/2471] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:16 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:16.776005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b15e394-4d3e-47b9-8bf2-eb9859c827bc tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] Calling method '.version_select at 0x7f23efb178b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.523118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:17.532707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01046c60-5426-4ef4-bdd5-1c75296d7392 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.933335 Jul 19 19:51:17.543296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1217/2472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:16 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:17.564600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-db1f9fd1-9fb4-459a-922c-ef12428b1cb2 req-33e429aa-9cb9-443f-ab3f-2753f77f7abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca4469c-d47e-4dd7-8c38-0e3902be7d95", "tag": "1605e3c5-9a0a-41f9-877a-c642e4982a05"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:17.591210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-db1f9fd1-9fb4-459a-922c-ef12428b1cb2 req-33e429aa-9cb9-443f-ab3f-2753f77f7abe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.591671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-db1f9fd1-9fb4-459a-922c-ef12428b1cb2 req-33e429aa-9cb9-443f-ab3f-2753f77f7abe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.615059 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-db1f9fd1-9fb4-459a-922c-ef12428b1cb2 req-33e429aa-9cb9-443f-ab3f-2753f77f7abe service nova] Creating event network-changed:1605e3c5-9a0a-41f9-877a-c642e4982a05 for instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 on n-h2-843834-3 Jul 19 19:51:17.629120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-db1f9fd1-9fb4-459a-922c-ef12428b1cb2 req-33e429aa-9cb9-443f-ab3f-2753f77f7abe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083923 Jul 19 19:51:17.630077 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1218/2473] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:17.656032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.656818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:17.672623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.673723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.674950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:17.675561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:17.692399 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b15e394-4d3e-47b9-8bf2-eb9859c827bc tempest-NetworksTest-1188859606 tempest-NetworksTest-1188859606-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 9454 microversion: 2.1 time: 0.927526 Jul 19 19:51:17.692778 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1256/2474] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:51:16 2022] GET /compute/v2.1/os-networks => generated 9454 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:17.769857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d628abf-07bf-47c8-b14b-b5871345d7bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef8cf700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:17.837039 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d628abf-07bf-47c8-b14b-b5871345d7bc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.071148 Jul 19 19:51:17.837633 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1257/2475] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:18.310713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.320991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.327203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.340545 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3aa2de0-fe60-4150-b04f-614f1a004996 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.689329 Jul 19 19:51:18.341742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1219/2476] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:17 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:18.570007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.571450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:18.589123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.590016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.592047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:18.596475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:18.830743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:18.845910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f339354-e7b5-4556-bb0e-8b0b1d9ac414 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.279118 Jul 19 19:51:18.849756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-788c5e36-b671-4d30-8d3d-33b16e148263 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef722d30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:18.859298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1258/2477] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:18.912445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-788c5e36-b671-4d30-8d3d-33b16e148263 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1421 microversion: 2.1 time: 0.066396 Jul 19 19:51:18.914166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1220/2478] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:18 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1421 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:19.369621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.372423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.382447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.383826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.385300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.386668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.492084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.492882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.505421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.507295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.508997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.515521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.540271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] HTTP exception thrown: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Request method failure captured: Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c HTTP/1.1 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wmH9nccWPykDjTEgDFN6PwjyO7sS5CCB8fEacUlbXaZ8zfSkuhY9p8hl2GCR7TovpG6VV83tuo0e-VmaShfphmPOkXLK3vASODdTY_0O7P5DClG8mBU3I_pSWmTVkng97RHv8Xx0C3MeO0pPIfeoDJgTVP5id8Mb5hcJxcXn0-HJb0 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7de2997249e341bc845c655354f66909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7de2997249e341bc845c655354f66909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: b26d4f35890d4ed189dac8851965128f Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd527bde2-8bb1-4b77-b5b4-5552f70dad1c'} Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:19.542186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.546808 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.549767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Returning 404 to user: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:19.551320 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-680a8a42-cf72-46e6-bd96-c14df1a87e30 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 404 len: 111 microversion: 2.42 time: 0.065464 Jul 19 19:51:19.552349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1221/2479] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:51:19 2022] DELETE /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:51:19.603283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.605602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] [instance: d527bde2-8bb1-4b77-b5b4-5552f70dad1c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.622369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.623158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.626324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.627435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.675496 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] HTTP exception thrown: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Request method failure captured: Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c HTTP/1.1 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wmH9nccWPykDjTEgDFN6PwjyO7sS5CCB8fEacUlbXaZ8zfSkuhY9p8hl2GCR7TovpG6VV83tuo0e-VmaShfphmPOkXLK3vASODdTY_0O7P5DClG8mBU3I_pSWmTVkng97RHv8Xx0C3MeO0pPIfeoDJgTVP5id8Mb5hcJxcXn0-HJb0 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7de2997249e341bc845c655354f66909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7de2997249e341bc845c655354f66909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7de2997249e341bc845c655354f66909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7de2997249e341bc845c655354f66909 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1857897249 Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: b26d4f35890d4ed189dac8851965128f Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1857897249-project Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd527bde2-8bb1-4b77-b5b4-5552f70dad1c'} Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.677206 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] Returning 404 to user: Instance d527bde2-8bb1-4b77-b5b4-5552f70dad1c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:19.680971 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9122e0b-8775-49c2-82be-0d599a744288 tempest-TaggedBootDevicesTest_v242-1857897249 tempest-TaggedBootDevicesTest_v242-1857897249-project] 10.222.0.23 "GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c" status: 404 len: 111 microversion: 2.42 time: 0.099399 Jul 19 19:51:19.683500 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1222/2480] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers/d527bde2-8bb1-4b77-b5b4-5552f70dad1c => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:51:19.740675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.752018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.754059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:19.755656 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33ddd789-5f31-4972-bd27-3e68374b1b03 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.390514 Jul 19 19:51:19.767594 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1259/2481] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:19.864273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:19.865143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:19.882324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.882771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.883790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:19.884502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:19.925881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2be518e-4d83-4660-8611-84b9251eea8f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef849820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.022772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2be518e-4d83-4660-8611-84b9251eea8f tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1430 microversion: 2.1 time: 0.100692 Jul 19 19:51:20.032123 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1260/2482] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1430 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.038023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23152e62-c679-4204-80b0-7ee19ea84f26 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef85dee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.135165 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23152e62-c679-4204-80b0-7ee19ea84f26 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 200 len: 1430 microversion: 2.1 time: 0.100918 Jul 19 19:51:20.140734 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1261/2483] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 1430 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:20.152809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.158254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.172851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.177803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.179220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.181717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.320513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.329083 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-53b69a84-c1de-44f3-9096-049d4a7f75a5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.468864 Jul 19 19:51:20.329611 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1223/2484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:19 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.592098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:20.608016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eaa2b435-ff2d-47aa-be2e-af789607faf0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1465 microversion: 2.1 time: 0.459170 Jul 19 19:51:20.609160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1262/2485] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1465 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:20.626696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1efaa7d0-e710-445d-bed1-dd6f32846358 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef6f0790>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.702462 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1efaa7d0-e710-445d-bed1-dd6f32846358 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29" status: 200 len: 784 microversion: 2.1 time: 0.079575 Jul 19 19:51:20.705234 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1224/2486] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/images/371de3c2-13a8-4290-a544-705d4d9b3f29 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:20.715239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a60ff2bb-2ffc-4092-a735-427063bd2410 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.733640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a60ff2bb-2ffc-4092-a735-427063bd2410 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020203 Jul 19 19:51:20.740078 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1263/2487] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:20.753238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3a09ea2-8c7f-4cf2-b228-8b397d8fb436 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef2e1700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.783220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:20.784725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:20.799273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.801212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:20.802029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:20.804803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.392356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.415074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.416738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:21.422674 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76c448d1-52a3-41a5-9d39-c6abad3e03cf tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 0.652131 Jul 19 19:51:21.433672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1264/2488] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:20 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:21.449455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.450075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:21.475694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.476162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.476955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:21.477914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:21.906382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3a09ea2-8c7f-4cf2-b228-8b397d8fb436 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "DELETE /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 204 len: 0 microversion: 2.1 time: 1.164517 Jul 19 19:51:21.907165 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1225/2489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:20 2022] DELETE /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:21.917803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8359b72f-f10c-47b0-8a0c-ad95c616bd18 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef5edc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:21.961080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8359b72f-f10c-47b0-8a0c-ad95c616bd18 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] HTTP exception thrown: Image not found. Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8359b72f-f10c-47b0-8a0c-ad95c616bd18 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Request method failure captured: Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 HTTP/1.1 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wrzhQksvzGiXDmmGgRYfPq_mOsNK0NCnm6QjcH7648zJWjYDCgjnIgBnxMLCOcUKrXl_5udM3xwbAIVR3zSBe7V5w2rjfgv_gcLCE3BCbDN7XVKjRNlWTh0ktOCjX5a5gC15y6tWGCJYhUhpM93VL6ievjpoWw3Tnx_JY6_FXGOpMw Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 882f7f3c47fa4ab19c97916f9d2961a7 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7'} Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:51:21.963607 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 could not be found. Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8359b72f-f10c-47b0-8a0c-ad95c616bd18 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:21.968612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8359b72f-f10c-47b0-8a0c-ad95c616bd18 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 404 len: 62 microversion: 2.1 time: 0.053662 Jul 19 19:51:21.974003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1226/2490] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:21 2022] GET /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:21.982905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-959078459"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:21.985701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:22.004997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.005947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.008819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.009820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.385395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:22.397467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07804667-4447-4645-88e6-db4f8d8dacc3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.971787 Jul 19 19:51:22.407887 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1265/2491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:21 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:22.441457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:22.442116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:22.448587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:22.456019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.462591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.465087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.474623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.702733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e87e906-f826-4f1a-bae5-e174402f1dc7 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "POST /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe/action" status: 202 len: 0 microversion: 2.1 time: 0.724932 Jul 19 19:51:22.709661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1227/2492] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:21 2022] POST /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:51:22.722832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8800f9d7-f781-44f7-8e51-35d7ba6a0dfc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400a30d30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:22.819043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8800f9d7-f781-44f7-8e51-35d7ba6a0dfc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.104513 Jul 19 19:51:22.827024 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1228/2493] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:22 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:22.883638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8376b263-28af-40ff-bad2-f0f5bdd419ae req-091d9e8b-1be7-4ade-a9fc-d7e7eb90cadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca4469c-d47e-4dd7-8c38-0e3902be7d95", "name": "network-vif-plugged", "status": "completed", "tag": "1605e3c5-9a0a-41f9-877a-c642e4982a05"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:22.918776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8376b263-28af-40ff-bad2-f0f5bdd419ae req-091d9e8b-1be7-4ade-a9fc-d7e7eb90cadd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:22.922839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8376b263-28af-40ff-bad2-f0f5bdd419ae req-091d9e8b-1be7-4ade-a9fc-d7e7eb90cadd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:22.971169 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8376b263-28af-40ff-bad2-f0f5bdd419ae req-091d9e8b-1be7-4ade-a9fc-d7e7eb90cadd service nova] Creating event network-vif-plugged:1605e3c5-9a0a-41f9-877a-c642e4982a05 for instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 on n-h2-843834-3 Jul 19 19:51:23.012849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8376b263-28af-40ff-bad2-f0f5bdd419ae req-091d9e8b-1be7-4ade-a9fc-d7e7eb90cadd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150085 Jul 19 19:51:23.013905 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1229/2494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:23.416658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:23.418112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:23.443349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.449319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.450379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:23.452268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:23.982235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:23.993182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.000698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.002227 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8b4e220-e573-48e7-9070-36c075140d29 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1750 microversion: 2.20 time: 1.565273 Jul 19 19:51:24.002800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1266/2495] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:22 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1750 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:24.012327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5f9da8a-fd11-4c11-8f67-a08ade3ec0c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23efbba280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:24.027967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:24.041070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df2fbd27-c2c9-4c78-8ddd-508d426f7f45 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1315 microversion: 2.1 time: 0.630454 Jul 19 19:51:24.045617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1230/2496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:23 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:24.137906 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5f9da8a-fd11-4c11-8f67-a08ade3ec0c4 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.106170 Jul 19 19:51:24.138965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1267/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:25.028297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.031710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:25.069666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.073952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.081387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.082572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.290682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcf04e4e-cf1b-4e2d-b292-c5455f9762e5 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] Calling method '.version_select at 0x7f23ef5edf70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.292640 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:51:25.292640 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 19:51:25.325877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcf04e4e-cf1b-4e2d-b292-c5455f9762e5 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.504654 Jul 19 19:51:25.326595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1231/2498] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:51:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:25.342229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.343208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:25.356468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.357872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.359281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.363860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.541932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:25.557196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:25.562623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:25.566309 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1a170f72-ea82-4c91-83d8-a9ff546d95f6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.543044 Jul 19 19:51:25.583006 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1268/2499] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:25 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:25.610403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b5dbba46-c23f-413a-b769-ca3dd2fcdbee req-f5996b78-0d2d-4914-b3a1-4e0bfdb1e03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-unplugged", "status": "completed", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:25.634137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b5dbba46-c23f-413a-b769-ca3dd2fcdbee req-f5996b78-0d2d-4914-b3a1-4e0bfdb1e03c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:25.634803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b5dbba46-c23f-413a-b769-ca3dd2fcdbee req-f5996b78-0d2d-4914-b3a1-4e0bfdb1e03c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:25.660100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b5dbba46-c23f-413a-b769-ca3dd2fcdbee req-f5996b78-0d2d-4914-b3a1-4e0bfdb1e03c service nova] Creating event network-vif-unplugged:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:51:25.676900 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b5dbba46-c23f-413a-b769-ca3dd2fcdbee req-f5996b78-0d2d-4914-b3a1-4e0bfdb1e03c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092091 Jul 19 19:51:25.677533 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1269/2500] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:25.683178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e1d608a-4cf3-4d57-8117-c4bf8c81b94a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23efb605e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:25.769717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e1d608a-4cf3-4d57-8117-c4bf8c81b94a tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.090654 Jul 19 19:51:25.776218 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1270/2501] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:25 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:25.777703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e1b8ceb-12d2-49f3-82ae-82804d47bcdd tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] Action: 'update', calling method: .version_select at 0x7f23efbba3a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:25.780682 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:51:25.780682 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:51:26.143625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:26.158796 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-18c39643-93d6-4690-8818-9d5ad8fce38f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1502 microversion: 2.1 time: 0.830802 Jul 19 19:51:26.170327 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1232/2502] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:25 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1502 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:26.247299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e1b8ceb-12d2-49f3-82ae-82804d47bcdd tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.474967 Jul 19 19:51:26.248730 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1271/2503] 10.222.0.23 () {60 vars in 1205 bytes} [Tue Jul 19 19:51:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:26.253945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:26.260004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:26.274892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.275740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:26.276825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.280731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:26.290171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-555137107", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:26.329495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lazy-loading 'flavor' on Instance uuid 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:26.417522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:26.438613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] validate_networks() for [('ea6f8e10-4d4c-4e15-85b0-219c7b75560e', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:26.832557 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a193bae2-eb7a-4038-b1ab-d06ccfb48447 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95/action" status: 202 len: 0 microversion: 2.1 time: 0.582378 Jul 19 19:51:26.836169 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1272/2504] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:26 2022] POST /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:26.847469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fae7505d-8355-4b7f-ad67-d408f2cae869 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] Calling method '.version_select at 0x7f23ef808b80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:26.848508 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:51:26.848508 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:51:26.882535 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fae7505d-8355-4b7f-ad67-d408f2cae869 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.048089 Jul 19 19:51:26.887773 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1273/2505] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 19:51:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:26.897480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:26.902077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:26.917615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.920921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:26.921987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:26.925746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.260680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:27.273292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:27.274806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:27.276034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e23c6a0a-7475-4001-804a-5c186d248b85 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.386962 Jul 19 19:51:27.306691 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1274/2506] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:26 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:27.319932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-425d3882-db3a-4ee4-919b-35f78eea5875 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef81e9d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:27.407280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-425d3882-db3a-4ee4-919b-35f78eea5875 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.099252 Jul 19 19:51:27.408264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1275/2507] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:27 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:27.717756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "63918403-32ad-47ad-9b66-fc0e8e26f59b"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:27.719206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:27.751588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.764598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:27.765809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:27.766425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.013315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] HTTP exception thrown: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Request method failure captured: Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments/348c02c9-4d13-47ba-9511-bf39b06503d6 HTTP/1.1 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 74 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wrfOAYuomli7zBc8LglSxPryd16BfjzjQZQEg7B2BinzYVxD52l4_nN5kALbcLsPW3rCIBuD9qUn5VvsR2sQOT_LwRxWlh5v4WDbrG_6DdoEC1dM5VkNnV-crmqNaT5ajZX5yNWuc-_TLnb7mtr8nWa9rTsK4Ij2qzr6K4jCmgCezc Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 9ca546e255bf4273bbc6e936c0ca4f19 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 9ca546e255bf4273bbc6e936c0ca4f19 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesAdminNegativeTest-1873068298-project-admin Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 672090f5fc5d4fbd94c269bfdc5d805a Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesAdminNegativeTest-1873068298-project-admin Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: {"volumeAttachment": {"volumeId": "63918403-32ad-47ad-9b66-fc0e8e26f59b"}} Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '63896c76-b7b6-43ca-8b9d-ed5d38a91c15', 'id': '348c02c9-4d13-47ba-9511-bf39b06503d6', 'body': {'volumeAttachment': {'volumeId': '63918403-32ad-47ad-9b66-fc0e8e26f59b'}}} Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. (HTTP 404) (Request-ID: req-ea9f6012-f686-4881-b6b2-d781751fd5e4) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:51:28.044941 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. Jul 19 19:51:28.049764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:51:28.062559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Returning 400 to user: Volume 63918403-32ad-47ad-9b66-fc0e8e26f59b could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:28.063979 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a4a97ce-ce5e-423f-9944-eb2e9851bdd7 tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments/348c02c9-4d13-47ba-9511-bf39b06503d6" status: 400 len: 107 microversion: 2.1 time: 0.654649 Jul 19 19:51:28.064848 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1276/2508] 10.222.0.23 () {60 vars in 1432 bytes} [Tue Jul 19 19:51:27 2022] PUT /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments/348c02c9-4d13-47ba-9511-bf39b06503d6 => generated 107 bytes in 656 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:51:28.071169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:28.072455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:28.094658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.095548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.098669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.099458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.375455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:28.375930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:28.376370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:28.376944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:28.377498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:28.409757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.410213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.411039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.411485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.495387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Getting quotas for project c50f7a386f604111b0af7ddd603d4490. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:28.519556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Getting quotas for user dd8981ee6a2545af87960b16c2d48e89 and project c50f7a386f604111b0af7ddd603d4490. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:28.574809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:28.577477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:28.582769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:28.591729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b05f8d65-79bb-4100-a94e-1336b2ce53e3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.525006 Jul 19 19:51:28.600918 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1277/2509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:28 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:28.612431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eeafdda7-5448-4031-8065-99beb665d2a6 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] Action: 'update', calling method: .version_select at 0x7f23efbba160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:28.623080 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 19:51:28.623080 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 19:51:28.726228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80a9e675-b322-4179-9662-416c73c284ae tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.562325 Jul 19 19:51:28.731502 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1233/2510] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:51:28.736721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f8c2acc6-7307-47a8-aab5-14ad85c8439a req-49a43061-63f1-42ce-a652-072d1db7b060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-plugged", "status": "completed", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:28.756016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f8c2acc6-7307-47a8-aab5-14ad85c8439a req-49a43061-63f1-42ce-a652-072d1db7b060 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.766864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f8c2acc6-7307-47a8-aab5-14ad85c8439a req-49a43061-63f1-42ce-a652-072d1db7b060 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.819306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f8c2acc6-7307-47a8-aab5-14ad85c8439a req-49a43061-63f1-42ce-a652-072d1db7b060 service nova] Creating event network-vif-plugged:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:51:28.845829 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f8c2acc6-7307-47a8-aab5-14ad85c8439a req-49a43061-63f1-42ce-a652-072d1db7b060 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105915 Jul 19 19:51:28.846866 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1234/2511] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:28.861830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:28.862886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:28.872633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eeafdda7-5448-4031-8065-99beb665d2a6 tempest-QuotaClassesAdminTestJSON-479966883 tempest-QuotaClassesAdminTestJSON-479966883-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.267856 Jul 19 19:51:28.875201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1278/2512] 10.222.0.23 () {60 vars in 1205 bytes} [Tue Jul 19 19:51:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:28.877198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.879598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.880653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.885271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.910429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:28.911086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:28.971205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.971705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:28.972553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:28.972995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:29.233960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lazy-loading 'services' on Instance uuid 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:29.246744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:29.491228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e2adefc-d69f-4418-ab1e-d257510e7bf7 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments/348c02c9-4d13-47ba-9511-bf39b06503d6" status: 202 len: 0 microversion: 2.1 time: 0.638670 Jul 19 19:51:29.492133 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1235/2513] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 19:51:28 2022] DELETE /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments/348c02c9-4d13-47ba-9511-bf39b06503d6 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:29.523617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6788d360-69d7-4a0c-a2b2-628c6d89add3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400aa28b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:29.638781 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6788d360-69d7-4a0c-a2b2-628c6d89add3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.140175 Jul 19 19:51:29.639473 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1236/2514] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:29 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:29.651050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-516bf3eb-4a8a-486e-89c3-c0914b7f640a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:29.663425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-516bf3eb-4a8a-486e-89c3-c0914b7f640a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:30.017179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-516bf3eb-4a8a-486e-89c3-c0914b7f640a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:30.030682 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-516bf3eb-4a8a-486e-89c3-c0914b7f640a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1222 microversion: 2.1 time: 0.384021 Jul 19 19:51:30.047055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1237/2515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:29 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:30.057546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8f22c692-1f1d-4582-b7f0-45bc63c805f4 req-873c9823-e294-4a09-8c7c-19a7da647318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:30.075049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8f22c692-1f1d-4582-b7f0-45bc63c805f4 req-873c9823-e294-4a09-8c7c-19a7da647318 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:30.080439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8f22c692-1f1d-4582-b7f0-45bc63c805f4 req-873c9823-e294-4a09-8c7c-19a7da647318 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:30.148384 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8f22c692-1f1d-4582-b7f0-45bc63c805f4 req-873c9823-e294-4a09-8c7c-19a7da647318 service nova] Creating event network-changed:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h2-843834-3 Jul 19 19:51:30.148935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:30.162211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8f22c692-1f1d-4582-b7f0-45bc63c805f4 req-873c9823-e294-4a09-8c7c-19a7da647318 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113425 Jul 19 19:51:30.165457 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1238/2516] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:30.174358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:30.176454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:30.185529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:30.195500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:30.205359 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cdc28665-b020-4272-ad9f-6fbf12f9b80b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 1.321636 Jul 19 19:51:30.208162 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1279/2517] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:28 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:30.212088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:30.213412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:30.215820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:30.228369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:30.230696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:30.231643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:30.256434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:30.259436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:30.262712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:30.265848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:30.317458 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4dcbc92-89af-410c-bd97-b2c85c7c6739 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150620 Jul 19 19:51:30.318422 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1239/2518] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:30 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:30.652217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c174aeb-4b71-4434-b5ea-314a4c79debc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f2400a7d3a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:30.755029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5c174aeb-4b71-4434-b5ea-314a4c79debc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.106650 Jul 19 19:51:30.755784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1240/2519] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:30 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:31.053709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:31.054681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:31.058048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:31.101502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.102376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.103455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.104111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.511620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:31.526051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e747d307-3785-4c96-9899-ec13b31d76b5 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1274 microversion: 2.1 time: 0.476107 Jul 19 19:51:31.528309 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1241/2520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:31 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1274 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:31.541582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:31.544715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:31.603605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.606275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:31.609190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:31.611081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.707368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:32.724378 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5079cd60-9d59-4893-aab9-f2928d6df732 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 2.512728 Jul 19 19:51:32.738185 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1280/2521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:30 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:32.755788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:32.757195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:32.771942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.775657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.779121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:32.783174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:32.863729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-260f0c25-06bf-4e0c-b1d6-685a318ce388 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123971 Jul 19 19:51:32.864354 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1281/2522] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:32.887527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-975e6794-dcb0-48a9-8567-c15b9f2fbaa3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef966310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:32.992863 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-975e6794-dcb0-48a9-8567-c15b9f2fbaa3 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.119686 Jul 19 19:51:32.994531 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1282/2523] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:33.007471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.010147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:33.027524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.028204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.029201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.040708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.209625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.259877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.263042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.266586 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fae34fe3-6600-46b2-bd71-b0adacca7fca tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 1.734962 Jul 19 19:51:33.269076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:33.271132 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1242/2524] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:31 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:33.278856 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a47fa4f1-6723-4f0c-beb3-45fb3b25662a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1280 microversion: 2.1 time: 0.282910 Jul 19 19:51:33.290081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1283/2525] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:32 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:33.755424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.756315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:33.766820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.771322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.773160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.776018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.880235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:33.898567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:33.934860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.935528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:33.936563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:33.939589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.055078 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e04f520-c7ff-485a-a726-3a6665a34d33 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182873 Jul 19 19:51:34.056736 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1284/2526] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:33 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:34.067878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cfa0d753-816e-46da-97ee-ce075a165ce6 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef7d2f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.261226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cfa0d753-816e-46da-97ee-ce075a165ce6 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1426 microversion: 2.1 time: 0.203106 Jul 19 19:51:34.262177 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1285/2527] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:34 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1426 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:34.296191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:34.297137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:34.309177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=24,nova_api:INSERT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:34.314359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.323299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:34.324912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:34.327476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.263284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.280531 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3f56cc6-17bb-4a8a-b8a2-3f190636f85b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 1.538820 Jul 19 19:51:35.284590 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1243/2528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:33 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:35.304223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.309779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:35.329140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.333653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.337621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.345137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.400798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.413767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.439453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.460830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-501ebd2e-6889-48a7-98fe-a9b028d7722d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 1.156457 Jul 19 19:51:35.462209 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1286/2529] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:34 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:35.492185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-162a9487-c466-4dd6-8c21-59a4ed3e0898 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Action: 'create', calling method: .version_select at 0x7f23ef85d430>, body: {"keypair": {"name": "tempest-keypair-1632026081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhaAgh5rDx+lXpYM6ca4VEedJxvUQrQDv5JDdwcjtlA7bgm8Al7+NBL1qa0KA7U9tYnG64JnrGw9DwrEklod2gard2buMbCceFamC0hRS4Wso67e0X3pdc4qRqnM8tNsg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:35.556571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-162a9487-c466-4dd6-8c21-59a4ed3e0898 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Getting quotas for project 6f519e5e8619449ab545ebb05fd23722. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:35.591337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-162a9487-c466-4dd6-8c21-59a4ed3e0898 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Getting quotas for user 97fc2886fd0c44af87fecd3a9c2000cd and project 6f519e5e8619449ab545ebb05fd23722. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:35.596178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:35.629459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23fc6b7d-9177-4417-80e3-f08184ab55b2 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1280 microversion: 2.1 time: 0.336934 Jul 19 19:51:35.655574 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1244/2530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:35.657174 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-162a9487-c466-4dd6-8c21-59a4ed3e0898 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.192559 Jul 19 19:51:35.666181 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1287/2531] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:51:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 19:51:35.687252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.693238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:35.710422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-928d5bfe-01ee-4a89-8e72-00d02b62f9ff tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef81e1f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:35.716299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.717036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.718761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:35.724727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:35.804092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ee4f4f52-03f9-4466-9993-2b83fbb2b97d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146927 Jul 19 19:51:35.805289 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1245/2532] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:36.302737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:36.304325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:36.320200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.324038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:36.325093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:36.327527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.078233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:37.102321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1423a111-c44e-4913-8b38-9464c9ba2570 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.803993 Jul 19 19:51:37.102951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1246/2533] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:36 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:37.137445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:37.155716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:37.209929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.214883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:37.224824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:37.231975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.273130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.293514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.302998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:38.313051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2ad14121-30e2-4719-8752-f9587d631362 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 1.202071 Jul 19 19:51:38.314166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1247/2534] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:37 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:38.347263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:38.355107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:38.371859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.381286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.386946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:38.389196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:38.443715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:39.406796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:39.449119 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3217b8f-f02e-4238-9bcc-2dc99ac65770 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1322 microversion: 2.1 time: 1.130169 Jul 19 19:51:39.464734 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1248/2535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:38 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1322 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:39.492448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.510898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.539468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.542364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.548933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.549741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.648971 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-052bcf63-c43d-4fb5-aeb5-fc717ac225c0 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182032 Jul 19 19:51:39.650406 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1249/2536] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:39.658631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:39.659560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:39.677638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.681302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:39.682789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:39.686637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.026079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:40.673077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:40.707161 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f712c117-349a-4ee2-bd11-202143c396cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 1.031693 Jul 19 19:51:40.708168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1250/2537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:39 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:40.713365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:40.714305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:40.732286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.732951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:40.733917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:40.740448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.178135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.190470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.198039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.223195 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-02d96c18-3c6a-4e9e-85a0-5981669e6cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.504214 Jul 19 19:51:41.235315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1251/2538] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:40 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:41.242473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:41.247662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:41.265903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.266625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.267629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:41.268230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:41.696554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:41.711856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0381e21-0d3b-4946-b013-53bbe97caf13 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1322 microversion: 2.1 time: 0.474995 Jul 19 19:51:41.712690 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1252/2539] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:41 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:42.038037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ffc74087-02ef-45e2-8c1f-b49a07156d62 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef47af70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:42.166265 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ffc74087-02ef-45e2-8c1f-b49a07156d62 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836" status: 200 len: 371 microversion: 2.1 time: 0.447424 Jul 19 19:51:42.168429 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1253/2540] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:51:41 2022] GET /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836 => generated 371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:42.189825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-743635618", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c6122f78-27ad-4d26-b711-526d5d05e523"}, {"port": "91990a06-1178-4654-8553-4a053eda5e1c", "tag": "port-1"}, {"port": "32137e5f-76f6-4923-948b-dea0b9940b3d", "tag": "port-2"}, {"uuid": "8522ef66-ce72-49f4-b100-e9e92224d83c", "tag": "net-1"}, {"uuid": "8522ef66-ce72-49f4-b100-e9e92224d83c"}, {"uuid": "5c9a022a-f736-43f9-860f-d95cd40161d0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5c9a022a-f736-43f9-860f-d95cd40161d0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c7787611-1bdc-4f2e-8505-f638176ee000", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4c1bbc35-7e40-47e4-adcf-478efb3f493f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "697933ae-ea20-4e64-bdac-47062466ca22", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2084441600"}], "key_name": "tempest-keypair-1632026081", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:45.409036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:45.610270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:45.644920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:48.501959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-928d5bfe-01ee-4a89-8e72-00d02b62f9ff tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1435 microversion: 2.1 time: 12.821929 Jul 19 19:51:48.507525 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1288/2541] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:35 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1435 bytes in 12840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:48.514728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.520355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:48.535578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.536343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.537322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.537915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.577231 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-725ee8ab-592a-4668-a072-efd163da29bd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068197 Jul 19 19:51:48.578431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1289/2542] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:51:48.595607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-61eafd48-1e13-4023-b139-efde7dbabf9e req-606e9ffc-a307-4916-91ec-833b932ff2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:48.615204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61eafd48-1e13-4023-b139-efde7dbabf9e req-606e9ffc-a307-4916-91ec-833b932ff2c2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.616556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61eafd48-1e13-4023-b139-efde7dbabf9e req-606e9ffc-a307-4916-91ec-833b932ff2c2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.642891 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-61eafd48-1e13-4023-b139-efde7dbabf9e req-606e9ffc-a307-4916-91ec-833b932ff2c2 service nova] Creating event network-changed:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:51:48.655949 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-61eafd48-1e13-4023-b139-efde7dbabf9e req-606e9ffc-a307-4916-91ec-833b932ff2c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063940 Jul 19 19:51:48.658423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] validate_networks() for [('c6122f78-27ad-4d26-b711-526d5d05e523', None, None, None, None, None), (None, None, '91990a06-1178-4654-8553-4a053eda5e1c', None, None, None), (None, None, '32137e5f-76f6-4923-948b-dea0b9940b3d', None, None, None), ('8522ef66-ce72-49f4-b100-e9e92224d83c', None, None, None, None, None), ('8522ef66-ce72-49f4-b100-e9e92224d83c', None, None, None, None, None), ('5c9a022a-f736-43f9-860f-d95cd40161d0', '10.2.2.100', None, None, None, None), ('5c9a022a-f736-43f9-860f-d95cd40161d0', '10.2.2.200', None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:48.666727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1290/2543] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:48.682284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:48.683305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:48.709920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.711129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:48.712200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:48.712876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.547894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:49.557163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1832b55-5015-490a-ae20-6c2f683ae547 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.888645 Jul 19 19:51:49.569335 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1291/2544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:48 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:49.582575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef89e430>, body: {"quota_set": {"ram": "5120"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:49.694753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.695522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.697544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.698226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.766261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3c0ce2a-bddb-4920-9e31-22d99869639c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836" status: 200 len: 328 microversion: 2.1 time: 0.195377 Jul 19 19:51:49.776770 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1292/2545] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:51:49 2022] PUT /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836 => generated 328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:49.786753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:49.787531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:49.804396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.804844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:49.807389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:49.808079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.209147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.218375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.219913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.227705 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-506107d2-e222-4525-8239-1ad2ba3892ff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.449512 Jul 19 19:51:50.243051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1293/2546] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:49 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:50.253142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.254269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:50.268810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.273878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.275001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.275605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.680302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:50.689774 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a7dca1cb-4e29-4f6d-8a4a-8b1d32c930d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1322 microversion: 2.1 time: 0.445227 Jul 19 19:51:50.692240 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1294/2547] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.698734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b64836bf-1c34-4744-9313-313acb31ee9b tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef81e430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:50.789609 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b64836bf-1c34-4744-9313-313acb31ee9b tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 200 len: 1435 microversion: 2.1 time: 0.093621 Jul 19 19:51:50.792133 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1295/2548] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:51:50 2022] GET /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 1435 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:50.810725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a7e43d47-648e-4858-ba35-6d4218653f34 req-0bba2da1-4686-4132-83fb-bcce774b26f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "name": "network-vif-plugged", "status": "completed", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:50.844392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a7e43d47-648e-4858-ba35-6d4218653f34 req-0bba2da1-4686-4132-83fb-bcce774b26f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:50.847577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a7e43d47-648e-4858-ba35-6d4218653f34 req-0bba2da1-4686-4132-83fb-bcce774b26f7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:50.870767 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a7e43d47-648e-4858-ba35-6d4218653f34 req-0bba2da1-4686-4132-83fb-bcce774b26f7 service nova] Creating event network-vif-plugged:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:51:50.883276 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a7e43d47-648e-4858-ba35-6d4218653f34 req-0bba2da1-4686-4132-83fb-bcce774b26f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088346 Jul 19 19:51:50.884954 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1296/2549] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:50.897247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1523492667", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "37635a60-68cb-4791-83ae-ac3a6be38a37"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:51.023146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] validate_networks() for [('37635a60-68cb-4791-83ae-ac3a6be38a37', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:51:51.705138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:51.801994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:51.802518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:51.803196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:51.803733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:51.804242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:51.819520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:51.820047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:51.821179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:51.821618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:51.840276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:51.845698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Getting quotas for user 0170aafaff4847149210c7b6b73862cf and project 61012f87f99940e884c8f2cf0ebc702e. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:51.859887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:51.862559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:51.955420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71b2882e-ebce-4ef1-a275-fca0351cbf70 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065338 Jul 19 19:51:51.957761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1297/2550] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:51:51.965648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f0ac469e-3037-4852-8e10-5b66a32459ae tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:51.985663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f0ac469e-3037-4852-8e10-5b66a32459ae tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836" status: 202 len: 0 microversion: 2.1 time: 0.026185 Jul 19 19:51:51.987177 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1298/2551] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:51:51 2022] DELETE /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:51:51.994734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:51.995435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.013965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.014427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.015252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.015733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.147509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:52.273683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:52.289644 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81b2146b-bc64-4714-a95c-409e5988eceb tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.301948 Jul 19 19:51:52.298945 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1299/2552] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:51 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:52.298945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:52.298945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.304538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.305003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.305813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.306261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.724632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:52.736993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b132e685-6c9a-4d50-95ca-c03984079120 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1465 microversion: 2.1 time: 0.445158 Jul 19 19:51:52.738835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1300/2553] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:52 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1465 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:52.747462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:52.750301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:52.757310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.758232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.759783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:52.760337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:52.985067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.012909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.015046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.016766 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d63d79c8-92c4-4aac-9186-6fe005f30417 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.276634 Jul 19 19:51:53.017906 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1301/2554] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:52 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:53.023186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.024092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:53.033689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.034512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.035639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.036590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.405906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.415857 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1535c355-3860-48a2-97aa-f0bb0e26fb37 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1516 microversion: 2.1 time: 0.396344 Jul 19 19:51:53.416871 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1302/2555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:53.423051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.424016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:53.431080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.431804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.432604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:53.433143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:53.858231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:53.866432 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3725b3ce-742a-420a-a0ad-3197a1400368 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1276 microversion: 2.1 time: 0.447315 Jul 19 19:51:53.876059 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1303/2556] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:53.876059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab938867-f14a-4efd-908b-9f623ae589e2 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef808940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:53.956185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab938867-f14a-4efd-908b-9f623ae589e2 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836" status: 200 len: 371 microversion: 2.1 time: 0.087093 Jul 19 19:51:53.957026 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1304/2557] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:51:53 2022] GET /compute/v2.1/os-quota-sets/9bc95f7c77bb48b9b6fdec0f75f34836 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:53.965509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ed42d19-c83c-4a35-a714-49259475ce6d tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef7bc280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:54.408370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:51:54.409448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:51:54.410146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:51:54.410559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:51:54.410959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:51:54.425333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.425975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.426995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.427447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.447761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Getting quotas for project 6f519e5e8619449ab545ebb05fd23722. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:51:54.453317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Getting quotas for user 97fc2886fd0c44af87fecd3a9c2000cd and project 6f519e5e8619449ab545ebb05fd23722. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:51:54.684894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:51:54.689564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c7787611-1bdc-4f2e-8505-f638176ee000',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4c1bbc35-7e40-47e4-adcf-478efb3f493f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='697933ae-ea20-4e64-bdac-47062466ca22',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:51:54.773395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ed42d19-c83c-4a35-a714-49259475ce6d tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "DELETE /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2" status: 204 len: 0 microversion: 2.1 time: 0.815224 Jul 19 19:51:54.775497 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1305/2558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:53 2022] DELETE /compute/v2.1/images/ab8887cf-3265-4dfa-b36a-a24cef2a4ec2 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:54.780883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9f9bc72c-1fcf-4223-aebd-0e85ebd6548c req-d688731a-976a-4623-b7fc-ab15f6a67298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-unplugged", "status": "completed", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:54.791100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9f9bc72c-1fcf-4223-aebd-0e85ebd6548c req-d688731a-976a-4623-b7fc-ab15f6a67298 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.791851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9f9bc72c-1fcf-4223-aebd-0e85ebd6548c req-d688731a-976a-4623-b7fc-ab15f6a67298 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.804378 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9f9bc72c-1fcf-4223-aebd-0e85ebd6548c req-d688731a-976a-4623-b7fc-ab15f6a67298 service nova] Creating event network-vif-unplugged:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:51:54.816680 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9f9bc72c-1fcf-4223-aebd-0e85ebd6548c req-d688731a-976a-4623-b7fc-ab15f6a67298 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039713 Jul 19 19:51:54.817367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1306/2559] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:54.834520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:54.836485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:54.849466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.850259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:54.851666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:54.852553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.153716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.169302 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0ef190e-04d0-4b73-afd0-cabbbf8c8c61 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.344439 Jul 19 19:51:55.173896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1307/2560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:54 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:55.190378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:55.192258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.201505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.205941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.207097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.207693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.237023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lazy-loading 'flavor' on Instance uuid 312a01af-ccf8-4a0e-a5ae-cc148049247d {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:51:55.252132 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac41cf1a-2f90-460e-b344-cf2ca6460a84 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 13.074804 Jul 19 19:51:55.258495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1254/2561] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Jul 19 19:51:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 13089 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:51:55.275339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.276517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.283965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.284871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.286259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.286997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.374103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32368d11-5737-4f3a-a438-2030af61754b tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action" status: 200 len: 32 microversion: 2.1 time: 0.189572 Jul 19 19:51:55.374723 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1308/2562] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:51:55 2022] POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:51:55.385364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c03dd605-27b5-45bb-a351-df6cd2d1859a tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef6354c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.547849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.565313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.567510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.569354 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5edcacef-932e-4587-8bc4-71ab1d067868 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.309365 Jul 19 19:51:55.570832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1255/2563] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:55.592280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-575b0aa2-f9b0-442a-a9e8-4cf2ddca5590 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '.version_select at 0x7f23ef72d280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.627503 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-575b0aa2-f9b0-442a-a9e8-4cf2ddca5590 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] HTTP exception thrown: Image not found. Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-575b0aa2-f9b0-442a-a9e8-4cf2ddca5590 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Request method failure captured: Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 HTTP/1.1 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wrzhQksvzGiXDmmGgRYfPq_mOsNK0NCnm6QjcH7648zJWjYDCgjnIgBnxMLCOcUKrXl_5udM3xwbAIVR3zSBe7V5w2rjfgv_gcLCE3BCbDN7XVKjRNlWTh0ktOCjX5a5gC15y6tWGCJYhUhpM93VL6ievjpoWw3Tnx_JY6_FXGOpMw Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 882f7f3c47fa4ab19c97916f9d2961a7 Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7'} Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 to delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 could not be found. Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.632131 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:51:55.638388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-575b0aa2-f9b0-442a-a9e8-4cf2ddca5590 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:51:55.641266 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-575b0aa2-f9b0-442a-a9e8-4cf2ddca5590 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "DELETE /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7" status: 404 len: 62 microversion: 2.1 time: 0.066782 Jul 19 19:51:55.642298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1256/2564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:55 2022] DELETE /compute/v2.1/images/23d3d3e8-8f02-45c5-9bab-d5f8a4e3a5a7 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:51:55.649559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.652184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.674159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.674993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.676605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.677284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.739610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c03dd605-27b5-45bb-a351-df6cd2d1859a tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.363385 Jul 19 19:51:55.740540 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1309/2565] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22/defaults => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:55.747196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.748171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.929696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.947531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.956165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:55.959087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6492e8d1-06f2-4887-86e3-071c7210310b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1285 microversion: 2.32 time: 0.217247 Jul 19 19:51:55.960904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1310/2566] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:55.966713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:55.967928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:55.981292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.982022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:55.983270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:55.984156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.199383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:56.210399 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e5d4a41-a264-44fa-87ca-2649ee9badec tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.565104 Jul 19 19:51:56.211477 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1257/2567] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:56.217082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.217633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.235780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.236663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.237723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.238202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.297108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:51:56.323040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:56.335215 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f34c310-9871-4b30-ba78-61e53d006420 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 0.371345 Jul 19 19:51:56.335843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1311/2568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:55 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:56.344255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef7d2700>, body: {"quota_set": {"ram": "5120"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:56.526023 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00c7b241-09d7-49aa-914a-e598e10be3c2 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 204 len: 0 microversion: 2.1 time: 0.312712 Jul 19 19:51:56.530506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1258/2569] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:51:56 2022] DELETE /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:51:56.541473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.546293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.555028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.557979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.559021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.559732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.683905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.687164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.693223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.694153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.787668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:56.794472 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae144fed-cd5a-42d7-b8b1-0c941b95f03c tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc" status: 200 len: 328 microversion: 2.1 time: 0.455505 Jul 19 19:51:56.797620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7140fb42-d6e9-47d4-924f-58535e9ef9de tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.265560 Jul 19 19:51:56.799523 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1312/2570] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:51:56 2022] PUT /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc => generated 328 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:56.809821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1259/2571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:56.811538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-32a4a6cb-61e5-48c0-9287-22023871986d req-d232cc14-0ddd-4c38-bf5d-c2560dbb70f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88950277-b758-4235-badf-96603105b9b0", "tag": "3f45f1d7-2e90-4c9d-be9d-cfadecd19829"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:56.816620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.817577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.824860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-32a4a6cb-61e5-48c0-9287-22023871986d req-d232cc14-0ddd-4c38-bf5d-c2560dbb70f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.825280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.825473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-32a4a6cb-61e5-48c0-9287-22023871986d req-d232cc14-0ddd-4c38-bf5d-c2560dbb70f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.826230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.827319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.827988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.839975 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-32a4a6cb-61e5-48c0-9287-22023871986d req-d232cc14-0ddd-4c38-bf5d-c2560dbb70f1 service nova] Creating event network-changed:3f45f1d7-2e90-4c9d-be9d-cfadecd19829 for instance 88950277-b758-4235-badf-96603105b9b0 on n-h1-843834-3 Jul 19 19:51:56.845382 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-32a4a6cb-61e5-48c0-9287-22023871986d req-d232cc14-0ddd-4c38-bf5d-c2560dbb70f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044087 Jul 19 19:51:56.846102 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1313/2572] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:56.853012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:56.853928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:56.860908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.861464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.862334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:56.862850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:56.867809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:57.068971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.076422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.081927 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-388adfc2-49db-41b9-b652-b93bcc469cbc tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1471 microversion: 2.1 time: 0.268462 Jul 19 19:51:57.084500 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1260/2573] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:57.093717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.093717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.093717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1aff48d9-20f4-4f45-8551-85669ca2ba76 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.241293 Jul 19 19:51:57.093717 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1314/2574] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:56 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:57.094519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef85d0d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:57.108703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:57.110480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:57.120923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.122397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.123880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.124126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.169842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.170559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.171580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.172395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.195032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3611f67-43bb-4a15-9064-de63029e0503 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc/detail" status: 200 len: 916 microversion: 2.1 time: 0.104474 Jul 19 19:51:57.196291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1315/2575] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc/detail => generated 916 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:57.228009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:57.228883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:57.238780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.251089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.254936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.255775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.265614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.278958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.281008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.282415 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-654205c3-451e-44a2-aef2-4323c333466b tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1575 microversion: 2.32 time: 0.180174 Jul 19 19:51:57.283673 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1261/2576] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:57.354819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:57.355481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:57.361830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.362684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.365096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.365728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.652441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.662608 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e384475-515e-43d4-a25f-e4f81fba0768 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.438515 Jul 19 19:51:57.668727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1316/2577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:51:57.676808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Action: 'update', calling method: .version_select at 0x7f23ef64a310>, body: {"quota_set": {"ram": "2048"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:51:57.785465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:51:57.801458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.805896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.809475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.809956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.838318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:57.857910 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a31ab8fc-f98e-4744-841e-6b2050bf199c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 0.507470 Jul 19 19:51:57.859174 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1262/2578] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:57.867455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:57.868055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:57.888876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.896385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.897256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.897697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.906383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.907128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:57.911296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:57.911997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.135766 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2a14d28-a0f0-446f-895f-833e8660d4da tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc?user_id=b3e0ef14736a43edb8f58d73f9c485b9" status: 200 len: 328 microversion: 2.1 time: 0.456060 Jul 19 19:51:58.137647 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1317/2579] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:51:57 2022] PUT /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc?user_id=b3e0ef14736a43edb8f58d73f9c485b9 => generated 328 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:58.143623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.144535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.152776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.153507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.154492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.155202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.174249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.193650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecf61873-5d84-4b96-832c-6a1d840dfd10 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1508 microversion: 2.1 time: 0.332338 Jul 19 19:51:58.194272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1263/2580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:57 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:58.200910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.202532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.213320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.214308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.215726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.216344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.549642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.561847 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9a53a265-8701-45e8-bf6a-514eef9b34f0 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1471 microversion: 2.1 time: 0.422851 Jul 19 19:51:58.568489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1318/2581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:58.584546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e51fbc6-a338-45f3-9b6b-1afb3f916afb tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef8081f0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.728144 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e51fbc6-a338-45f3-9b6b-1afb3f916afb tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc?user_id=b3e0ef14736a43edb8f58d73f9c485b9" status: 200 len: 370 microversion: 2.1 time: 0.156759 Jul 19 19:51:58.736726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1319/2582] 10.222.0.23 () {58 vars in 1322 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/os-quota-sets/c2454a738b394b31a39824c7b2b131bc?user_id=b3e0ef14736a43edb8f58d73f9c485b9 => generated 370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:51:58.747991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.749831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.757811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.758382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.760488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.761588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.883999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.903794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.910406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:58.911758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecdb079f-e913-41ad-8203-6b84c863e497 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.715084 Jul 19 19:51:58.929518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1264/2583] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:58.936161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:58.936781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:58.962799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.963582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:58.964618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:58.965219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:59.000203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:59.021461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:59.028033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:59.031734 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29b70ff5-5ce5-49bd-9e91-80b1046ade28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1593 microversion: 2.32 time: 0.292532 Jul 19 19:51:59.033391 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1320/2584] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:51:59.049705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:59.051919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:59.073342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.076825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:59.082145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.082829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:59.610129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:51:59.626936 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f369d526-af5f-4873-a91a-205434b13994 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.689668 Jul 19 19:51:59.632290 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1265/2585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:58 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:51:59.654752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:51:59.655469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:51:59.666676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.667283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:51:59.668094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:51:59.668522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.171211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:00.185277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0a8816c-b1b5-4f9c-ba78-5a825fde91eb tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.147670 Jul 19 19:52:00.185920 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1321/2586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:59 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:00.202077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-94eec6a1-90fb-489a-968d-ec0bba105e0e tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Calling method '.version_select at 0x7f23ef7d2c10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:00.451434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:00.459340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e6ada17-ffb5-4a90-8ef9-671f09545b6a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1529 microversion: 2.1 time: 0.825943 Jul 19 19:52:00.462673 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1266/2587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:51:59 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1529 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:00.475623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:00.476492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:00.496110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.500100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-94eec6a1-90fb-489a-968d-ec0bba105e0e tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.312826 Jul 19 19:52:00.501465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1322/2588] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:52:00 2022] GET /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22/defaults => generated 371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:00.506458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:00.507380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.508530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.509898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.514369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:00.526567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.531595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:00.532672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:00.533264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.034282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.044108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.053913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.055517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8141a717-2343-45c6-8c29-498501218a1a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.552955 Jul 19 19:52:01.056643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1323/2589] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:00 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:01.079030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:01.080174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:01.087593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.088055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.088906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.089482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.471185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.489043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.493952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.495653 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f341724d-2d7a-4a9c-8729-0b0385fd9c6c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1661 microversion: 2.32 time: 0.437892 Jul 19 19:52:01.499185 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1324/2590] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:01 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1661 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:01.532345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Action: 'update', calling method: .version_select at 0x7f23efb17ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:01.577931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882f7f3c47fa4ab19c97916f9d2961a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f434859ea049848dc1ed47fc05cb60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:01.589817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44bb72c6-c83f-4637-9f56-98cd59335045 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 200 len: 1471 microversion: 2.1 time: 1.121864 Jul 19 19:52:01.595720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1267/2591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:00 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 1471 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:01.602623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:01.605005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:01.622353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:01.627631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.628397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:01.633818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:01.634598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.032949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:02.040593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10fc6430-24b4-429a-b7b3-8737e1fbc5af tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.442416 Jul 19 19:52:02.044198 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1268/2592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:01 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:02.052832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:02.065640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:02.081045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.083264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.087714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.089226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.139510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.146374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.148543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.150169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.651494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-839bcb09-4db4-4138-9193-dcd691621084 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22" status: 200 len: 329 microversion: 2.1 time: 1.120789 Jul 19 19:52:02.653391 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1325/2593] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Jul 19 19:52:01 2022] PUT /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22 => generated 329 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:02.668387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:02.671320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:02.708360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.714693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.718728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.719648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.796852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:02.821723 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24d35f80-4b0f-4ea2-9b06-05d00421c4a4 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 0.772250 Jul 19 19:52:02.828557 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1269/2594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:02 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:02.846097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-939a90a3-eab4-41f9-a65d-668d55f690d6 req-46c34e5c-108e-4ce8-9706-6d02da265ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec796ddf-846e-4d3d-b1ac-c8917a9be1fe", "name": "network-vif-deleted", "tag": "8688f4fb-3b4c-4ff6-b103-70f9bd8c868d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:02.866876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-939a90a3-eab4-41f9-a65d-668d55f690d6 req-46c34e5c-108e-4ce8-9706-6d02da265ec2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.868489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-939a90a3-eab4-41f9-a65d-668d55f690d6 req-46c34e5c-108e-4ce8-9706-6d02da265ec2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.902350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-939a90a3-eab4-41f9-a65d-668d55f690d6 req-46c34e5c-108e-4ce8-9706-6d02da265ec2 service nova] Creating event network-vif-deleted:8688f4fb-3b4c-4ff6-b103-70f9bd8c868d for instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe on n-h1-843834-3 Jul 19 19:52:02.925587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-939a90a3-eab4-41f9-a65d-668d55f690d6 req-46c34e5c-108e-4ce8-9706-6d02da265ec2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095204 Jul 19 19:52:02.928476 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1270/2595] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:02.947068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:02.948951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:02.972136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.976038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:02.977087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:02.978946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:03.048833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:03.216374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:03.232677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae0d274c-6879-4d8f-9093-5e0d8748e92d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 0.576261 Jul 19 19:52:03.241268 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1326/2596] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:02 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:03.263597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:03.265171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:03.276676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:03.278746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:03.281408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:03.282217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:03.458515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:03.467850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:03.469280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:03.470481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52fc1d01-cf87-4c9c-8bc6-bc05ecff7876 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.540457 Jul 19 19:52:03.494371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1271/2597] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:02 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:03.501008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:03.502397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] [instance: ec796ddf-846e-4d3d-b1ac-c8917a9be1fe] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:03.510428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:03.515752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:03.516968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:03.517642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:03.554407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] HTTP exception thrown: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Request method failure captured: Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe HTTP/1.1 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wrzhQksvzGiXDmmGgRYfPq_mOsNK0NCnm6QjcH7648zJWjYDCgjnIgBnxMLCOcUKrXl_5udM3xwbAIVR3zSBe7V5w2rjfgv_gcLCE3BCbDN7XVKjRNlWTh0ktOCjX5a5gC15y6tWGCJYhUhpM93VL6ievjpoWw3Tnx_JY6_FXGOpMw Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1f434859ea049848dc1ed47fc05cb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d1f434859ea049848dc1ed47fc05cb60 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-774230051 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 882f7f3c47fa4ab19c97916f9d2961a7 Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerTestJSON-774230051-project Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ec796ddf-846e-4d3d-b1ac-c8917a9be1fe'} Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:03.558862 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. Jul 19 19:52:03.562682 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:03.569660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] Returning 404 to user: Instance ec796ddf-846e-4d3d-b1ac-c8917a9be1fe could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:03.574025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-97723d1d-4237-4d6c-8a7f-3b07a9250c65 tempest-ImagesOneServerTestJSON-774230051 tempest-ImagesOneServerTestJSON-774230051-project] 10.222.0.23 "GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe" status: 404 len: 111 microversion: 2.1 time: 0.077886 Jul 19 19:52:03.582014 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1272/2598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:03 2022] GET /compute/v2.1/servers/ec796ddf-846e-4d3d-b1ac-c8917a9be1fe => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:03.601522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Action: 'update', calling method: .version_select at 0x7f23fc4cee50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:04.089233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:04.108884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:04.110881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:04.112677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b905e30-578d-4ec4-ba0a-e17afd7492d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1661 microversion: 2.32 time: 0.870318 Jul 19 19:52:04.115346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1327/2599] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:03 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1661 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:04.120582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:04.129362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:04.145780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.148310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.151328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.153761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.438148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:04.467849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:04.534982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:04.552316 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0e0d9ce8-bba6-47e4-937a-a9e72613a243 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.427312 Jul 19 19:52:04.565173 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1328/2600] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:04 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:04.570692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-44204219-3343-4350-af50-64a32444c5aa req-75fd514e-84dc-46c4-bd5d-8cf4dbe38ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "name": "network-vif-plugged", "status": "completed", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:04.586734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.587700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.589045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.589681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.618703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-44204219-3343-4350-af50-64a32444c5aa req-75fd514e-84dc-46c4-bd5d-8cf4dbe38ba6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.622871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-44204219-3343-4350-af50-64a32444c5aa req-75fd514e-84dc-46c4-bd5d-8cf4dbe38ba6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.674838 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-44204219-3343-4350-af50-64a32444c5aa req-75fd514e-84dc-46c4-bd5d-8cf4dbe38ba6 service nova] Creating event network-vif-plugged:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h2-843834-3 Jul 19 19:52:04.696283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-44204219-3343-4350-af50-64a32444c5aa req-75fd514e-84dc-46c4-bd5d-8cf4dbe38ba6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127418 Jul 19 19:52:04.716288 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1329/2601] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:04.743217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:04.748363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:04.788624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.792160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:04.796218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:04.797816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:05.435001 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2cd8d1f4-3c2f-4e58-907a-86cdba020929 tempest-QuotasAdminTestJSON-1064088205 tempest-QuotasAdminTestJSON-1064088205-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22" status: 200 len: 329 microversion: 2.1 time: 1.851425 Jul 19 19:52:05.437909 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1273/2602] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Jul 19 19:52:03 2022] PUT /compute/v2.1/os-quota-sets/8d1bb4188b0a4df5ad6a91b45647fa22 => generated 329 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:05.450049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:05.452085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:05.468737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:05.472657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:05.473682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:05.474272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:05.653466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:05.688559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d508d334-3b72-4236-8019-a7ebf4dbb7df tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 0.942028 Jul 19 19:52:05.704468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1330/2603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:04 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:05.714990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:05.716079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:05.726249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:05.726904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:05.727966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:05.735493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.226854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:06.239930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84a67501-10fc-499f-93c7-48547c3f0b33 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 0.800789 Jul 19 19:52:06.254094 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1274/2604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:05 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:06.267569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:06.268212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:06.287063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:06.287525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.288362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:06.288796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.397633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:06.418637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:06.421398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:06.425276 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7babb90c-aa0d-463f-a1f1-961c729c3d32 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 0.717134 Jul 19 19:52:06.426857 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1331/2605] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:05 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:06.434176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:06.437562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:06.452286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:06.456341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.457555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:06.458192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:06.983841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:07.017092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df4a788c-e12e-4d89-b71b-e088d590c8f3 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 0.575072 Jul 19 19:52:07.022497 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1332/2606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:06 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:07.044455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:07.054511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:07.105133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:07.111008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:07.112359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:07.112821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:07.165131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:07.188063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:07.199540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:07.204029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b03fcbd8-8302-4b07-9c98-8f22bced2927 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1708 microversion: 2.32 time: 0.948284 Jul 19 19:52:07.204635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1275/2607] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:06 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1708 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:07.239336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca4469c-d47e-4dd7-8c38-0e3902be7d95", "name": "network-vif-plugged", "status": "completed", "tag": "1605e3c5-9a0a-41f9-877a-c642e4982a05"}, {"server_uuid": "88950277-b758-4235-badf-96603105b9b0", "name": "network-vif-plugged", "status": "completed", "tag": "3f45f1d7-2e90-4c9d-be9d-cfadecd19829"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:07.278296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:07.287962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:07.329273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] Creating event network-vif-plugged:1605e3c5-9a0a-41f9-877a-c642e4982a05 for instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 on n-h2-843834-3 Jul 19 19:52:07.329915 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] Creating event network-vif-plugged:3f45f1d7-2e90-4c9d-be9d-cfadecd19829 for instance 88950277-b758-4235-badf-96603105b9b0 on n-h1-843834-3 Jul 19 19:52:07.355111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-367ed01e-1436-4d86-bc01-d8ba634c6163 req-6833b03b-ad44-400c-8491-c3d13305a5d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132064 Jul 19 19:52:07.356033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1276/2608] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:07.370499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:07.372052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:07.386902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:07.388510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:07.390041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:07.390676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:08.981303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:08.992012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9183e967-e221-45a5-9630-3b7541f6dcfd tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.967471 Jul 19 19:52:08.992633 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1333/2609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:07 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:09.082069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:09.091240 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10d93099-f89d-4382-98aa-0dd60a866d49 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.733761 Jul 19 19:52:09.094187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1277/2610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:07 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:09.109282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:09.112568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:09.144170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.144170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:09.147349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.149500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:09.336646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] Calling method '.version_select at 0x7f23ef77ad30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:09.364493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.365490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:09.367047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.368083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:09.421555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:09.433802 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5841012-3dd8-4418-a44f-e4049847507f tempest-AbsoluteLimitsTestJSON-1189661617 tempest-AbsoluteLimitsTestJSON-1189661617-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.440016 Jul 19 19:52:09.447936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1334/2611] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jul 19 19:52:08 2022] GET /compute/v2.1/limits => generated 511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:09.460182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:09.461150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:09.468776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.469532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:09.470621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:09.471283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.120354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:10.169999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:10.173621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:10.192008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e0a30043-75c3-4060-87d0-f9ba41b978a0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1806 microversion: 2.20 time: 1.079223 Jul 19 19:52:10.194173 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1278/2612] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:09 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1806 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:10.214696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:10.223984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:10.240618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.241418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:10.242462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:10.243194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.312196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.314545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:11.333154 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c25aead4-3dbe-4167-b2e0-6c90202fc1cb tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1318 microversion: 2.1 time: 1.883391 Jul 19 19:52:11.336376 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1335/2613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:09 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1318 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:11.348809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:11.352039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:11.373468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.374200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.376208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.377656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.853109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.870101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.876769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:11.884120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-78a181c2-eac3-4bbc-9fe1-4c4dfc7a184a tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1802 microversion: 2.32 time: 1.684602 Jul 19 19:52:11.885801 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1279/2614] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:10 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1802 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:11.901039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:11.902619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:11.917500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.919042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:11.921014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:11.925389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:12.399070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:12.423760 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-100d598a-5703-41a5-bad2-bd7dcf64ba8c tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.086007 Jul 19 19:52:12.427037 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1336/2615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:11 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:12.455676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:12.456934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:12.469630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.470466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:12.471536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:12.472209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.106960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.146637 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7596787c-ff26-4666-85a4-1a5fe5b900ce tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.258790 Jul 19 19:52:13.147430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1280/2616] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:11 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:13.163337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:13.164727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:13.172621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.173569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.175225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.175874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.237284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.249023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.270806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.275129 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4577059a-5ef9-428e-9cdc-81216ac1168d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1793 microversion: 2.20 time: 0.846556 Jul 19 19:52:13.275789 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1337/2617] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:12 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1793 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:13.286129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:13.299200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:13.320669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.321495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.330298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.330298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.674859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.685649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.696527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.721291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70bc65d5-cbdb-4cd5-a8d4-3e930f019a47 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1802 microversion: 2.32 time: 0.442711 Jul 19 19:52:13.738706 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1338/2618] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:13 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1802 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:13.744059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:13.746648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:13.770459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.771950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.773488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:13.775306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:13.864891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:13.876313 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ec3b02e-088b-4f8f-b0a9-5ff9bc01e273 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1507 microversion: 2.1 time: 0.715036 Jul 19 19:52:13.880602 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1281/2619] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:13 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:14.166711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:14.167579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:14.192028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.196912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.201517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.203448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.605503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:14.642259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:14.659188 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-619a7c35-157e-4d31-9df6-80af16c72e43 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 0.918903 Jul 19 19:52:14.659778 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1339/2620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:13 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:14.745839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:14.747008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:14.760075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.764344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:14.764344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:14.768706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.296131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.336100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.371543 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25926e05-f75c-4606-a892-6e3e7e8a01e0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.189334 Jul 19 19:52:15.377573 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1282/2621] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:14 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:15.391913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.401693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:15.406185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9e02dfc-311d-481a-9bd2-1d8ac1e07855 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1802 microversion: 2.32 time: 0.663648 Jul 19 19:52:15.410822 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1340/2622] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:14 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1802 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:52:15.676994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:15.677596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:15.681539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:15.697263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.704922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:15.706758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:15.710234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.396118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:16.397538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:16.421855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.424373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.425420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.433435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.870605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:16.880063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44de1c1b-9733-48f1-9e1a-c5d9cffd2660 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.207651 Jul 19 19:52:16.880747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1283/2623] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:15 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:16.902369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:16.902828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:16.912595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:16.925781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ce043ba-cf82-46a2-a959-8aecf46f74f5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 0.532583 Jul 19 19:52:16.926672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1341/2624] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:16 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:16.942138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.942605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:16.943446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:16.949020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.461134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:17.470847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:17.472396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:17.493110 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9497900-3f50-49a9-9d33-8ba20d49a0e3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1802 microversion: 2.32 time: 0.611245 Jul 19 19:52:17.516327 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1284/2625] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:16 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1802 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:17.904623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:17.905277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:17.922420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.923259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.924240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.924961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.949234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:17.949862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:17.967258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:17.969031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.969577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:17.970411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:17.970854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:19.362936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=80 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:19.398778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:19.406356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=17 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:19.413212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:19.439856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-178c777d-6221-49c0-a03a-8463dc991e9e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.501133 Jul 19 19:52:19.471897 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b7a6aa9-0abc-4ccb-9cab-3e283670087d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.574419 Jul 19 19:52:19.472812 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1285/2626] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:17 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:52:19.481344 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1342/2627] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:17 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:19.492238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:19.492855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:19.508836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:19.522292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:19.522292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:19.522292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:19.666966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1093355976", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:19.783351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:19.783783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:19.784263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:19.784677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:19.785098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:19.808277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:19.808774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:19.809697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:19.810328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:19.833557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Getting quotas for project 12aee6e32e9a421f8bc97cda939ff9cc. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:19.841250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Getting quotas for user 53d13c06d49b4e2da08aa3f7a368ec66 and project 12aee6e32e9a421f8bc97cda939ff9cc. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:19.855835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:19.858522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:19.926207 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48607aa8-795d-48d0-b4a4-e2e424489b7a tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.451203 Jul 19 19:52:19.928118 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1286/2628] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:52:20.002293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.030752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.041230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.047952 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7ee42341-2ab0-4183-a011-c623cfdc0c16 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1849 microversion: 2.32 time: 0.557920 Jul 19 19:52:20.051523 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1343/2629] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:19 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1849 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:20.068500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "87e67aba-945e-4192-83a5-958df4593530"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:20.074976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:20.091250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.094395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.096619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.101132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.144131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-518654082", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "11ed988d-6878-4e43-b2e8-a2da5fae9603"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:20.248356 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] HTTP exception thrown: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Request method failure captured: Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0/os-volume_attachments/15d00f08-0ac6-49de-94c7-d05638c74bdf HTTP/1.1 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 74 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wrfOAYuomli7zBc8LglSxPryd16BfjzjQZQEg7B2BinzYVxD52l4_nN5kALbcLsPW3rCIBuD9qUn5VvsR2sQOT_LwRxWlh5v4WDbrG_6DdoEC1dM5VkNnV-crmqNaT5ajZX5yNWuc-_TLnb7mtr8nWa9rTsK4Ij2qzr6K4jCmgCezc Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 9ca546e255bf4273bbc6e936c0ca4f19 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ca546e255bf4273bbc6e936c0ca4f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 9ca546e255bf4273bbc6e936c0ca4f19 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1873068298 Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesAdminNegativeTest-1873068298-project-admin Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 672090f5fc5d4fbd94c269bfdc5d805a Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesAdminNegativeTest-1873068298-project-admin Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: {"volumeAttachment": {"volumeId": "87e67aba-945e-4192-83a5-958df4593530"}} Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '88950277-b758-4235-badf-96603105b9b0', 'id': '15d00f08-0ac6-49de-94c7-d05638c74bdf', 'body': {'volumeAttachment': {'volumeId': '87e67aba-945e-4192-83a5-958df4593530'}}} Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. (HTTP 404) (Request-ID: req-f2c91a0d-417d-4815-89ac-e5c033b0a296) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:52:20.252929 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] Returning 404 to user: Volume 15d00f08-0ac6-49de-94c7-d05638c74bdf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18d1a542-c8d8-4640-859e-381644a5ef6c tempest-VolumesAdminNegativeTest-1873068298 tempest-VolumesAdminNegativeTest-1873068298-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0/os-volume_attachments/15d00f08-0ac6-49de-94c7-d05638c74bdf" status: 404 len: 109 microversion: 2.1 time: 0.201247 Jul 19 19:52:20.262853 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1344/2630] 10.222.0.23 () {60 vars in 1432 bytes} [Tue Jul 19 19:52:20 2022] PUT /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0/os-volume_attachments/15d00f08-0ac6-49de-94c7-d05638c74bdf => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:20.268961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:20.275339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:20.305877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] validate_networks() for [('11ed988d-6878-4e43-b2e8-a2da5fae9603', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:20.698299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.724364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.726230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:20.751513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0062fb2f-afe4-46b7-be6c-771a81753df4 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "PUT /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1359 microversion: 2.75 time: 0.494737 Jul 19 19:52:20.752453 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1345/2631] 10.222.0.23 () {62 vars in 1296 bytes} [Tue Jul 19 19:52:20 2022] PUT /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1359 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:20.769315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:20.770500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:20.782075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.782738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:20.784844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:20.786229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:21.776966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:21.789097 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a06e0b05-0c55-472c-92c6-c548aa8c7763 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.035260 Jul 19 19:52:21.796020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1346/2632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:20 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:21.829691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:21.830940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:21.845220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:21.846117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:21.847614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:21.848286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.625157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:22.626672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:22.627355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:22.627972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:22.628687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:22.648389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.650222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.673414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.674210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.738426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:22.754250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for user 3cdca318e2f44c2c8148cdd29aaa5747 and project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:22.788680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:22.793963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:22.814121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:22.826735 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9eeef6ee-f409-45ef-8012-8f856a213c84 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 1.028494 Jul 19 19:52:22.827398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1347/2633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:21 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:22.852351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.865594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:22.913931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.914751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.918174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:22.921051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:22.984248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0e2be001-5b66-4a78-93db-b8dc87b7d443 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.054152 Jul 19 19:52:22.985585 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1287/2634] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:22.994720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:22.995673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:23.009431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.010150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:23.011202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:23.011786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.050850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.092483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.102414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.118585 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-950f9146-b170-4b4f-a41f-41d952743f2f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1417 microversion: 2.75 time: 1.278435 Jul 19 19:52:24.119398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1348/2635] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1417 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:24.126951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.134855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.147287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.148295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.149657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.151689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.253887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.294596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.298995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.304703 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c913a66f-f999-4f47-83a8-3b200c7b72b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1849 microversion: 2.32 time: 1.316381 Jul 19 19:52:24.318169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1288/2636] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:22 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1849 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:24.324335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.325289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.332916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.333705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.334723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.335491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.629288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:24.638126 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62e1e931-109d-4220-b775-4ddc4d1fa732 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1213 microversion: 2.1 time: 0.317867 Jul 19 19:52:24.647291 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1289/2637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:24 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1213 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:24.653543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-09fd0f37-57bf-448a-ae56-f770dc50a5b4 req-65e6c9d9-9b8d-4a8e-ba0b-1a08a0ac533d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "32ecaf13-8f8f-485f-9226-fd02b3cdbdc5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:24.670824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-09fd0f37-57bf-448a-ae56-f770dc50a5b4 req-65e6c9d9-9b8d-4a8e-ba0b-1a08a0ac533d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.671581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-09fd0f37-57bf-448a-ae56-f770dc50a5b4 req-65e6c9d9-9b8d-4a8e-ba0b-1a08a0ac533d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.705350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-09fd0f37-57bf-448a-ae56-f770dc50a5b4 req-65e6c9d9-9b8d-4a8e-ba0b-1a08a0ac533d service nova] Creating event network-changed:32ecaf13-8f8f-485f-9226-fd02b3cdbdc5 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:24.727759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-09fd0f37-57bf-448a-ae56-f770dc50a5b4 req-65e6c9d9-9b8d-4a8e-ba0b-1a08a0ac533d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078836 Jul 19 19:52:24.728395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1290/2638] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:24.763447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:24.768031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:24.794125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.801410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:24.804555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:24.805670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.144347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:26.162482 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f10b3886-0c4b-4ef9-bd6b-eca75585f609 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 2.041677 Jul 19 19:52:26.163108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1349/2639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:24 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:26.184032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:26.186221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:26.210444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.211575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.215226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.216028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.319855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:26.510955 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e761acf-5902-46e8-924e-86b8abf81dbd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 204 len: 0 microversion: 2.1 time: 0.339761 Jul 19 19:52:26.514606 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1350/2640] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:26 2022] DELETE /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:26.533457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:26.538700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:26.560989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.561616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.565139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.565717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.853119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:26.868576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:26.870659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:26.882839 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d4d8bc0-90f0-4fc3-92a2-c265076b13d6 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1438 microversion: 2.75 time: 0.364749 Jul 19 19:52:26.884468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1351/2641] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:26 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1438 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:26.895593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:26.910096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:26.925591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.926042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.926935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:26.927374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:26.937821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:27.103782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.107762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:27.134085 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-593b8f72-985c-4fe3-b06f-b88adaf2587e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1522 microversion: 2.1 time: 2.402884 Jul 19 19:52:27.138459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1291/2642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:24 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1522 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:27.149073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:27.150301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:27.170815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.171506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.172363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.174796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.442729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.458563 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aff17042-e27d-4d8c-9c27-c94ade5a34ca tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1275 microversion: 2.1 time: 0.318451 Jul 19 19:52:27.470890 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1292/2643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:27 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1275 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:27.472920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:27.484635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:27.496244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.497072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.498082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.498688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.732845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.749895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.754465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:27.756048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9237ce62-a4ce-42c5-94a4-5c3a7df9d51e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1870 microversion: 2.32 time: 0.868353 Jul 19 19:52:27.758876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1352/2644] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:26 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1870 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:27.767904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:27.775531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:27.782639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.783227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.784373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:27.784890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:27.915054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:27.916030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:27.916816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:27.917478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:27.918123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:28.066564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:28.082511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.083147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.084062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.084575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.414484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:28.424677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:28.426826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:28.434013 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-794ffc5f-ecf5-4069-91d9-7f8921da9852 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "POST /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc/action" status: 202 len: 1495 microversion: 2.75 time: 0.672013 Jul 19 19:52:28.465454 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1353/2645] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:52:27 2022] POST /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc/action => generated 1495 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 19:52:28.475395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:28.481871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:28.506148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.506702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.507529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.507967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.533203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:28.569259 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b69c5c78-5ae2-49ee-9d24-f0bcd2787d5b tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1513 microversion: 2.1 time: 1.104073 Jul 19 19:52:28.580300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1293/2646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:27 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1513 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:28.581416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:28.582103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:28.611066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.613517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:28.617036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:28.618109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.561296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.569859 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12a8e132-a0b2-474c-9154-db69edd545c2 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1524 microversion: 2.1 time: 1.101639 Jul 19 19:52:29.570951 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1354/2647] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:28 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1524 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:29.578196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:29.579587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:29.592443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.593141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.594686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.595227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.628376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.642539 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecf8314a-eab9-46b9-9650-fc4dc5425f1e tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1502 microversion: 2.1 time: 1.066311 Jul 19 19:52:29.646518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1294/2648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:28 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1502 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:29.668556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:29.669468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:29.676104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.676874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.678105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.683721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.824760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.835081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.836928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:29.844710 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70075b16-de4f-4b81-a56e-e75bb72cb4b9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.271271 Jul 19 19:52:29.845929 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1355/2649] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:29 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:29.851342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:29.852340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:29.860086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.861041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:29.862053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:29.862806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.470534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.478442 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb6a47ff-e62c-4876-b807-417b00465a85 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1317 microversion: 2.1 time: 0.817245 Jul 19 19:52:30.479039 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1295/2650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:29 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:30.483559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6ea7d15c-aac3-4f2f-9007-04cc6a70cd52 req-54110f6e-c720-4420-89ef-622432f62121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "91990a06-1178-4654-8553-4a053eda5e1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:30.492496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6ea7d15c-aac3-4f2f-9007-04cc6a70cd52 req-54110f6e-c720-4420-89ef-622432f62121 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.492942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6ea7d15c-aac3-4f2f-9007-04cc6a70cd52 req-54110f6e-c720-4420-89ef-622432f62121 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.505130 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6ea7d15c-aac3-4f2f-9007-04cc6a70cd52 req-54110f6e-c720-4420-89ef-622432f62121 service nova] Creating event network-changed:91990a06-1178-4654-8553-4a053eda5e1c for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:30.510690 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6ea7d15c-aac3-4f2f-9007-04cc6a70cd52 req-54110f6e-c720-4420-89ef-622432f62121 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030105 Jul 19 19:52:30.511336 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1296/2651] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:30.516773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:30.517465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:30.526112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.526562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.527356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:30.527787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:30.709092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.719462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.721206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:30.722467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba9c0e04-bbd8-4bc7-836d-ec4e0983a71c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1870 microversion: 2.32 time: 0.875443 Jul 19 19:52:30.728042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1356/2652] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:29 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1870 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:30.748705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-495296cd-ffdd-412a-8cf0-d2dd490c3a42 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'create', calling method: .version_select at 0x7f23ef6c2820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1058479386", "description": "tempest-description-1515645024"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:30.755913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:31.288713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:31.298751 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-896921c8-ee8c-43b5-a343-1717a935974c tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 200 len: 1513 microversion: 2.1 time: 0.786155 Jul 19 19:52:31.299715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1297/2653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:30 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 1513 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:31.306381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:31.307534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:31.320802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.322477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:31.323735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.324341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:31.841445 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-495296cd-ffdd-412a-8cf0-d2dd490c3a42 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.110022 Jul 19 19:52:31.842079 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1357/2654] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:52:30 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:31.849054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:31.850503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:31.864035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.864497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:31.865311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:31.865749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.279140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.282479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.296794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.299202 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fac455c0-9016-4ef8-b246-3990bbd15b84 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1506 microversion: 2.1 time: 0.997631 Jul 19 19:52:32.301531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:32.307969 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1298/2655] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:31 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1506 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:32.315766 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d52d8d73-aa26-44b8-9163-b2687f6015d2 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.472454 Jul 19 19:52:32.316848 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1358/2656] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:31 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:32.328488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:32.328872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:32.329222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:32.329974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:32.347371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.347764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.348179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.349122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.350156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.351545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.353156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:32.353625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:32.691429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:32.780413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:33.037017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:33.047467 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-539b263d-6239-4600-bca5-455f5ef3aae6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1317 microversion: 2.1 time: 0.736286 Jul 19 19:52:33.049136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:33.050662 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1299/2657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:32 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:33.056822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1058479386"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:33.057873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.066222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.067044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.068409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.069037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.093300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:33.101748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:33.105701 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b43529f-c798-45a3-8087-1640fb8d20ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.786871 Jul 19 19:52:33.111126 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1359/2658] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:32 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:33.131687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:33.132348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 88950277-b758-4235-badf-96603105b9b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.142430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.143335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.144564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.145813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.173093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] HTTP exception thrown: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Request method failure captured: Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 HTTP/1.1 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wrWSvua2X6gzct78s5dAplRGt6fSuvo2BfoZU-mKPJUAa47hZZyBFoLy5AIxS8WlXvP7ZpyoMjuH8ma6uQNaaGJRCR_-16fihB4KhaGof54t58VCJWTOYIA9eTpgoo5yZ57soLpwqBNdYRWPYdjvI57g8KXDOO9JgeZqyUwrkTdIV4 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 61012f87f99940e884c8f2cf0ebc702e Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 61012f87f99940e884c8f2cf0ebc702e Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesAdminNegativeTest-216364145-project Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0170aafaff4847149210c7b6b73862cf Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesAdminNegativeTest-216364145-project Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '88950277-b758-4235-badf-96603105b9b0'} Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:33.176117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. Jul 19 19:52:33.181112 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:52:33.183438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Returning 404 to user: Instance 88950277-b758-4235-badf-96603105b9b0 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:33.184774 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-145e38d7-352c-4b8a-8867-75cfc61dece2 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0" status: 404 len: 111 microversion: 2.1 time: 0.072345 Jul 19 19:52:33.190463 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1360/2659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:33 2022] GET /compute/v2.1/servers/88950277-b758-4235-badf-96603105b9b0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:33.206465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e77b5468-3058-4a7f-91de-4dc17415c729 req-f2853757-ebcf-4627-a120-b6b2d52fe3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88950277-b758-4235-badf-96603105b9b0", "name": "network-vif-deleted", "tag": "3f45f1d7-2e90-4c9d-be9d-cfadecd19829"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:33.225063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e77b5468-3058-4a7f-91de-4dc17415c729 req-f2853757-ebcf-4627-a120-b6b2d52fe3fa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.225632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e77b5468-3058-4a7f-91de-4dc17415c729 req-f2853757-ebcf-4627-a120-b6b2d52fe3fa service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.242178 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e77b5468-3058-4a7f-91de-4dc17415c729 req-f2853757-ebcf-4627-a120-b6b2d52fe3fa service nova] Creating event network-vif-deleted:3f45f1d7-2e90-4c9d-be9d-cfadecd19829 for instance 88950277-b758-4235-badf-96603105b9b0 on n-h1-843834-3 Jul 19 19:52:33.249141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e77b5468-3058-4a7f-91de-4dc17415c729 req-f2853757-ebcf-4627-a120-b6b2d52fe3fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056214 Jul 19 19:52:33.250618 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1361/2660] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:33.256151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1c375061-9865-408b-9fb9-485f5585dd93 req-c50ba11f-77e1-49ec-88a9-5f1695e37557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca4469c-d47e-4dd7-8c38-0e3902be7d95", "name": "network-vif-unplugged", "status": "completed", "tag": "1605e3c5-9a0a-41f9-877a-c642e4982a05"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:33.269528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1c375061-9865-408b-9fb9-485f5585dd93 req-c50ba11f-77e1-49ec-88a9-5f1695e37557 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.269970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1c375061-9865-408b-9fb9-485f5585dd93 req-c50ba11f-77e1-49ec-88a9-5f1695e37557 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.341550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1c375061-9865-408b-9fb9-485f5585dd93 req-c50ba11f-77e1-49ec-88a9-5f1695e37557 service nova] Creating event network-vif-unplugged:1605e3c5-9a0a-41f9-877a-c642e4982a05 for instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 on n-h2-843834-3 Jul 19 19:52:33.355256 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1c375061-9865-408b-9fb9-485f5585dd93 req-c50ba11f-77e1-49ec-88a9-5f1695e37557 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101365 Jul 19 19:52:33.362549 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1362/2661] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:33.376909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:33.377672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:33.388962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.network.security_group_api [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Adding security group 4b9e1243-7b0c-434d-8931-8510ca6dc86d to port ccd3e211-b58d-4417-b92b-9d075dbbcb85 Jul 19 19:52:33.400942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.401406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:33.418634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:33.419128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.350879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.367044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b76cd567-d467-43eb-b6d7-ff28f00fc9cd tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1506 microversion: 2.1 time: 1.002970 Jul 19 19:52:34.376045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1363/2662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:33 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1506 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:34.390770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:34.395378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:34.406708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.411894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.413553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.414164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.587088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.596512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.598102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:34.604625 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-24e194b6-6077-4198-9f7a-f9c3ace11f66 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.224849 Jul 19 19:52:34.605892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1364/2663] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:34 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:34.611150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:34.612066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:34.620504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.621225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:34.622234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:34.622839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.071775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.084291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67abea8e-25bd-4898-a3e6-0dfe5cd7d3a5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1317 microversion: 2.1 time: 0.477057 Jul 19 19:52:35.085199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1365/2664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:34 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:35.106265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:35.106956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:35.113729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.114288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.115239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.116195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.190061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-892093c0-ed75-442f-bc06-7a7397c96195 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action" status: 202 len: 0 microversion: 2.1 time: 2.137877 Jul 19 19:52:35.190674 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1300/2665] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:33 2022] POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action => generated 0 bytes in 2139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:35.265227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1563156457", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:35.342533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] validate_networks() for [('824a5a9d-4325-4644-b0b0-03d9409dea9f', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:35.668183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.680366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.684602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:35.686369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64685737-cc28-4bc5-ac79-a9ee893ee1d3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.588729 Jul 19 19:52:35.687459 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1366/2666] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:35 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:35.695421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1058479386"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:35.696590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:35.704741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.705492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:35.706618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:35.707246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.013603 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Removing security group 4b9e1243-7b0c-434d-8931-8510ca6dc86d from port ccd3e211-b58d-4417-b92b-9d075dbbcb85 Jul 19 19:52:36.609378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:36.610443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:36.611156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:36.611767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:36.612341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:36.635504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.636711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.637716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.638371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.703411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Getting quotas for project 1db260f44fa445459b9f0493a4afcf12. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:36.710534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Getting quotas for user d0aaf646bf424940b18407df636c82ff and project 1db260f44fa445459b9f0493a4afcf12. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:36.727548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:36.730171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:36.802718 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3eda2d02-7139-457c-b915-79f05695f066 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.607945 Jul 19 19:52:36.808548 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1301/2667] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:36.832100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "32137e5f-76f6-4923-948b-dea0b9940b3d"}, {"name": "network-changed", "server_uuid": "1313497f-b80f-4834-ac4d-6f8f15518665", "tag": "bb733810-9d34-4661-9216-380670ab27f4"}, {"name": "network-changed", "server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:36.847637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.848677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.869164 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Creating event network-changed:32137e5f-76f6-4923-948b-dea0b9940b3d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:36.870111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Creating event network-changed:bb733810-9d34-4661-9216-380670ab27f4 for instance 1313497f-b80f-4834-ac4d-6f8f15518665 on n-h2-843834-3 Jul 19 19:52:36.870847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] Creating event network-changed:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:52:36.892397 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4f8a7934-7d09-4a29-b94a-b01b8d461104 req-72ff5ce4-4c70-47e5-9aad-7c722a1c7694 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.085925 Jul 19 19:52:36.894582 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1302/2668] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:36.906783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:36.908443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:36.922977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.923798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:36.925064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:36.925778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.494718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:37.513821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c1ec09e-37eb-487e-8726-66beeb80f724 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 200 len: 1449 microversion: 2.1 time: 0.612191 Jul 19 19:52:37.530354 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1303/2669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:36 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 1449 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:37.542079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:37.543744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:37.561568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.576454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.577442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.577893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.711967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-535e09bc-34b5-4c73-bf9f-6b08334c1b53 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action" status: 202 len: 0 microversion: 2.1 time: 2.020745 Jul 19 19:52:37.714695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1367/2670] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:35 2022] POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action => generated 0 bytes in 2026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:37.722581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:37.728522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:37.767806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.769414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.781013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.782226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.798610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:37.841738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:37.847574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:37.876605 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2044c59c-63b9-4820-a21f-f34cba8f0e58 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.344084 Jul 19 19:52:37.877213 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1304/2671] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:37 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:37.891494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:37.892142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:37.905000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.906478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:37.907593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:37.908207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.367232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.377151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-922778a9-73fb-4915-a310-096fb371e705 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1317 microversion: 2.1 time: 0.660962 Jul 19 19:52:38.389768 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1368/2672] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:37 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:38.402320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:38.405774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:38.426950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:38.434295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.434894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.440883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.444309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.749542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.774052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:38.784353 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7568d6e5-4a7c-4f4c-b147-3350f66a7ffe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1274 microversion: 2.1 time: 0.393211 Jul 19 19:52:38.787244 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1369/2673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:38 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1274 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:38.812149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:38.814031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:38.839491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.840324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.841660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:38.842311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:38.876955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:38.895200 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.compute.api [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Working on deleting snapshot 15c689ed-82d1-439b-b35e-cbf3be2e6e0c from shelved instance... Jul 19 19:52:38.896894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.913232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.915871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:38.917360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1ef82cb-10ab-405b-8d49-0da4f6cbda5d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 1.037513 Jul 19 19:52:38.922617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1305/2674] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:37 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:38.933496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0c398c06-6f93-41e1-9698-1661b260e0a8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'create', calling method: .version_select at 0x7f2400a511f0>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:39.875864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Doing local delete in cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131229) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 19:52:39.876883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:39.877513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:39.878035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.compute.api [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 19:52:39.882724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] deallocate_for_instance() {{(pid=131229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 19:52:41.708584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Updating instance_info_cache with network_info: [] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:52:42.131542 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a725c1e9-4784-4428-80cb-0b40ea9b3e16 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 204 len: 0 microversion: 2.1 time: 3.341727 Jul 19 19:52:42.132756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1370/2675] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:38 2022] DELETE /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 0 bytes in 3344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:42.141362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.142238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.148733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.149195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.150156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.150594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.177796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:42.283395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3dc820a5-b2ff-40bf-aee9-db3ceecc6950 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 204 len: 0 microversion: 2.1 time: 0.145882 Jul 19 19:52:42.284191 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1371/2676] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:42 2022] DELETE /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:42.289840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.290683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.297349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.297725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.298634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.299212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.392401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.401873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.403793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.409869 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8834053-0ffe-44fe-affc-285c490968e3 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.124102 Jul 19 19:52:42.410467 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1372/2677] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:42.415114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "2ba4e656-104e-403b-8ef4-51a022ce309d"}, {"name": "network-changed", "server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:42.425479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.425952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.439331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] Creating event network-changed:2ba4e656-104e-403b-8ef4-51a022ce309d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:42.439843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] Creating event network-changed:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:52:42.448869 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-299bf9cd-f51a-43b4-b23b-29896bde6a7f req-10a26e9a-9949-4857-8ce3-14a802be61ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037043 Jul 19 19:52:42.449769 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1373/2678] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:42.455504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7c49862a-35dc-439d-a0c7-9a04c8510355 req-7f7f7adc-0c1b-490a-b6bc-c675489175b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1313497f-b80f-4834-ac4d-6f8f15518665", "name": "network-vif-plugged", "status": "completed", "tag": "bb733810-9d34-4661-9216-380670ab27f4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:42.466523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7c49862a-35dc-439d-a0c7-9a04c8510355 req-7f7f7adc-0c1b-490a-b6bc-c675489175b3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.467081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7c49862a-35dc-439d-a0c7-9a04c8510355 req-7f7f7adc-0c1b-490a-b6bc-c675489175b3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.479340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7c49862a-35dc-439d-a0c7-9a04c8510355 req-7f7f7adc-0c1b-490a-b6bc-c675489175b3 service nova] Creating event network-vif-plugged:bb733810-9d34-4661-9216-380670ab27f4 for instance 1313497f-b80f-4834-ac4d-6f8f15518665 on n-h2-843834-3 Jul 19 19:52:42.484829 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7c49862a-35dc-439d-a0c7-9a04c8510355 req-7f7f7adc-0c1b-490a-b6bc-c675489175b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Jul 19 19:52:42.488011 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1374/2679] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:42.490536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.491270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.498252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.498706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.499527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.499966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.757059 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0c398c06-6f93-41e1-9698-1661b260e0a8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.833199 Jul 19 19:52:42.758207 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1306/2680] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:52:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:42.769098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.769721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.776380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.777123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.778064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.778660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.804319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:42.812171 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1533018d-9ab6-4bd1-af3e-0abe3b792016 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1317 microversion: 2.1 time: 0.325562 Jul 19 19:52:42.813004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1375/2681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:42.828223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:42.828491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:42.834647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.835194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:42.835974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:42.836411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.083928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.091919 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08a4cdc4-f4bd-4efd-8b8c-b4e0ece66ee1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1314 microversion: 2.1 time: 0.326598 Jul 19 19:52:43.092486 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1307/2682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:43.096965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d3661038-e2a5-4388-a1a3-e41392a4efe9 req-d65139f3-7d5b-46ec-994d-e9775de37d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5a87da-2358-4ee1-8249-537c3f2bfba8", "tag": "d6c1ead5-69f7-49b3-9538-0578e1fd5855"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:43.105397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d3661038-e2a5-4388-a1a3-e41392a4efe9 req-d65139f3-7d5b-46ec-994d-e9775de37d97 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.105845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d3661038-e2a5-4388-a1a3-e41392a4efe9 req-d65139f3-7d5b-46ec-994d-e9775de37d97 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.122330 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d3661038-e2a5-4388-a1a3-e41392a4efe9 req-d65139f3-7d5b-46ec-994d-e9775de37d97 service nova] Creating event network-changed:d6c1ead5-69f7-49b3-9538-0578e1fd5855 for instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 on n-h1-843834-3 Jul 19 19:52:43.127699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d3661038-e2a5-4388-a1a3-e41392a4efe9 req-d65139f3-7d5b-46ec-994d-e9775de37d97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034028 Jul 19 19:52:43.132325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1308/2683] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:43.138096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:43.138808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:43.145789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.146253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.147069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.147513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.166768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 HTTP/1.1 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1ca4469c-d47e-4dd7-8c38-0e3902be7d95'} Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:43.170073 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:52:43.175736 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:43.176571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.178784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:43.179794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4484e66e-81cf-475e-8493-55b96fd223fa tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 404 len: 111 microversion: 2.1 time: 0.046072 Jul 19 19:52:43.180375 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1309/2684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:43 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:43.199069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.200613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.201804 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d17c569-f286-4b8a-9ea4-2b0e83acbba8 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.378010 Jul 19 19:52:43.202397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1376/2685] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:42 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:43.203039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:43.203969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:43.216146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.216"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:43.217516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:43.219448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.219965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.220792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.221226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.238555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.242207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.243413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:43.245362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:43.313533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Acquired lock "refresh_cache-312a01af-ccf8-4a0e-a5ae-cc148049247d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:52:43.967639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0170aafaff4847149210c7b6b73862cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61012f87f99940e884c8f2cf0ebc702e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:43.977161 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4972bef-dc1b-4ce3-b75d-01d688d2fafd tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 200 len: 1682 microversion: 2.1 time: 0.795482 Jul 19 19:52:43.978207 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1310/2686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:43 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 1682 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:43.985252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-577076818", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:44.048648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:52:45.487132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:45.487937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:45.488591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:45.489506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:45.491530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:45.506553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.509192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.512652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.514436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.569230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:52:45.577555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:45.580038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:52:45.598122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:52:45.601608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:52:45.681316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-629ae12b-b457-442f-be65-7f2d02298f54 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701594 Jul 19 19:52:45.682368 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1311/2687] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:52:45.687176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:45.687788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:45.705770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.706333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.707225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:45.707709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:45.910080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:45.925776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:45.944473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:45.955847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e4f0fcd-c33b-4c19-9d3b-46fc2dfaca67 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.272369 Jul 19 19:52:45.957190 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1312/2688] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:45 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:45.969150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:45.969772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:45.998022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.000903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.012155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.014112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.282366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:46.283508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Building network info cache for instance {{(pid=131229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:52:46.286220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:46.298133 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-926e021b-d058-44ae-8f46-46c4d6d2c6b3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1507 microversion: 2.1 time: 0.338857 Jul 19 19:52:46.299046 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1313/2689] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:45 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:46.309484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:46.310349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:46.326089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.328109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.333161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.333892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.636111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:46.646449 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ffc3a789-d450-47fe-9868-843948899c36 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1314 microversion: 2.1 time: 0.346238 Jul 19 19:52:46.647663 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1314/2690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:46 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:46.659218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:46.663462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:46.681756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.691766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:46.695438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:46.696090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.065991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.077711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.079556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.080805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ef039b8-14f5-4fd8-883b-d0b23b4216a6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.430560 Jul 19 19:52:47.092109 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1315/2691] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:46 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:47.092109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "f3366ada-1b22-498f-9431-a3646f97f3f0"}, {"server_uuid": "1ca4469c-d47e-4dd7-8c38-0e3902be7d95", "name": "network-vif-deleted", "tag": "1605e3c5-9a0a-41f9-877a-c642e4982a05"}, {"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "f8fc22e0-5d2e-40f8-a10b-a8008dcdc283"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:47.109589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.110463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.152617 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Creating event network-changed:f3366ada-1b22-498f-9431-a3646f97f3f0 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:47.157670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.server_external_events [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Unable to find a host for instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95. Dropping event network-vif-deleted {{(pid=131230) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 19:52:47.160483 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] Creating event network-changed:f8fc22e0-5d2e-40f8-a10b-a8008dcdc283 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:47.173355 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5ece4fb8-12ff-4a60-9c63-21044ce77523 req-176ab834-a212-4d1a-8fbd-e6e72bc92724 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 514 microversion: 2.1 time: 0.090168 Jul 19 19:52:47.174234 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1316/2692] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 514 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 19:52:47.180205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.187979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.205879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.206638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.208417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.211122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.275947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-afdcc24f-b132-4795-b361-72a94a9b3d5e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments/8d57531a-24b2-446e-ab4b-421c2904c12b" status: 200 len: 194 microversion: 2.20 time: 0.099805 Jul 19 19:52:47.279293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1317/2693] 10.222.0.23 () {60 vars in 1453 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments/8d57531a-24b2-446e-ab4b-421c2904c12b => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:52:47.297477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.298098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] [instance: 63896c76-b7b6-43ca-8b9d-ed5d38a91c15] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.305840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.306359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.307195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.311613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.334116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] HTTP exception thrown: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Request method failure captured: Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 HTTP/1.1 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wrWSvua2X6gzct78s5dAplRGt6fSuvo2BfoZU-mKPJUAa47hZZyBFoLy5AIxS8WlXvP7ZpyoMjuH8ma6uQNaaGJRCR_-16fihB4KhaGof54t58VCJWTOYIA9eTpgoo5yZ57soLpwqBNdYRWPYdjvI57g8KXDOO9JgeZqyUwrkTdIV4 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 61012f87f99940e884c8f2cf0ebc702e Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61012f87f99940e884c8f2cf0ebc702e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 61012f87f99940e884c8f2cf0ebc702e Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-216364145 Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesAdminNegativeTest-216364145-project Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0170aafaff4847149210c7b6b73862cf Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesAdminNegativeTest-216364145-project Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '63896c76-b7b6-43ca-8b9d-ed5d38a91c15'} Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:52:47.336345 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. Jul 19 19:52:47.340825 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:52:47.343017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Returning 404 to user: Instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:52:47.344235 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8b4261d8-f693-42c7-a2a7-f4f14007d037 tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15" status: 404 len: 111 microversion: 2.1 time: 0.063564 Jul 19 19:52:47.345387 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1318/2694] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/63896c76-b7b6-43ca-8b9d-ed5d38a91c15 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:52:47.350745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2624079c-4150-47f2-bb21-f086de46514d req-39545747-9c0c-4e94-9027-d346c413cc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63896c76-b7b6-43ca-8b9d-ed5d38a91c15", "name": "network-vif-deleted", "tag": "ab753503-9da1-460d-bf01-3c93dd1ecd3b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:47.361788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2624079c-4150-47f2-bb21-f086de46514d req-39545747-9c0c-4e94-9027-d346c413cc81 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.362483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2624079c-4150-47f2-bb21-f086de46514d req-39545747-9c0c-4e94-9027-d346c413cc81 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.376311 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2624079c-4150-47f2-bb21-f086de46514d req-39545747-9c0c-4e94-9027-d346c413cc81 service nova] Creating event network-vif-deleted:ab753503-9da1-460d-bf01-3c93dd1ecd3b for instance 63896c76-b7b6-43ca-8b9d-ed5d38a91c15 on n-h2-843834-3 Jul 19 19:52:47.389244 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2624079c-4150-47f2-bb21-f086de46514d req-39545747-9c0c-4e94-9027-d346c413cc81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042300 Jul 19 19:52:47.390332 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1319/2695] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:47.395791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.398008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.413427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.413878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.414857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.415329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.543089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:47.544182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Updating instance_info_cache with network_info: [{"id": "ccd3e211-b58d-4417-b92b-9d075dbbcb85", "address": "fa:16:3e:cd:7d:45", "network": {"id": "ea6f8e10-4d4c-4e15-85b0-219c7b75560e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-480369015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c50f7a386f604111b0af7ddd603d4490", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapccd3e211-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:52:47.554884 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c19d228-ca77-44d6-9e91-28c4ebd9a03b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1284 microversion: 2.1 time: 0.163100 Jul 19 19:52:47.556184 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1320/2696] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:47.561214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.561773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.565901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Releasing lock "refresh_cache-312a01af-ccf8-4a0e-a5ae-cc148049247d" {{(pid=131229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:52:47.567441 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a00888df-e428-4e79-8cfe-0249815a31da tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action" status: 202 len: 0 microversion: 2.1 time: 4.355129 Jul 19 19:52:47.568375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.568814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.569592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.570023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.570287 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1377/2697] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:43 2022] POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action => generated 0 bytes in 4359 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:52:47.578866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:47.580176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:47.590071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.590804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:47.592138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:47.593465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.085589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.089807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:48.095964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.097480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.105321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d0874e8-d05f-416b-a156-16e0f5e4ae41 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.533041 Jul 19 19:52:48.106169 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1378/2698] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:48.119007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ec727dfb-8469-4800-8a50-03d0b19eaba0 req-21ac1455-09af-457c-887f-488c82433214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5a87da-2358-4ee1-8249-537c3f2bfba8", "name": "network-vif-plugged", "status": "completed", "tag": "d6c1ead5-69f7-49b3-9538-0578e1fd5855"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:48.129439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ec727dfb-8469-4800-8a50-03d0b19eaba0 req-21ac1455-09af-457c-887f-488c82433214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.130409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ec727dfb-8469-4800-8a50-03d0b19eaba0 req-21ac1455-09af-457c-887f-488c82433214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.143749 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ec727dfb-8469-4800-8a50-03d0b19eaba0 req-21ac1455-09af-457c-887f-488c82433214 service nova] Creating event network-vif-plugged:d6c1ead5-69f7-49b3-9538-0578e1fd5855 for instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 on n-h1-843834-3 Jul 19 19:52:48.149423 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ec727dfb-8469-4800-8a50-03d0b19eaba0 req-21ac1455-09af-457c-887f-488c82433214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041869 Jul 19 19:52:48.151010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1379/2699] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:48.158523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-189ed3e3-362b-4199-acb6-4190659c141d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] Calling method '.version_select at 0x7f23eef57ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.181054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-189ed3e3-362b-4199-acb6-4190659c141d tempest-VolumesAdminNegativeTest-216364145 tempest-VolumesAdminNegativeTest-216364145-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-740790480" status: 202 len: 0 microversion: 2.1 time: 0.027989 Jul 19 19:52:48.182257 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1380/2700] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-740790480 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:48.191757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.193197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:48.211640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.212387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.213621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.215211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.235172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.243768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90a56702-5b3e-41e6-b4e8-6bbcc353594a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1507 microversion: 2.1 time: 0.686425 Jul 19 19:52:48.245431 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1321/2701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:47 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1507 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:48.263490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.216"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:48.321897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lazy-loading 'services' on Instance uuid 7b46ac79-be21-4f59-b714-0d63bcf29ce7 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:52:48.407911 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e55b2d59-d91b-4da6-8e51-d5c11899d275 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments/8d57531a-24b2-446e-ab4b-421c2904c12b" status: 202 len: 0 microversion: 2.20 time: 0.223959 Jul 19 19:52:48.408980 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1381/2702] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jul 19 19:52:48 2022] DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments/8d57531a-24b2-446e-ab4b-421c2904c12b => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:48.414518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.415607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:48.422959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.423813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.424833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.425614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.557103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:48.569741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.570411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.571791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.572814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.735379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:48.743900 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d95d544d-d378-4d47-9543-037c5c8b91c9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1314 microversion: 2.1 time: 0.333360 Jul 19 19:52:48.750575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1382/2703] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:48 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:48.758415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:48.759061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:48.765708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.766164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:48.767705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:48.768252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.097268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Acquired lock "refresh_cache-312a01af-ccf8-4a0e-a5ae-cc148049247d" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 19:52:49.137267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:49.157654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:49.161117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:49.166020 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de9acbed-eb5d-4abf-a2d8-0c2f23e2f9c1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.411145 Jul 19 19:52:49.178083 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1383/2704] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:48 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:49.184586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:49.187147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:49.193783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.194747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.195836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.196821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.284898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:52:49.285696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:52:49.286410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:52:49.287075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:52:49.287717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:52:49.373822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:49.388894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.393694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.395276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.396250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.447879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8db8565-dd14-476f-a25e-43acaa15e22e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "POST /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665/action" status: 202 len: 1109 microversion: 2.1 time: 0.268256 Jul 19 19:52:49.460678 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1384/2705] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:49 2022] POST /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665/action => generated 1109 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 19:52:49.481779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:49.483525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:49.502518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.507162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.511459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.519832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.566383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c273f96b-f7f7-4639-aa75-32823b9c3378 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102082 Jul 19 19:52:49.570422 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1385/2706] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:52:49 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:52:49.587050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:49.590985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:49.598423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.599021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:49.599923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:49.600431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.080250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.088400 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b93545a-060f-49e4-a15a-29f13c071d3e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.514106 Jul 19 19:52:50.089002 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1386/2707] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:49 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:50.093614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:50.094220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:50.108770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.109521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.110430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.111346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.342050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.353169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.355154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:50.363725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9cd97a7b-d456-4a8a-879a-8c4c0d4a319b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.273665 Jul 19 19:52:50.379363 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1387/2708] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:50 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:50.386816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "5142b9da-6911-44d7-93c6-0f1fd5e6437a"}, {"name": "network-changed", "server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:50.403463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.404406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.418583 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] Creating event network-changed:5142b9da-6911-44d7-93c6-0f1fd5e6437a for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:52:50.419492 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] Creating event network-changed:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:52:50.431227 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b8449f29-fd11-4600-a519-79344c523c5c req-836a0dad-30a8-409b-a02a-c9be19a97cdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048695 Jul 19 19:52:50.433625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1388/2709] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:50.440079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:50.441428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:50.452818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.453526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:50.455097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:50.455716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.159721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:51.169724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-05fb0b94-bbe0-4b73-a248-8182212b02b7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.734071 Jul 19 19:52:51.170677 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1389/2710] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:50 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:51.177649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.178531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:51.186050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.186785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.187830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.188475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.772471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:51.780431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0152a834-ff24-4b40-abc1-1d731bb8ab34 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1499 microversion: 2.1 time: 0.608492 Jul 19 19:52:51.791757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Building network info cache for instance {{(pid=131230) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 19:52:51.792665 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1390/2711] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:51 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1499 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:51.797740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:51.801074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:51.808014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.808702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:51.809653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:51.810234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:52.312388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:52.329407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:52.331669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:52.333299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5174f833-3639-4abe-9643-402f2481797d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.539411 Jul 19 19:52:52.334530 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1391/2712] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:51 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:52.342497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:52.343829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:52.353373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.354164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:52.355221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.355815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:52.426413 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f98bfeb-f660-40fc-80af-6812764d67f1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090525 Jul 19 19:52:52.427296 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1392/2713] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:52:52 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:52:52.438956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:52.442091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:52.471207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.472006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:52.473334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:52.475074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.068672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.087048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28128534-7c17-4dfe-b17a-80f6b05c0691 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.658402 Jul 19 19:52:53.088695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1393/2714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:52 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:53.094705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:53.095781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:53.103424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.104391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.106338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.106969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.299690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.314207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.316561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:53.324814 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-362a4556-e0a9-46fc-97b4-6c1563c65264 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.234193 Jul 19 19:52:53.338806 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1394/2715] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:53 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:53.343489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:53.345048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:53.352308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.352810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.353802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.354343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.375905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:53.380612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lazy-loading 'flavor' on Instance uuid 7c5a87da-2358-4ee1-8249-537c3f2bfba8 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:52:53.474072 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f062b1dc-da98-4944-b204-eaf4c07c1b03 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "POST /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8/action" status: 200 len: 32 microversion: 2.1 time: 0.139332 Jul 19 19:52:53.475687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1395/2716] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:53 2022] POST /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 19:52:53.489137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:53.491115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:53.507578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.508300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.509392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.510047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.542015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Updating instance_info_cache with network_info: [{"id": "ccd3e211-b58d-4417-b92b-9d075dbbcb85", "address": "fa:16:3e:cd:7d:45", "network": {"id": "ea6f8e10-4d4c-4e15-85b0-219c7b75560e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-480369015-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c50f7a386f604111b0af7ddd603d4490", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapccd3e211-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 19:52:53.551145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Releasing lock "refresh_cache-312a01af-ccf8-4a0e-a5ae-cc148049247d" {{(pid=131230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 19:52:53.553354 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c8155aaf-dbc0-4cc7-97f9-7521f70816c8 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action" status: 202 len: 0 microversion: 2.1 time: 5.306635 Jul 19 19:52:53.556272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1322/2717] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:52:48 2022] POST /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d/action => generated 0 bytes in 5308 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 19:52:53.564872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}, {"name": "network-changed", "server_uuid": "52a731b7-9aa9-427d-bbef-be48d0320774", "tag": "c6be8861-6bf1-40cb-a028-70cb1f756199"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:53.575960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.576770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.592895 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] Creating event network-changed:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:52:53.593593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] Creating event network-changed:c6be8861-6bf1-40cb-a028-70cb1f756199 for instance 52a731b7-9aa9-427d-bbef-be48d0320774 on n-h2-843834-3 Jul 19 19:52:53.604461 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b71d88c6-fc16-4287-97cb-8e42982e2cca req-d07ef026-2c3a-4b47-aafd-bd012063c12d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045116 Jul 19 19:52:53.605493 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1323/2718] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:53.621654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:53.622745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:53.632113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.632835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:53.633787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:53.635057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.389947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:54.397618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9db2595b-4590-40d5-b563-c3f3391005b6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.920087 Jul 19 19:52:54.407291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1396/2719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:53 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:54.407291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:54.407291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:54.410092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.410502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.411348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.411884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.442446 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26e1189d-ee50-48af-a603-f61d481716af tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043113 Jul 19 19:52:54.443047 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1397/2720] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:52:54 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:52:54.447854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:54.448455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:54.454625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.455120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.455863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.456305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.529499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:54.537531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:54.539355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:54.540987 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d14412e0-37a3-464e-886a-07c0e7c95245 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.933868 Jul 19 19:52:54.541588 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1324/2721] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:53 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:54.546388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01f611d0-5deb-48bb-ab6b-2c78717676d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '.version_select at 0x7f23efb63b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:54.960175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:54.968154 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebb7ba32-8f02-4d34-9b0b-f606f5431f11 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.524095 Jul 19 19:52:54.968750 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1398/2722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:54 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:54.973605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:54.974237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:54.981364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.981818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:54.982660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:54.983170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.554341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:55.591640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:55.597663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.607900 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af01f56c-9b87-46fa-a654-e9afe1495009 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.637613 Jul 19 19:52:55.608716 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1399/2723] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:54 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:55.615598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:55.616493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:55.624249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.624697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.625478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.625907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.764047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.773673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.775395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:55.781318 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8667575-1808-4d50-88b4-2b24ed42ab25 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.171043 Jul 19 19:52:55.781999 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1400/2724] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:55 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:55.786533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:55.787242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:55.793647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.794103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:55.794885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:55.795345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.086717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:56.103196 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40cbe99a-c6ed-4a09-91e2-863c086dd66d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.320040 Jul 19 19:52:56.113774 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1401/2725] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:55 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:56.130446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:56.132609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:56.141636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.142371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.143358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.146477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.189893 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2725e6c-c095-4022-91fb-2a6a06e93dd8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073699 Jul 19 19:52:56.198925 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1402/2726] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:52:56 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:56.203794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:56.204406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:56.214146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.214598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.215409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:56.215847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:56.954233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:56.967307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:56.980153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:56.982138 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2947c647-f144-47af-ad5a-21b2f650145e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.782039 Jul 19 19:52:56.984437 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1403/2727] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:56 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:56.997131 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01f611d0-5deb-48bb-ab6b-2c78717676d1 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/0f8c9935-64a8-4926-b9f8-d29a65d12c30" status: 202 len: 0 microversion: 2.1 time: 2.454271 Jul 19 19:52:56.998298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1325/2728] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:52:54 2022] DELETE /compute/v2.1/os-floating-ips/0f8c9935-64a8-4926-b9f8-d29a65d12c30 => generated 0 bytes in 2456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:57.004435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.004936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.011345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.012460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.013540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.014133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.015135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.015757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.018773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:57.021049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.021776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.023028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.023693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.056343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:57.188675 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-284dabe2-7f68-4872-b2c7-35f893f4776a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 204 len: 0 microversion: 2.20 time: 0.188137 Jul 19 19:52:57.194290 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1326/2729] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:52:56 2022] DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:52:57.201682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.202663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.212503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.213007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.213790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.215149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.236164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.247220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cdec408-5e1a-4cd2-ae83-da1b0900586d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.260387 Jul 19 19:52:57.248623 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1404/2730] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:56 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:57.261514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.262431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.270810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.271608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.272410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.272847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.369698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.398787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.400738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.406671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7c17cd5-25e7-4a7e-8b9f-06247d20e3b7 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.156814 Jul 19 19:52:57.407385 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1405/2731] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:57.412514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2317ec32-506c-4a25-a84f-3c49be590300 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '.version_select at 0x7f23eef63430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.422465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.431016 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a479846c-e74b-4cf9-9fe8-9ab420b88720 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.234732 Jul 19 19:52:57.431736 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1327/2732] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:57.437293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.438147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.445201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.445901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.447209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.447683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.674363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.685082 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3286b87a-7bda-4e36-9d38-093c867cda9c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.252016 Jul 19 19:52:57.686633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1328/2733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:57.695326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.695787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.705897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.706700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.709775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.710359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.721972 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2317ec32-506c-4a25-a84f-3c49be590300 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4b9e1243-7b0c-434d-8931-8510ca6dc86d" status: 202 len: 0 microversion: 2.1 time: 0.313265 Jul 19 19:52:57.723502 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1406/2734] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:52:57 2022] DELETE /compute/v2.1/os-security-groups/4b9e1243-7b0c-434d-8931-8510ca6dc86d => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:52:57.752325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-03049b45-fadf-4741-a304-1aa4af299b2d req-cced0d06-3bef-43d5-91b8-eb4cc65ac7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a731b7-9aa9-427d-bbef-be48d0320774", "name": "network-vif-plugged", "status": "completed", "tag": "c6be8861-6bf1-40cb-a028-70cb1f756199"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:57.777425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-03049b45-fadf-4741-a304-1aa4af299b2d req-cced0d06-3bef-43d5-91b8-eb4cc65ac7be service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.787357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-03049b45-fadf-4741-a304-1aa4af299b2d req-cced0d06-3bef-43d5-91b8-eb4cc65ac7be service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.803223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-03049b45-fadf-4741-a304-1aa4af299b2d req-cced0d06-3bef-43d5-91b8-eb4cc65ac7be service nova] Creating event network-vif-plugged:c6be8861-6bf1-40cb-a028-70cb1f756199 for instance 52a731b7-9aa9-427d-bbef-be48d0320774 on n-h2-843834-3 Jul 19 19:52:57.811657 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-03049b45-fadf-4741-a304-1aa4af299b2d req-cced0d06-3bef-43d5-91b8-eb4cc65ac7be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085920 Jul 19 19:52:57.813196 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1407/2735] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:57.819043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:57.819941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:57.829439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.830237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.831495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:57.832133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:57.865044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:52:57.936337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.950069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.951692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:57.953180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a83be806-4f19-494c-8aa8-e30eb7e91554 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.266257 Jul 19 19:52:57.957949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1329/2736] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:58.001915 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e672097-7d09-4c5d-a5a1-450b4270358d tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "DELETE /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 204 len: 0 microversion: 2.1 time: 0.186861 Jul 19 19:52:58.003002 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1408/2737] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:52:57 2022] DELETE /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:52:58.011229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.012872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.014106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.015820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.023120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.024023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.025344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.025928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.027161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.027978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.029233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.029699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.309428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.315082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.319041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:58.325164 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9b497e7-6d11-4c22-81d4-f4cf7487561a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1508 microversion: 2.1 time: 0.316087 Jul 19 19:52:58.335042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.336194 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1409/2738] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:58.336327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.337506 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ea204a28-cf16-4dbe-bee4-a01983691b15 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.339021 Jul 19 19:52:58.339257 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1330/2739] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:57 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:58.341367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.342170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.349806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.350256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.351086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.351521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.426431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.427208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.433899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.434422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.435286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.435783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.566303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.570022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:52:58.575820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.577306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.583403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55add7d8-532f-428a-b3bc-5bfa82e0ea6c tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.161261 Jul 19 19:52:58.583993 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1331/2740] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:58.588448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.589049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.595446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.595896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.596707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.597137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.692581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.702828 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd117d76-ccb1-4c93-bf5c-ead498298ed5 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.365191 Jul 19 19:52:58.713301 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1410/2741] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:58.719508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.720171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.726861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.727328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.728170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.728712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.923923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:58.932778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd46859f-6eb4-4faa-aba3-5d0641150a86 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.347688 Jul 19 19:52:58.942360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1332/2742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:58.975508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:58.976159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:58.985514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.985514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.986297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:58.986937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:58.993238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.004708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9d3c340-1c27-4e77-847d-689c4d8461fe tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.289565 Jul 19 19:52:59.009751 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1411/2743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:59.249958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.259265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.260919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.262199 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05e9afef-c93f-49f2-b739-22bd065aa51b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1721 microversion: 2.20 time: 0.293121 Jul 19 19:52:59.262876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1333/2744] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:58 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:59.342233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.343173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.356633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.357256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.360068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.360839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.363834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.364281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.368132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.369038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.369868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.370306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.768269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.774199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.786573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.788367 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d3e5081d-9d09-4314-93e8-e6b18520164a tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1508 microversion: 2.1 time: 0.449754 Jul 19 19:52:59.788698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.789483 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1412/2745] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:52:59.789923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cc7da87f-7e96-46d5-baca-6785f6d666fe tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.437427 Jul 19 19:52:59.796283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.797205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.805408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.806301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.807532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.808228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.811394 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1334/2746] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:52:59.826369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-96893ddf-d2e7-478e-86ec-ae44a6373794 req-396fcb56-f0fc-4171-b40e-61f6274b0741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b46ac79-be21-4f59-b714-0d63bcf29ce7", "name": "network-vif-deleted", "tag": "66ce091d-ce27-46a0-af9b-b2b9cf70ac14"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:52:59.840116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-96893ddf-d2e7-478e-86ec-ae44a6373794 req-396fcb56-f0fc-4171-b40e-61f6274b0741 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.840567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-96893ddf-d2e7-478e-86ec-ae44a6373794 req-396fcb56-f0fc-4171-b40e-61f6274b0741 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.882693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-96893ddf-d2e7-478e-86ec-ae44a6373794 req-396fcb56-f0fc-4171-b40e-61f6274b0741 service nova] Creating event network-vif-deleted:66ce091d-ce27-46a0-af9b-b2b9cf70ac14 for instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 on n-h2-843834-3 Jul 19 19:52:59.889816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-96893ddf-d2e7-478e-86ec-ae44a6373794 req-396fcb56-f0fc-4171-b40e-61f6274b0741 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076681 Jul 19 19:52:59.890444 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1335/2747] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:52:59.900848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.901562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.909592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.910048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.911539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.911539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.912380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.926887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.929559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:52:59.936587 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29ff8b6f-6484-47be-a907-9b7ae5ee507b tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.145566 Jul 19 19:52:59.951138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1413/2748] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:52:59.956520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:52:59.957213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:52:59.963669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.964329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:52:59.965102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:52:59.965692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.279586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.292698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.297647 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0bac3979-3afc-4db5-b88b-40df78cf4d2c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.393935 Jul 19 19:53:00.302530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1336/2749] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:00.315954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.316579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.317963 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0091780e-e0bb-4cfd-b072-8ed217bda831 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1314 microversion: 2.1 time: 0.365407 Jul 19 19:53:00.321702 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1414/2750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:52:59 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:00.330211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.332223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.333488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.335969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.336939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.339099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.340960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.341537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.342420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.343124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.394156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.394523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.395750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lazy-loading 'fault' on Instance uuid 7b46ac79-be21-4f59-b714-0d63bcf29ce7 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:00.490247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.503014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.505046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.506630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7292fca6-5baa-4092-9819-e9ec54f565d0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 200 len: 1369 microversion: 2.20 time: 0.181764 Jul 19 19:53:00.519756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1415/2751] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:00.643714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:00.652328 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-998fce84-ef22-4794-af59-636f3908fe5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.348462 Jul 19 19:53:00.652842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1337/2752] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:00.808389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.809007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.815150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:00.815776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:00.822670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.823153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.823948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.824592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.836336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.837303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:00.837608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:00.838192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.139067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.151495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2966cd0-2fe9-4e71-9097-f7ae038c5860 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1508 microversion: 2.1 time: 0.348634 Jul 19 19:53:01.152106 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1416/2753] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:01.156999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.157416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:01.169627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.180537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.182122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.191394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.191856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.192671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.193096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.197343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d5ae04ba-d7bd-4fc0-92b6-cf68f29084ae tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.378934 Jul 19 19:53:01.198076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1338/2754] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:00 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:01.319474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.320263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:01.328035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.328870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.329867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.330754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.365792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.378534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.389056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.400004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0863b75d-2e2f-406c-bf0a-9639d84035f9 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1447 microversion: 2.75 time: 0.246150 Jul 19 19:53:01.401273 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1417/2755] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:01.406462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:01.407342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:01.416506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.420084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.421264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:01.422083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:01.990188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:01.999279 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4e4e4f5-57b5-462a-8a0c-8c34da33f5c1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.683766 Jul 19 19:53:02.011406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.015149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1339/2756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:02.021204 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-502ff220-6712-4f79-b98c-dbd58deac0a7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1501 microversion: 2.1 time: 0.618538 Jul 19 19:53:02.025702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.026312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.027060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1418/2757] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:01 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1501 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.031962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.035116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.043060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.045811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.047232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.048843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.049516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.052301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.053429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.054031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.085402 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 HTTP/1.1 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '7b46ac79-be21-4f59-b714-0d63bcf29ce7'} Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:02.087297 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:53:02.094172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:02.101383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:02.102756 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af04a2f6-855f-4461-b7eb-7652186b3070 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 404 len: 111 microversion: 2.20 time: 0.082689 Jul 19 19:53:02.103615 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1340/2758] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:53:02.113340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9b47fac-4921-4b0e-81ac-bb054bf4b908 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:02.121313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9b47fac-4921-4b0e-81ac-bb054bf4b908 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.122143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9b47fac-4921-4b0e-81ac-bb054bf4b908 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.199015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9b47fac-4921-4b0e-81ac-bb054bf4b908 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:53:02.269744 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9b47fac-4921-4b0e-81ac-bb054bf4b908 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774/action" status: 202 len: 0 microversion: 2.1 time: 0.159880 Jul 19 19:53:02.270743 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1341/2759] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:02 2022] POST /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:02.285634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0dacd1f4-95a7-449f-8ddb-c73589426cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '.version_select at 0x7f23efb631f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.324162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.341401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-deb81a22-58ac-4ab1-95f0-d5b59237a0a1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.309752 Jul 19 19:53:02.343120 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1419/2760] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.347366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0dacd1f4-95a7-449f-8ddb-c73589426cd2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70956320" status: 204 len: 0 microversion: 2.20 time: 0.068213 Jul 19 19:53:02.348296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.349164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.349449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1342/2761] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 19:53:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70956320 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:53:02.359584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.360593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.361720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.362351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.375772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.378764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.389827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.390461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.391282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.392670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.476012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.492453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d755483b-6684-4df9-8005-8c97cc01c296 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1466 microversion: 2.1 time: 0.148056 Jul 19 19:53:02.503644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1420/2762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.515267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.519547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.535535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.536576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.537641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.538296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.883692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.901682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.908306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.909768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3394a0ee-a7d9-4ea9-889d-652fc2ad2555 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.556417 Jul 19 19:53:02.910821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1343/2763] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:02.916236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:02.917098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:02.921995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:02.924798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.925271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.926487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.926738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.929971 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45a6371c-8d71-403a-a2fd-a4e6b65e0e2d tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.425092 Jul 19 19:53:02.930571 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1421/2764] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:02.941866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0b086008-c995-41e6-94e1-12abf67bdc22 req-d0861d06-5607-4298-9eec-afe043eda67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312a01af-ccf8-4a0e-a5ae-cc148049247d", "name": "network-vif-deleted", "tag": "ccd3e211-b58d-4417-b92b-9d075dbbcb85"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:02.955186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0b086008-c995-41e6-94e1-12abf67bdc22 req-d0861d06-5607-4298-9eec-afe043eda67d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:02.955745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0b086008-c995-41e6-94e1-12abf67bdc22 req-d0861d06-5607-4298-9eec-afe043eda67d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:02.968691 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0b086008-c995-41e6-94e1-12abf67bdc22 req-d0861d06-5607-4298-9eec-afe043eda67d service nova] Creating event network-vif-deleted:ccd3e211-b58d-4417-b92b-9d075dbbcb85 for instance 312a01af-ccf8-4a0e-a5ae-cc148049247d on n-h1-843834-3 Jul 19 19:53:02.975397 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0b086008-c995-41e6-94e1-12abf67bdc22 req-d0861d06-5607-4298-9eec-afe043eda67d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041924 Jul 19 19:53:02.979094 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1422/2765] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:03.018852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.020134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.027850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.028592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.029765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.030355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.040792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.052977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.055043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.060793 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2567060-5040-49d0-89de-9e159ce75dc5 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1453 microversion: 2.75 time: 0.148668 Jul 19 19:53:03.061957 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1344/2766] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:02 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:03.233084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.244437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53f61917-8563-4e22-96b1-0885c107d627 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.229770 Jul 19 19:53:03.245340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1423/2767] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:03.361910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.362547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.370060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.371162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.372147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.372737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.510828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.511818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.518691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.519408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.520522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.521116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.562227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.562953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.563580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lazy-loading 'fault' on Instance uuid 312a01af-ccf8-4a0e-a5ae-cc148049247d {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:03.666631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8981ee6a2545af87960b16c2d48e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50f7a386f604111b0af7ddd603d4490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.680870 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-309f6cf0-3018-40ac-8ace-2d48f0cc8582 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 200 len: 1312 microversion: 2.1 time: 0.174240 Jul 19 19:53:03.681632 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1424/2768] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:03.703980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:03.716544 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49f9739d-44bd-4df0-9cf7-895584de6ee4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.356465 Jul 19 19:53:03.716544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1345/2769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:03.730785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a502883d-4bdb-41e6-a7b1-5367df47688e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: .version_select at 0x7f23eed47280>, body: {"keypair": {"name": "tempest-keypair-452594477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7AUSXihIqQqsk+aCo+eXlAOjEXae1YQk5uoeCXqS9FLZGE7aCnZPrzA00ufnW8rFgl9eGe7BueHZ1zaWYY+au7G+mpVH+hIFz5p5mLqXIQmSlANLE8fLucMbC0r2Ul1Q=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:03.745231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a502883d-4bdb-41e6-a7b1-5367df47688e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for project 6f78585de12146399a7ae194aae19e52. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:03.750608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a502883d-4bdb-41e6-a7b1-5367df47688e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for user 23a43026b121469baad2d3978d113bc2 and project 6f78585de12146399a7ae194aae19e52. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:03.774048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a502883d-4bdb-41e6-a7b1-5367df47688e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047203 Jul 19 19:53:03.774758 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1425/2770] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 19:53:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 19 19:53:03.931027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.932790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.944562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.945638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.947348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.947942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.950302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:03.951473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:03.966773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.970139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:03.972523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:03.973733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.345802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.354609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.356494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.358174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.359766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c3d1ca7-f178-4bd2-850e-0ed69b67d162 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.434507 Jul 19 19:53:04.370960 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1346/2771] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:04.372044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36defdb2-d8c7-41f6-93bc-331c195777bc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.420060 Jul 19 19:53:04.372044 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1426/2772] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:03 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:04.380239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.381164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.381527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.382233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.397205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.398557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.399156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.399638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.400265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.400511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.400769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.400954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.426350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:04.508370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.518836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.521291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.529035 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36e3f054-dc50-4751-b6fe-d67dc0db5b80 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1438 microversion: 2.75 time: 0.164420 Jul 19 19:53:04.530567 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1347/2773] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1438 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:04.594003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:04.604686 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1428dc3e-82f7-4a83-96f8-7224701a6346 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.237936 Jul 19 19:53:04.606855 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1427/2774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:04.700260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.701245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] [instance: 312a01af-ccf8-4a0e-a5ae-cc148049247d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.710519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.711089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.712118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.712762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.729505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] HTTP exception thrown: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Request method failure captured: Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d HTTP/1.1 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1ws9hs0OGl6d62G-EN3fNMDrCUxerFWyvrJe-4fmFRWcMOPliS5KN3nH3phV0aRn1Jp8Z7pdorgbRhyY75xh2g_Gg_1JtPGfj3Qo2qcUgJOTLNCAjGVPx6xPV9c55zhgOgBEVDdPUVGo5uJnpSzJ0jRZgkRZiaBTKVqRlIYjLRvJqHQ Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c50f7a386f604111b0af7ddd603d4490 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1965030695 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c50f7a386f604111b0af7ddd603d4490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c50f7a386f604111b0af7ddd603d4490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c50f7a386f604111b0af7ddd603d4490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c50f7a386f604111b0af7ddd603d4490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1965030695 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c50f7a386f604111b0af7ddd603d4490 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1965030695 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerRescueTestJSONUnderV235-1965030695-project Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dd8981ee6a2545af87960b16c2d48e89 Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1965030695-project Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '312a01af-ccf8-4a0e-a5ae-cc148049247d'} Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:04.731477 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. Jul 19 19:53:04.735999 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:04.738584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] Returning 404 to user: Instance 312a01af-ccf8-4a0e-a5ae-cc148049247d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:04.740258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d08e563-69a6-4774-b1d3-f6e1f1e2ade9 tempest-ServerRescueTestJSONUnderV235-1965030695 tempest-ServerRescueTestJSONUnderV235-1965030695-project] 10.222.0.23 "GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d" status: 404 len: 111 microversion: 2.1 time: 0.044493 Jul 19 19:53:04.741807 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1428/2775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/312a01af-ccf8-4a0e-a5ae-cc148049247d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:04.753616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:04.754552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.761311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.762050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.763042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.763636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.927947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:04.929478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:04.935964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.936835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:04.937843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:04.938540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.024917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:05.025630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:05.026275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:05.026981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:05.027455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:05.053443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.062653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:05.066963 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9a26af2e-2a60-46a5-a928-90eed9182bcf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.323423 Jul 19 19:53:05.068132 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1429/2776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:04 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:05.103844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.108961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:05.134148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.134956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.136261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.137092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.305270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:05.334106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac0fc64b-9232-40fe-ac9e-da677961f363 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc/action" status: 202 len: 1942 microversion: 2.75 time: 0.785764 Jul 19 19:53:05.335344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1348/2777] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:53:04 2022] POST /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc/action => generated 1942 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 19:53:05.353000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.354060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.360635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.361946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.363506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.364118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.393995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.396859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.422384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.423288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.424807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.426858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.584498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:05.615978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-578bb181-a21b-48dd-a5f7-c66a848d0b71 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.266585 Jul 19 19:53:05.630233 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1430/2778] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:05.636619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.637561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.645062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.645825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.646815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.647451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.913698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:05.922289 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29df8dca-67d4-4921-903f-11a716040f3c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.539507 Jul 19 19:53:05.924063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1349/2779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:05.935193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:05.935927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:05.943661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.945183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:05.946777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:05.947461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.030931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.042263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.044041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.045437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cdab0645-d999-453a-aaf6-df85d8044928 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.413900 Jul 19 19:53:06.047315 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1431/2780] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:06.053024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-119909295", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c737f796-c7f6-4ab9-bce5-9b5f4c2b900a"}], "security_groups": [{"name": "tempest-securitygroup--446620721"}], "key_name": "tempest-keypair-452594477", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:06.332480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.340541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] validate_networks() for [('c737f796-c7f6-4ab9-bce5-9b5f4c2b900a', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:06.348982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8c0c41b-653a-47fe-813b-62a4fe9e008d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.423609 Jul 19 19:53:06.350139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1350/2781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:05 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:06.356902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:06.357935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:06.364832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.365688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.366752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.367598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.728431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:06.741365 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a0b0ad62-8895-4842-805b-1766e43b5dbf tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.389155 Jul 19 19:53:06.742815 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1351/2782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:06 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:06.748077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:06.748870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:06.755920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.756375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.757158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.757601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.893954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:06.917361 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-87047e71-c072-41d2-91de-3199d8284418 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.173199 Jul 19 19:53:06.930808 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1352/2783] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:06 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:06.941430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:06.942273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:06.949873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.951546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:06.952681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:06.953340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.613620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:07.614133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:07.614743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:07.614928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:07.615553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:07.634770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.635381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.637255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.638036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.664229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for project 6f78585de12146399a7ae194aae19e52. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:07.675937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Getting quotas for user 23a43026b121469baad2d3978d113bc2 and project 6f78585de12146399a7ae194aae19e52. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:07.687423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:07.697959 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c3387c0-42fc-4926-a50a-f156a3f4d283 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.761258 Jul 19 19:53:07.699148 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1353/2784] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:06 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:07.704333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:07.705139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:07.706760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:07.713062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:07.715446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.723074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.724808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.725816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.792837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-479c54ed-058c-43b1-ad9d-6b7352b0f9dd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.744243 Jul 19 19:53:07.794136 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1432/2785] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:53:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:53:07.799625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:07.802543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:07.806006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:07.813942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.815046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:07.816032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:07.816818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.466882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.487458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.497050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.500714 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d606173-046f-455e-be7e-32c3ba90cef0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.800286 Jul 19 19:53:08.502306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.503544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1354/2786] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:07 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:08.511521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b83d7fd5-c7ae-4929-ba90-9136ccbf8084 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.716142 Jul 19 19:53:08.515705 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1433/2787] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:07 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:08.518749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.519594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.520818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.521424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.531060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.531521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.532303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.532737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.533026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.533487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.537903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.539185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.717343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.748694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.750695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.754173 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ae71356-65d9-48ac-8bc7-536bbdf61ef5 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1284 microversion: 2.20 time: 0.236398 Jul 19 19:53:08.756517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1434/2788] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:08.762792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.763723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.771991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.772911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.774766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.775516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.934796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:08.947785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0730461e-43e1-4f5e-90f5-3950d0fff69e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.442276 Jul 19 19:53:08.948441 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1355/2789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:08.961444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:08.964253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:08.977790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.980807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.984145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:08.984846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:08.994239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:09.033742 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-450e561a-20d4-4f47-85fb-df0aa46fd35e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.275856 Jul 19 19:53:09.034350 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1435/2790] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:09.493794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:09.506101 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cc66b49b-cc6e-4897-9a62-e619489463a4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.556390 Jul 19 19:53:09.514085 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1356/2791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:08 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:09.530814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:09.531442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:09.531798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:09.532339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:09.540274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.540723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.543484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.544100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.544357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.545185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:09.546178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:09.546679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.494925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.503072 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5de25974-b5e2-4ab6-9e5d-1f38f8e11e77 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.975512 Jul 19 19:53:10.503682 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1357/2792] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:09 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:10.517253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.518074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.524691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.525444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.526411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.527713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.751753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.757312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.768198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.770509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.775439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.777893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-374183e5-df9b-49ae-9bc8-f996d51ba427 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1338 microversion: 2.20 time: 0.264528 Jul 19 19:53:10.782976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:10.783944 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1358/2793] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:10.784894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8bd8eaa-dffe-43b9-97e9-f2ce40814859 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 1.265863 Jul 19 19:53:10.785936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1436/2794] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:09 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:10.794630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.795443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.804421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:10.807524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.807978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.810774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:10.810935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.810935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.815964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.827632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:10.828630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:10.829091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.104839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:11.131159 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c24c4812-b0f5-4b3e-89c6-070f1195d9fc tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.343773 Jul 19 19:53:11.132245 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1437/2795] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:11.137741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.138830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.146352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.147788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.149041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.149733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.337149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:11.347234 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7efc174-942e-4cdd-8b3d-88d31ccdbca6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.562095 Jul 19 19:53:11.348424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1359/2796] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:10 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:11.520087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.521589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.530207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.530666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.532518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.533093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.589838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:11.603598 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-38953ddb-0377-40f6-9563-14c9e4bb9352 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.468501 Jul 19 19:53:11.604240 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1438/2797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:11.809239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:11.809866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:11.828662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.829535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:11.830356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:11.830812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.003326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.017723 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-82921116-acac-4908-8d3e-89ccb6f3c662 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 1.501639 Jul 19 19:53:13.019674 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1360/2798] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:13.026676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.027421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.028697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.037669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.037875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.038412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.039590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.039736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.040729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.042321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d04588e9-672f-47b6-8300-2bee191c11b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 1.238403 Jul 19 19:53:13.043604 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1439/2799] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:11 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:13.212172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0725299f-bdc5-4ba8-9045-296d79c9f58d tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Action: 'create', calling method: .version_select at 0x7f23eed62c10>, body: {"pool": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:13.444377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.460900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.467748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:13.470745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aeeedcee-306a-4edb-bb42-0f1c595f6d90 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.449868 Jul 19 19:53:13.483162 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1361/2800] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:13.490219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.490845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.499761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.500614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.501767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.502962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.683159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:13.705005 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b70f804-15f1-451c-ae7e-cac5b5223f7e tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.219649 Jul 19 19:53:13.706288 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1362/2801] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:13.711795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:13.712702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:13.721410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.722206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.723813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:13.724442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:13.730856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:14.115875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:14.179552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11b9aec8-e55f-4ce5-aa26-4535dfd2c785 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.470061 Jul 19 19:53:14.180857 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1363/2802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:13 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:14.192076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:14.198681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:14.215850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:14.216619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:14.218947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:14.219689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:14.735469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:14.758990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b41bd69e-73a5-4a01-ba4a-296155047cd7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.568868 Jul 19 19:53:14.764177 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1364/2803] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:14 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:14.785200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:14.796212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:14.808714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:14.810211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:14.812252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:14.815050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.157338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:15.167536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5608db57-fb04-4368-90c2-25dfa4e66942 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.389125 Jul 19 19:53:15.180324 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1365/2804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:14 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:15.189071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:15.194485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:15.205934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.206393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.207507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.208371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.676012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:15.689282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:15.691465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:15.693315 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-971562cc-7911-4335-b1c0-ceea7c5c890d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.519786 Jul 19 19:53:15.694720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1366/2805] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:15 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:15.701090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:15.702123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:15.709877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.711099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:15.712211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:15.713043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.012131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.038898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.043723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.046264 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25bbc28a-a0b2-438f-a60e-b9bb05e17d28 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.350042 Jul 19 19:53:16.050171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1367/2806] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:15 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:16.061475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.062095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.072449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.072906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.074492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.075138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.190309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:16.214553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-53820c78-8ac5-4c49-a230-77deb9074876 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.163115 Jul 19 19:53:16.215372 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1368/2807] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:16.224257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-37a06614-6abe-430d-ae53-a86ed56ed926 req-cf30e2cb-8d04-451a-b19b-526686d7c05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:16.236057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-37a06614-6abe-430d-ae53-a86ed56ed926 req-cf30e2cb-8d04-451a-b19b-526686d7c05f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.236650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-37a06614-6abe-430d-ae53-a86ed56ed926 req-cf30e2cb-8d04-451a-b19b-526686d7c05f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.248480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-37a06614-6abe-430d-ae53-a86ed56ed926 req-cf30e2cb-8d04-451a-b19b-526686d7c05f service nova] Creating event network-changed:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:53:16.255070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-37a06614-6abe-430d-ae53-a86ed56ed926 req-cf30e2cb-8d04-451a-b19b-526686d7c05f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038397 Jul 19 19:53:16.256258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1369/2808] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.383926 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0725299f-bdc5-4ba8-9045-296d79c9f58d tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.338766 Jul 19 19:53:16.384627 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1440/2809] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:53:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.395217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.395834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.402340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.403137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.403930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.404372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.414780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f2ef8bd-6794-4122-bbc6-cdca5fb73f5b tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] Calling method '.version_select at 0x7f24009abf70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.472407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f2ef8bd-6794-4122-bbc6-cdca5fb73f5b tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214513 Jul 19 19:53:16.473136 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1370/2810] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.478974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.479730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.486139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.486597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.487425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.487873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.586626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.597021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7ae22bc5-b137-452d-99be-ba64762607d2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.205496 Jul 19 19:53:16.597622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1441/2811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:16.602875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.604156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.612951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.613534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.614377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.614889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.649772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.658107 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3205777-acf0-465b-b39c-4289b75f7434 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.183785 Jul 19 19:53:16.658890 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1371/2812] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:16.666212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd9b5649-7498-4ef5-b770-c0090c245a43 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f24009abc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.855398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:16.863368 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74e33b1a-24db-4bfc-8b06-8c2afc887a7c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.264421 Jul 19 19:53:16.863935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1442/2813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:16.868786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46fa684a-9491-4bf5-ab72-a2001eecbccd tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] Calling method '.version_select at 0x7f23eed73f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.901037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd9b5649-7498-4ef5-b770-c0090c245a43 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/e0f946e3-b779-4449-8518-5ef5ce51acff" status: 200 len: 142 microversion: 2.1 time: 0.239456 Jul 19 19:53:16.901800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1372/2814] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/os-floating-ips/e0f946e3-b779-4449-8518-5ef5ce51acff => generated 142 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.906753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:16.907420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:16.913816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.914480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.915493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:16.916220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:16.961161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46fa684a-9491-4bf5-ab72-a2001eecbccd tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50" status: 200 len: 371 microversion: 2.1 time: 0.095938 Jul 19 19:53:16.962090 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1443/2815] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:16.969408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-077bde0d-1cbc-40fe-98f9-7496459b20c6 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f23eed62160>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.647268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.654262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:17.657604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.658849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.660202 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a6c88423-1ad2-453b-8d35-75485abf4d27 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.757259 Jul 19 19:53:17.660958 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1373/2816] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:17.665481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ee08fe28-6c5b-4a5c-8b3b-c7ca0b368465 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] Calling method '.version_select at 0x7f24008b3e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.673473 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-077bde0d-1cbc-40fe-98f9-7496459b20c6 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.709496 Jul 19 19:53:17.673473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1444/2817] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:53:16 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:17.685208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.685824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.696944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.697604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.698388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.698825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.725658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ee08fe28-6c5b-4a5c-8b3b-c7ca0b368465 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063485 Jul 19 19:53:17.726355 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1374/2818] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50/defaults => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:17.731346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.732264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.739056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.739519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.740298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.740739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.856706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:17.875388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66f83fb6-d64c-4068-b9da-91b381729b19 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.147396 Jul 19 19:53:17.876236 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1375/2819] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:17.881211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.881823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.888823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.889286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.890073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.890511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.935796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.946270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.946270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:17.947299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28b02cef-4ec1-4867-9f71-e14a231e1266 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.266680 Jul 19 19:53:17.947902 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1445/2820] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:17.952539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:17.953148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:17.959637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.960078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:17.960894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:17.961326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.212777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.220732 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b1511c39-4fca-4f59-8c39-41db545c07a2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.343112 Jul 19 19:53:18.221333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1376/2821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.226711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5671c8ec-3a0e-4fa5-a256-6783ec362e39 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f2400a1ed30>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.278871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.286855 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7d54ceec-792b-4a59-aaad-5ad5652f7bae tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.337891 Jul 19 19:53:18.287523 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1446/2822] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:17 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.292492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83d42d31-c954-48eb-a280-d9c262979fc3 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] Calling method '.version_select at 0x7f23eec95dc0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.375004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83d42d31-c954-48eb-a280-d9c262979fc3 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50" status: 200 len: 371 microversion: 2.1 time: 0.085999 Jul 19 19:53:18.375629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1447/2823] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:18.380426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.381050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.387552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.388013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.388847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.389225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.409238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:18.627637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:18.635814 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75f60787-0d9a-4745-9c32-24c3643cd20f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.259170 Jul 19 19:53:18.636416 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1448/2824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:18.641215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fbb1058f-037c-4dfb-a70c-b532cad5c008 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] Calling method '.version_select at 0x7f23eed62040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.715209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fbb1058f-037c-4dfb-a70c-b532cad5c008 tempest-QuotasTestJSON-1831433416 tempest-QuotasTestJSON-1831433416-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50?user_id=983a3f946cdb4cc0a330725b164915a0" status: 200 len: 371 microversion: 2.1 time: 0.077467 Jul 19 19:53:18.715936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1449/2825] 10.222.0.23 () {58 vars in 1322 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/os-quota-sets/841486d07f9647ea80ba86e0ba251f50?user_id=983a3f946cdb4cc0a330725b164915a0 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:18.721657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:18.721657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:18.728197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.728579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:18.729476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:18.729917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.056794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.066782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.068789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.070311 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9cf1fc5a-6f07-415a-a204-9c7b0a4507c3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.353522 Jul 19 19:53:19.071808 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1450/2826] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:18 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:19.076816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.077737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.084114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.084877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.085875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.086510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.188611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:19.209858 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aeeaa1b6-43ce-4064-a5b1-556fbd8815a3 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.136533 Jul 19 19:53:19.210463 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1451/2827] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:19.230589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.231659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.243760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.244288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.245078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.245517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.319306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5671c8ec-3a0e-4fa5-a256-6783ec362e39 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e0f946e3-b779-4449-8518-5ef5ce51acff" status: 202 len: 0 microversion: 2.1 time: 1.096661 Jul 19 19:53:19.320849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1377/2828] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:18 2022] DELETE /compute/v2.1/os-floating-ips/e0f946e3-b779-4449-8518-5ef5ce51acff => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:19.328171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.329161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.335849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.336690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.337884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.338644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.471343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.480979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.482567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.484650 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-965efc0f-b34c-404c-8123-5a3c40c61b13 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.260241 Jul 19 19:53:19.485932 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1452/2829] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:19.492381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.493398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.501582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.502126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.503224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.503779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.520681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.529666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f31c95d-b976-48da-bdba-4b1395a03b3c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.207085 Jul 19 19:53:19.530258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1378/2830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.536156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2f91644c-0c32-41a0-8b2e-b62e1d660268 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Action: 'create', calling method: .version_select at 0x7f2400a51c10>, body: {"pool": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:19.751993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:19.761108 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7b86ec2-c174-4886-bf45-213cd88fd86a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.273514 Jul 19 19:53:19.762271 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1453/2831] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:19.767641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:19.768344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:19.774981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.775567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:19.776482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:19.776917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.026147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.039905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-09111231-5601-4095-bdf5-d5b06bfab54f tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1505 microversion: 2.1 time: 0.274904 Jul 19 19:53:20.041729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1454/2832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:19 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:20.070489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-485e9c2a-6f47-4698-a945-08c044074cf9 req-c19fd941-42bf-42bf-903f-d3b15976517d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "32137e5f-76f6-4923-948b-dea0b9940b3d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:20.089571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-485e9c2a-6f47-4698-a945-08c044074cf9 req-c19fd941-42bf-42bf-903f-d3b15976517d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.090511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-485e9c2a-6f47-4698-a945-08c044074cf9 req-c19fd941-42bf-42bf-903f-d3b15976517d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.111342 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-485e9c2a-6f47-4698-a945-08c044074cf9 req-c19fd941-42bf-42bf-903f-d3b15976517d service nova] Creating event network-vif-plugged:32137e5f-76f6-4923-948b-dea0b9940b3d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:20.132610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-485e9c2a-6f47-4698-a945-08c044074cf9 req-c19fd941-42bf-42bf-903f-d3b15976517d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066509 Jul 19 19:53:20.135004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1455/2833] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:20.142691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.143459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:20.152602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.153097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.153956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.154446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.435062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.449353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.451761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.454162 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55514099-b4e6-44a3-8036-d126cbf3eabd tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.316358 Jul 19 19:53:20.455427 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1456/2834] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:20.462190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.463220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:20.478556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.479968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.481652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.482528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.618557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:20.649217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b2f95de-eda0-443b-88b1-7e0086605101 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.192384 Jul 19 19:53:20.650332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1457/2835] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:20.656466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.657077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:20.664048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.664504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.665281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.665965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.916740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.928895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.931068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:20.932416 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9124d4ea-c68a-4ce4-b673-b36ac4b7fd72 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.280717 Jul 19 19:53:20.933001 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1458/2836] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:20.937773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:20.938656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:20.951773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.952226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:20.953204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:20.953660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.237844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.247652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e0e87c9-81d1-4394-b24a-86c79acde660 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1514 microversion: 2.1 time: 0.313285 Jul 19 19:53:21.248339 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1459/2837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:20 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.264044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.264699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.272040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.272833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.274190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.276042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.624260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.648167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c12638a-2f42-451f-bff8-a721e5cd1282 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.386913 Jul 19 19:53:21.651289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1460/2838] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.667325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.678680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.702065 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2f91644c-0c32-41a0-8b2e-b62e1d660268 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.170471 Jul 19 19:53:21.703558 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1379/2839] 10.222.0.23 () {60 vars in 1169 bytes} [Tue Jul 19 19:53:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:21.704198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.704665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.709393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.709913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.710277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.711265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.719699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.735258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.736510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:21.737163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:21.975141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:21.985016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e8f8290-80e8-4131-b7ed-81204c31b745 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1485 microversion: 2.1 time: 0.332258 Jul 19 19:53:21.985983 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1461/2840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1485 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:21.991306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:21.992102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:21.999784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.000893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.001800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.002360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.060688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.071774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.074380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:22.076334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f2d97258-403b-4507-9017-f70ea6dedbfb tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.371105 Jul 19 19:53:22.088100 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1380/2841] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:22.093261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-38def2bd-8f9c-4f16-baa4-2dd768a27a0b tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f2400a244c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.122314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:22.146970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0dfda1c6-bd0f-4fe9-87e3-9eda96dfa1a6 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.159609 Jul 19 19:53:22.147869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1462/2842] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:21 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:22.281013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc636287-474b-4770-a081-9a75acc35acc tempest-ComputeTenantNetworksTest-1316545096 tempest-ComputeTenantNetworksTest-1316545096-project] Calling method '.version_select at 0x7f23eed49550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.927287 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc636287-474b-4770-a081-9a75acc35acc tempest-ComputeTenantNetworksTest-1316545096 tempest-ComputeTenantNetworksTest-1316545096-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.777243 Jul 19 19:53:22.932993 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1463/2843] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:22.934234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:22.934959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:22.941568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.942107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:22.943026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:22.943480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.168288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:23.177136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:23.178750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:23.180345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5884fe5-030e-443d-a933-438daf7484be tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.250505 Jul 19 19:53:23.181251 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1464/2844] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:22 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:23.186629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1208456884", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:23.240896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] validate_networks() for [('824a5a9d-4325-4644-b0b0-03d9409dea9f', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:23.554393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-38def2bd-8f9c-4f16-baa4-2dd768a27a0b tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86" status: 202 len: 0 microversion: 2.1 time: 1.464789 Jul 19 19:53:23.558371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1381/2845] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:22 2022] DELETE /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86 => generated 0 bytes in 1466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:23.560065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "91990a06-1178-4654-8553-4a053eda5e1c"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "f3366ada-1b22-498f-9431-a3646f97f3f0"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "5142b9da-6911-44d7-93c6-0f1fd5e6437a"}, {"server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "name": "network-vif-plugged", "status": "completed", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "2ba4e656-104e-403b-8ef4-51a022ce309d"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "f8fc22e0-5d2e-40f8-a10b-a8008dcdc283"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-plugged", "status": "completed", "tag": "32ecaf13-8f8f-485f-9226-fd02b3cdbdc5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:23.571293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.572141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.585123 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:91990a06-1178-4654-8553-4a053eda5e1c for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.585628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:f3366ada-1b22-498f-9431-a3646f97f3f0 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.586111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:5142b9da-6911-44d7-93c6-0f1fd5e6437a for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.586632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:53:23.587141 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:2ba4e656-104e-403b-8ef4-51a022ce309d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.587628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:f8fc22e0-5d2e-40f8-a10b-a8008dcdc283 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.588113 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] Creating event network-vif-plugged:32ecaf13-8f8f-485f-9226-fd02b3cdbdc5 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:23.597676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6c2638e7-ae5a-4126-b12f-c2444e1b3bc0 req-f640c1b1-2662-468d-af4b-1fe3a1b03c89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.041215 Jul 19 19:53:23.598250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1382/2846] 10.222.0.23 () {64 vars in 1318 bytes} [Tue Jul 19 19:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.603805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:23.604418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:23.611207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.611660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.612815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.612955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.873551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:23.874325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:23.875050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:23.875834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:23.876990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:23.888811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.889832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.891220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:23.891757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:23.903737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:23.912578 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e15d2ad-731a-4dbc-b662-5ebec0f15aba tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1520 microversion: 2.1 time: 0.313128 Jul 19 19:53:23.913041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Getting quotas for project 1db260f44fa445459b9f0493a4afcf12. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:23.913203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1383/2847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:23.921251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Getting quotas for user d0aaf646bf424940b18407df636c82ff and project 1db260f44fa445459b9f0493a4afcf12. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:23.937949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:23.940663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:23.994780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e32e8e8-4c3f-484a-9791-d9c7244a2d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.812155 Jul 19 19:53:24.000810 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1465/2848] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:53:24.002135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b597914-3a33-4df9-af1c-543d123143f6 tempest-ComputeTenantNetworksTest-1316545096 tempest-ComputeTenantNetworksTest-1316545096-project] Calling method '.version_select at 0x7f23fe109700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.086447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.087673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.097284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.097863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.098783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.099344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.156903 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b597914-3a33-4df9-af1c-543d123143f6 tempest-ComputeTenantNetworksTest-1316545096 tempest-ComputeTenantNetworksTest-1316545096-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/c249f54c-82aa-4fe6-8772-50ac626e3c12" status: 200 len: 139 microversion: 2.1 time: 0.159626 Jul 19 19:53:24.157844 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1466/2849] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/os-tenant-networks/c249f54c-82aa-4fe6-8772-50ac626e3c12 => generated 139 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:24.165471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.166656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.173997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.174606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.175451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.177011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.403849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.414156 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80293b86-9a1d-4c29-abd8-7740fd9921ed tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.499538 Jul 19 19:53:24.416526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1384/2850] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:23 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:24.421640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.422626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.430266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.430953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.432334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.433762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.456334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.466801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.469560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.470741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2eec5d7-d672-4fdf-90a0-a03c68b173d5 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1879 microversion: 2.32 time: 0.311441 Jul 19 19:53:24.478594 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1467/2851] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1879 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:24.484171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f23eed73310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.557427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ddacf8b7-e1fd-4f77-a822-58f3c8430b86 could not be found", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:53:24.558174 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] HTTP exception thrown: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Request method failure captured: Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86 HTTP/1.1 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wunW-UWHZ0NuvfaeGcDHe9pS0NDFGyOLjkZY4xKqYHZTQo11nFMheki-ccdYYyiiAC61I3VxLmIpAPRqWLWm9SS4RGrGKRsrDgrP6pA0xfzKme2CoWtAsiJvo0gIm0CZ4SbgL9_tEC-cs2QnaGov_9jSexu6l8ChHRJoNp0tx-Ybyw Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6c41648622a246c989cd9f2a0acaac92 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6c41648622a246c989cd9f2a0acaac92 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsTestJSON-1585909578-project Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ea836eaddcf748ce968f4446815f489b Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsTestJSON-1585909578-project Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: exception: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ddacf8b7-e1fd-4f77-a822-58f3c8430b86'} Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ddacf8b7-e1fd-4f77-a822-58f3c8430b86 could not be found Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44372e8a-3739-4791-97c6-b7f708efc699'] Jul 19 19:53:24.560459 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86. Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Returning 404 to user: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:24.565345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fde780b-0a45-47fe-8542-ad39b281ee47 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86" status: 404 len: 111 microversion: 2.1 time: 0.082042 Jul 19 19:53:24.570944 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1468/2852] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:24.572207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.572630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.580855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.581330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.582129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.582573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.585939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:24.607118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:24.608716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-89d526b5-c39f-4903-94fe-16e9ac363424 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.190007 Jul 19 19:53:24.609688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1385/2853] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:24.616131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.616909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.625780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.626846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.628730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.629308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.634379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:24.674743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:24.686538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0da121bd-2389-4123-b229-a6a2089ce258 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1218 microversion: 2.1 time: 0.118038 Jul 19 19:53:24.697051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1469/2854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:24.703640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Calling method '.version_select at 0x7f23eecef550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.781777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ddacf8b7-e1fd-4f77-a822-58f3c8430b86 could not be found", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:53:24.782490 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] HTTP exception thrown: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Request method failure captured: Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86 HTTP/1.1 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wunW-UWHZ0NuvfaeGcDHe9pS0NDFGyOLjkZY4xKqYHZTQo11nFMheki-ccdYYyiiAC61I3VxLmIpAPRqWLWm9SS4RGrGKRsrDgrP6pA0xfzKme2CoWtAsiJvo0gIm0CZ4SbgL9_tEC-cs2QnaGov_9jSexu6l8ChHRJoNp0tx-Ybyw Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6c41648622a246c989cd9f2a0acaac92 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c41648622a246c989cd9f2a0acaac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6c41648622a246c989cd9f2a0acaac92 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1585909578 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPsTestJSON-1585909578-project Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ea836eaddcf748ce968f4446815f489b Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPsTestJSON-1585909578-project Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: exception: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ddacf8b7-e1fd-4f77-a822-58f3c8430b86'} Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ddacf8b7-e1fd-4f77-a822-58f3c8430b86 could not be found Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-570b7547-1560-484f-b7a1-d617f64d3396'] Jul 19 19:53:24.784374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86. Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] Returning 404 to user: Floating IP not found for ID ddacf8b7-e1fd-4f77-a822-58f3c8430b86 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:24.789057 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f2fff10-0ef6-4c41-acd5-279e5d825e20 tempest-FloatingIPsTestJSON-1585909578 tempest-FloatingIPsTestJSON-1585909578-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86" status: 404 len: 111 microversion: 2.1 time: 0.091342 Jul 19 19:53:24.791581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1470/2855] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:53:24 2022] DELETE /compute/v2.1/os-floating-ips/ddacf8b7-e1fd-4f77-a822-58f3c8430b86 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:24.929914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:24.930796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:24.938520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.939059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:24.940049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:24.940723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.028396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.036537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.038055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.039320 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e10f40a3-fd89-4848-91fc-8206859264a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1405 microversion: 2.20 time: 0.428325 Jul 19 19:53:25.040302 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1386/2856] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:25.213062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.222431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd7abbae-af90-4a1f-8816-f70ab3a16b25 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1520 microversion: 2.1 time: 0.296542 Jul 19 19:53:25.223263 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1471/2857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:24 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:25.432532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.433164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.443432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.443802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.444598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.445132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.497691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.498578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.505470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.506160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.507171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.507683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.799170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.809298 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe683ffb-9ffd-4687-bf09-cc357c7fcdf8 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.381067 Jul 19 19:53:25.809984 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1387/2858] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:25.814846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.815522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:25.822792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.823551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.825269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:25.825817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:25.941139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:25.952588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.971308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.973258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:25.974568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59919a8d-2fa5-4275-96dd-5779b33bebba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2833 microversion: 2.32 time: 0.480893 Jul 19 19:53:25.977719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1472/2859] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2833 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:25.992908 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d96eeb4-03c2-4503-8e99-a48a51592f77 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.181788 Jul 19 19:53:25.993972 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1388/2860] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:25.996968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:25.997589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.009438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:26.017937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.018383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.023611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.025118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.187761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d414562b-df4f-479e-b4f1-25069195a7d0 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Action: 'create', calling method: .version_select at 0x7f2400a59790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-774911229", "metadata": {"Type": "work"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:26.228478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:26.240134 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-535df208-38cb-466a-ad9e-adf0ca7b5bcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1272 microversion: 2.1 time: 0.261059 Jul 19 19:53:26.250015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1473/2861] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:25 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:26.251368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.252084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.259831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.260902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.262237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.263234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.415164 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de9ce5c8-c813-4404-b018-a9767efd6bf2 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.168001 Jul 19 19:53:26.416314 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1474/2862] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393/os-interface => generated 1832 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:26.421874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.423380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.440008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.443497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.444382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.444834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.633611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d414562b-df4f-479e-b4f1-25069195a7d0 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.638207 Jul 19 19:53:26.634273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1389/2863] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 19 19:53:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 640 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 19:53:26.644938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-cc54a60a-a001-4730-93a6-483e0172a5b7 req-7e4e77d1-cf09-40e9-9b3d-7bda3b196f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1313497f-b80f-4834-ac4d-6f8f15518665", "name": "network-vif-plugged", "status": "completed", "tag": "bb733810-9d34-4661-9216-380670ab27f4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:26.654538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cc54a60a-a001-4730-93a6-483e0172a5b7 req-7e4e77d1-cf09-40e9-9b3d-7bda3b196f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.655202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cc54a60a-a001-4730-93a6-483e0172a5b7 req-7e4e77d1-cf09-40e9-9b3d-7bda3b196f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.678503 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-cc54a60a-a001-4730-93a6-483e0172a5b7 req-7e4e77d1-cf09-40e9-9b3d-7bda3b196f57 service nova] Creating event network-vif-plugged:bb733810-9d34-4661-9216-380670ab27f4 for instance 1313497f-b80f-4834-ac4d-6f8f15518665 on n-h2-843834-3 Jul 19 19:53:26.684009 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-cc54a60a-a001-4730-93a6-483e0172a5b7 req-7e4e77d1-cf09-40e9-9b3d-7bda3b196f57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048277 Jul 19 19:53:26.684640 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1390/2864] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:26.720535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:26.721242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:26.729065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.729791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:26.732579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:26.733473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.041481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.067678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.078373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.080127 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cabd7628-abf7-4a00-9663-838f7951f373 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1597 microversion: 2.20 time: 0.662572 Jul 19 19:53:27.081721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1475/2865] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1597 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:27.090085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d1a646b-d275-4a6f-9f89-3ea6b5b86ae6 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eec409d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.146506 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d1a646b-d275-4a6f-9f89-3ea6b5b86ae6 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 200 len: 352 microversion: 2.1 time: 0.061910 Jul 19 19:53:27.147434 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1476/2866] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:27.156224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.157700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.170376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.171927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.173035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.173641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.757342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.765089 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-981d24bc-ecad-4f1f-bdce-b477bb731e97 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1520 microversion: 2.1 time: 1.050020 Jul 19 19:53:27.765670 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1391/2867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:26 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1520 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:27.770224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.770823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.777323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.777780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.778594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.779199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.928147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:27.940372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:27.950410 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db461e9a-e4e4-4a41-a65b-f67093ce317a tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.801203 Jul 19 19:53:27.960591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1477/2868] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:27.961462 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f43f99b-0d69-4a9a-954f-26c28a4b0b89 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.193855 Jul 19 19:53:27.962491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1392/2869] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:27.966453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.967294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.971535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:27.972440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:27.982141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.983827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.984838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.985451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.985938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.991730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:27.992590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:27.993037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.254076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33d820ff-1a8a-41e0-a62a-ab68eed6566f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.291704 Jul 19 19:53:28.254699 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1478/2870] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:53:28.268405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d18257fc-96ca-473d-80b4-60d4bf076ae6 req-e22b813d-a010-4211-9bbd-c72505f075a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b560e6d3-359e-4b9f-9df1-2ff3fa7d5871", "tag": "c5770355-a060-41d6-bea7-d5afd379f1c5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:28.276868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d18257fc-96ca-473d-80b4-60d4bf076ae6 req-e22b813d-a010-4211-9bbd-c72505f075a7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.277323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d18257fc-96ca-473d-80b4-60d4bf076ae6 req-e22b813d-a010-4211-9bbd-c72505f075a7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.289395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d18257fc-96ca-473d-80b4-60d4bf076ae6 req-e22b813d-a010-4211-9bbd-c72505f075a7 service nova] Creating event network-changed:c5770355-a060-41d6-bea7-d5afd379f1c5 for instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 on n-h2-843834-3 Jul 19 19:53:28.294367 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d18257fc-96ca-473d-80b4-60d4bf076ae6 req-e22b813d-a010-4211-9bbd-c72505f075a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038466 Jul 19 19:53:28.295373 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1479/2871] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:28.301901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecd7f793-bf7d-4a9e-99c1-d53cbd3f50f1 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eedb5d30>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.350221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ecd7f793-bf7d-4a9e-99c1-d53cbd3f50f1 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 200 len: 353 microversion: 2.1 time: 0.053366 Jul 19 19:53:28.350979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1480/2872] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:28.361952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7d5ca21a-394f-4277-a8e7-14ac6a66a35f tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eed09a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.411735 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7d5ca21a-394f-4277-a8e7-14ac6a66a35f tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 200 len: 353 microversion: 2.1 time: 0.053757 Jul 19 19:53:28.418957 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1481/2873] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:28.422013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:28.430946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-486e3bd5-7454-470e-84b9-3aa37425110b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.467307 Jul 19 19:53:28.431666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6192aa26-1528-4b92-8bf5-9ccd15ee2870 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eed47ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.432498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1393/2874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:27 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:28.509363 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6192aa26-1528-4b92-8bf5-9ccd15ee2870 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 202 len: 0 microversion: 2.1 time: 0.087578 Jul 19 19:53:28.515310 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1482/2875] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:53:28 2022] DELETE /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:28.524739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e49d62ea-fd2c-4298-91a2-0eafa2134cdb tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f24009abc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.611078 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e49d62ea-fd2c-4298-91a2-0eafa2134cdb tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 200 len: 352 microversion: 2.1 time: 0.090925 Jul 19 19:53:28.611842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1394/2876] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:28.792804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.795146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:28.810085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.810823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.811957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.812543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.967866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:28.968708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:28.981015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.986293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:28.987332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:28.987896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.397160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:29.409509 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c33e2ac2-724f-412a-af8f-c8228de26e2a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1520 microversion: 2.1 time: 0.628504 Jul 19 19:53:29.420135 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1483/2877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1520 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:29.426323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:29.427187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:29.436163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.437795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.438769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.439435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.479335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:29.487247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0731389-03d8-4e6c-b1c0-d523b5291f7b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.524084 Jul 19 19:53:29.487839 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1395/2878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:28 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:29.509618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:29.510470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:29.534398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:29.536683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.542239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.543521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.544133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.629298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:29.674482 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1dfd74bb-8c13-40aa-9c02-51821f310f29 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.252360 Jul 19 19:53:29.675665 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1484/2879] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:29 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:29.680801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd056ce5-ef89-4571-84e2-6d2916d9bbcb tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eec77af0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:29.775528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd056ce5-ef89-4571-84e2-6d2916d9bbcb tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 200 len: 352 microversion: 2.1 time: 0.098554 Jul 19 19:53:29.776254 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1485/2880] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:29 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:29.786706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-448dae66-1e7f-4323-a67a-b0beaff9a3eb req-a6c81288-378e-4e7d-82b3-9992fcd59df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "tag": "32ecaf13-8f8f-485f-9226-fd02b3cdbdc5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:29.806003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-448dae66-1e7f-4323-a67a-b0beaff9a3eb req-a6c81288-378e-4e7d-82b3-9992fcd59df4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:29.811780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-448dae66-1e7f-4323-a67a-b0beaff9a3eb req-a6c81288-378e-4e7d-82b3-9992fcd59df4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:29.843932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-448dae66-1e7f-4323-a67a-b0beaff9a3eb req-a6c81288-378e-4e7d-82b3-9992fcd59df4 service nova] Creating event network-changed:32ecaf13-8f8f-485f-9226-fd02b3cdbdc5 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:53:29.851347 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-448dae66-1e7f-4323-a67a-b0beaff9a3eb req-a6c81288-378e-4e7d-82b3-9992fcd59df4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068711 Jul 19 19:53:29.853371 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1486/2881] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:29.895109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:29.906730 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03afa3e9-5625-4c4c-9d67-c61d7972165e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.414159 Jul 19 19:53:29.908990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1396/2882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:29 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:30.328480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e075c921-c4e7-403f-9a21-6cfeb0638dd0 req-720e5d82-a949-4fad-b892-54fee17d19d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:30.366663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e075c921-c4e7-403f-9a21-6cfeb0638dd0 req-720e5d82-a949-4fad-b892-54fee17d19d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.367466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e075c921-c4e7-403f-9a21-6cfeb0638dd0 req-720e5d82-a949-4fad-b892-54fee17d19d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.400708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e075c921-c4e7-403f-9a21-6cfeb0638dd0 req-720e5d82-a949-4fad-b892-54fee17d19d4 service nova] Creating event network-changed:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:53:30.409273 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e075c921-c4e7-403f-9a21-6cfeb0638dd0 req-720e5d82-a949-4fad-b892-54fee17d19d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085967 Jul 19 19:53:30.411860 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1487/2883] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:30.429191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:30.441263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:30.457844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.458555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.459614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.461512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.505455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:30.506673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:30.516537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.518418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:30.521195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:30.521899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.513160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.515901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:31.522763 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3318fba6-e76c-487a-8ab4-34f17acf66e5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 1.022117 Jul 19 19:53:31.526570 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1a7d5062-a60d-4a36-8f12-8d0e4903894e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1505 microversion: 2.1 time: 1.103434 Jul 19 19:53:31.533709 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1397/2884] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:30 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1505 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:31.534087 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1488/2885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:30 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:31.539943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.540678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:31.549838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68250976-12e7-4bce-b4d2-e0804ee80a48 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Calling method '.version_select at 0x7f23eec77ee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.567532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.568013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.568834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.569284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.612811 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-68250976-12e7-4bce-b4d2-e0804ee80a48 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] HTTP exception thrown: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68250976-12e7-4bce-b4d2-e0804ee80a48 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Request method failure captured: Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 HTTP/1.1 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wu13xYosMAwAOvlPRwg8Nt2VGqwbQKdI6i8JNOECxXIHWKtUw94SPo9zQaGBah1rTNE_GLejtz48R7N_34HIwMLR_O7jmgLngcJzlTxZfwGxhmicnmgmpNCC4Bg62qAdpA1xKtiFQeHvLAdDrioA556gWg0080G_UA5gDGTqquKQlM Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 531f187d9a9644ee854efffbb688ad48 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesGetTestJSON-269802193 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/531f187d9a9644ee854efffbb688ad48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/531f187d9a9644ee854efffbb688ad48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_531f187d9a9644ee854efffbb688ad48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/531f187d9a9644ee854efffbb688ad48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesGetTestJSON-269802193 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 531f187d9a9644ee854efffbb688ad48 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesGetTestJSON-269802193 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesGetTestJSON-269802193-project Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 58e2d689b5fa4ab4a1566a2fbfd2e7c1 Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesGetTestJSON-269802193-project Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '26082098-db68-48bc-b21d-1a902b837ac3'} Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. (HTTP 404) (Request-ID: req-2d8b01c6-2045-442d-9d82-efb810adb676) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:31.616628 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:31.621590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68250976-12e7-4bce-b4d2-e0804ee80a48 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] Returning 404 to user: Volume 26082098-db68-48bc-b21d-1a902b837ac3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:31.625112 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68250976-12e7-4bce-b4d2-e0804ee80a48 tempest-VolumesGetTestJSON-269802193 tempest-VolumesGetTestJSON-269802193-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3" status: 404 len: 109 microversion: 2.1 time: 0.085279 Jul 19 19:53:31.630226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1489/2886] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/os-volumes/26082098-db68-48bc-b21d-1a902b837ac3 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:31.640152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.644244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:31.666087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.666540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.678779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.681436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.816717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:31.868276 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-93a02397-f762-4c30-8ccc-65bd565a1685 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1929 microversion: 2.75 time: 0.330748 Jul 19 19:53:31.882466 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1398/2887] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1929 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:31.892770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:31.894413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:31.902334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.902801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:31.903622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:31.904079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.262366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:32.279473 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60dff3bd-edf0-44a1-aa1b-8124104280e4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.647171 Jul 19 19:53:32.280086 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1490/2888] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:32.358610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:32.385411 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-534a67c5-11cb-4d78-9be1-be2a851ff645 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 200 len: 1505 microversion: 2.1 time: 0.499374 Jul 19 19:53:32.389008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1399/2889] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:31 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:32.403184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.403687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.410622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.419669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.421295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.421978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.467682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:32.540220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.541474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.548510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.557222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.558347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.559002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.667198 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59ff45da-ab9c-4e82-84c6-8a347777af90 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 204 len: 0 microversion: 2.1 time: 0.266166 Jul 19 19:53:32.689822 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1491/2890] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:32 2022] DELETE /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:32.852367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2137102655", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "11ed988d-6878-4e43-b2e8-a2da5fae9603"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:32.881510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:32.894214 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-afd7f15b-874f-435f-a75f-3096d842980c tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.357805 Jul 19 19:53:32.914679 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1400/2891] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:32 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:32.920898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:32.926130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:32.936553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] validate_networks() for [('11ed988d-6878-4e43-b2e8-a2da5fae9603', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:32.939271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.939823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:32.944860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:32.945325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.100583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:33.123742 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e0fd2a6-4df0-4fae-b8c7-1e7d4d181fa4 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1935 microversion: 2.75 time: 0.207390 Jul 19 19:53:33.124557 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1401/2892] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:32 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1935 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:33.298273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.298931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.306671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.307163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.307960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.308399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.716032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:33.731866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22770f29-0b29-41e7-b07d-fb528f5fa94e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.439010 Jul 19 19:53:33.742433 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1402/2893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:33.831967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:33.832591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:33.832834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:33.833757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:33.834985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:33.844145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=25 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:33.851964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.852415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.853314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.853748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.872869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:33.880069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for user 3cdca318e2f44c2c8148cdd29aaa5747 and project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:33.898289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:33.900940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:33.938105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.939496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:33.951409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.952493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.954320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:33.955006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:33.965245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67fb915b-e517-411e-93ca-67ce53fe1fbc tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117962 Jul 19 19:53:33.967077 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1492/2894] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:53:33.979054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30045bf3-bd64-433b-9e03-62d9e6a4bfc7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:33.979817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30045bf3-bd64-433b-9e03-62d9e6a4bfc7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:34.090259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30045bf3-bd64-433b-9e03-62d9e6a4bfc7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:34.100692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30045bf3-bd64-433b-9e03-62d9e6a4bfc7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1218 microversion: 2.1 time: 0.127822 Jul 19 19:53:34.103353 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1493/2895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:34.147599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:34.147924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:34.159321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.159805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.163441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.163903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.437311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:34.456555 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc181965-1be9-4dc5-aa3f-459d90ed8d92 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1511 microversion: 2.1 time: 0.528777 Jul 19 19:53:34.461108 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1403/2896] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:33 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:34.477051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-88a7f5fd-a101-4500-bb01-52dfb1e1bbda req-147745b7-0e05-4bf2-88b7-69290567ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b560e6d3-359e-4b9f-9df1-2ff3fa7d5871", "name": "network-vif-plugged", "status": "completed", "tag": "c5770355-a060-41d6-bea7-d5afd379f1c5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:34.509038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88a7f5fd-a101-4500-bb01-52dfb1e1bbda req-147745b7-0e05-4bf2-88b7-69290567ab87 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.513188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88a7f5fd-a101-4500-bb01-52dfb1e1bbda req-147745b7-0e05-4bf2-88b7-69290567ab87 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.526146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:34.546856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-88a7f5fd-a101-4500-bb01-52dfb1e1bbda req-147745b7-0e05-4bf2-88b7-69290567ab87 service nova] Creating event network-vif-plugged:c5770355-a060-41d6-bea7-d5afd379f1c5 for instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 on n-h2-843834-3 Jul 19 19:53:34.553296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:34.559740 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-88a7f5fd-a101-4500-bb01-52dfb1e1bbda req-147745b7-0e05-4bf2-88b7-69290567ab87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094673 Jul 19 19:53:34.562687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1404/2897] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:34.616714 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc3967cb-037a-4334-9dfa-aaab6eef7411 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1935 microversion: 2.75 time: 0.468351 Jul 19 19:53:34.620087 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1494/2898] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:34 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1935 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:34.750587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:34.754904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:34.770890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.771393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.772209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:34.772660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:34.783425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:35.005541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b04cd7d-a95e-4281-8ddd-fd02c5f6cc73 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Action: 'create', calling method: .version_select at 0x7f2400a1baf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2121357457", "metadata": {"Type": "work"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b04cd7d-a95e-4281-8ddd-fd02c5f6cc73 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 122 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2121357457", "metadata": {"Type": "work"}}} Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2121357457', 'metadata': {'Type': 'work'}}}} Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:53:35.008527 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 19:53:35.013447 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.028302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b04cd7d-a95e-4281-8ddd-fd02c5f6cc73 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.029809 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8b04cd7d-a95e-4281-8ddd-fd02c5f6cc73 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.457278 Jul 19 19:53:35.031615 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1405/2899] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 19 19:53:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 460 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:53:35.042007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7b0e930-5d25-4849-af89-f42ffaae9d29 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Action: 'create', calling method: .version_select at 0x7f24009abdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-506791894", "metadata": {"Type": "work"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7b0e930-5d25-4849-af89-f42ffaae9d29 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 119 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-506791894", "metadata": {"Type": "work"}}} Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-506791894', 'metadata': {'Type': 'work'}}}} Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '0' Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:53:35.047110 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 19:53:35.053963 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.056524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7b0e930-5d25-4849-af89-f42ffaae9d29 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.057610 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7b0e930-5d25-4849-af89-f42ffaae9d29 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019898 Jul 19 19:53:35.058723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1406/2900] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 19 19:53:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:53:35.073135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3848731-3e4d-4c8d-afce-30a763de98f6 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Action: 'create', calling method: .version_select at 0x7f24009be310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539059796", "metadata": {"Type": "work"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3848731-3e4d-4c8d-afce-30a763de98f6 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 118 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539059796", "metadata": {"Type": "work"}}} Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-539059796', 'metadata': {'Type': 'work'}}}} Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '' Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:53:35.078195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.083054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3848731-3e4d-4c8d-afce-30a763de98f6 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.083949 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3848731-3e4d-4c8d-afce-30a763de98f6 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014385 Jul 19 19:53:35.084917 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1407/2901] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 19 19:53:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:53:35.099038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db2b63d0-17ed-4f29-99f5-cdbc3866facb tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Calling method '.version_select at 0x7f23efb45160>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.151901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-db2b63d0-17ed-4f29-99f5-cdbc3866facb tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] HTTP exception thrown: Volume tempest-invalid-589055534 could not be found. Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db2b63d0-17ed-4f29-99f5-cdbc3866facb tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-589055534 HTTP/1.1 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: exception: Volume tempest-invalid-589055534 could not be found. Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'tempest-invalid-589055534'} Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-589055534 could not be found. (HTTP 404) (Request-ID: req-98d9285e-e5f1-4bdc-a865-6d6b5ef42a82) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.161051 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-589055534 could not be found. Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-589055534 could not be found. Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-589055534 could not be found. Jul 19 19:53:35.165179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.171548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db2b63d0-17ed-4f29-99f5-cdbc3866facb tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 404 to user: Volume tempest-invalid-589055534 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.173043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-db2b63d0-17ed-4f29-99f5-cdbc3866facb tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-589055534" status: 404 len: 98 microversion: 2.1 time: 0.081653 Jul 19 19:53:35.176263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1408/2902] 10.222.0.23 () {58 vars in 1214 bytes} [Tue Jul 19 19:53:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-589055534 => generated 98 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:53:35.185713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.186462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.199499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.200278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.201304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.202278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.202626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.210505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1213c8cb-4d53-4b2f-b4ef-89a7b06529da tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.464993 Jul 19 19:53:35.211164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1495/2903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:34 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:35.218002 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15962a23-4cef-4f90-9083-28e5b9ef5d09 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005652 Jul 19 19:53:35.219157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1496/2904] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 19 19:53:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:53:35.228926 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-541427b0-5811-4fa3-a1a1-e59a9371297a tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004081 Jul 19 19:53:35.230317 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1497/2905] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:53:35.239578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-555ffc25-633e-4326-a70a-5d23e4d4a3c3 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Calling method '.version_select at 0x7f23eec40670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.283727 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-555ffc25-633e-4326-a70a-5d23e4d4a3c3 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] HTTP exception thrown: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-555ffc25-633e-4326-a70a-5d23e4d4a3c3 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-volumes/03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 HTTP/1.1 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '03ff8e3b-43bf-454c-ae6a-a5b1e269ed64'} Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. (HTTP 404) (Request-ID: req-2eee9b96-0f24-4ccb-8fc8-d9614de68793) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:35.286296 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-555ffc25-633e-4326-a70a-5d23e4d4a3c3 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 404 to user: Volume 03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.292134 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-555ffc25-633e-4326-a70a-5d23e4d4a3c3 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/03ff8e3b-43bf-454c-ae6a-a5b1e269ed64" status: 404 len: 109 microversion: 2.1 time: 0.052267 Jul 19 19:53:35.297035 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1498/2906] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:53:35 2022] DELETE /compute/v2.1/os-volumes/03ff8e3b-43bf-454c-ae6a-a5b1e269ed64 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:35.301530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23680223-5801-41e3-ae66-67f571f78297 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Calling method '.version_select at 0x7f23eec9adc0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.301665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.310778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b5a4db73-2998-478f-b496-c7481d7018b4 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1270 microversion: 2.1 time: 0.132813 Jul 19 19:53:35.311410 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1409/2907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:35.338431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-23680223-5801-41e3-ae66-67f571f78297 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] HTTP exception thrown: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23680223-5801-41e3-ae66-67f571f78297 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Request method failure captured: Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-volumes/0234b58c-cf13-4036-9dff-c3bd882a4925 HTTP/1.1 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wu-idB_R-p2z3jYWbxfChqEN09j1zud0Z35HfVe1eboKdlp2czsNzzp6Hu0zXkgh220t4vEl_mMCbsZojN4KCl2MGioGxGPZWGkjgO9Iz11HTHQz9xJnZk-DKEDfQXzWvf9vrIDguEIvkDYE0OBc4bn3ZsYG5nA36ABpqx9MOx3HWo Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22f5808d59664f9fa16c2a1ac5d6eead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 22f5808d59664f9fa16c2a1ac5d6eead Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesNegativeTest-390594520 Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 229cda2a58014095b0ff840d38ea212a Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesNegativeTest-390594520-project Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0234b58c-cf13-4036-9dff-c3bd882a4925'} Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. (HTTP 404) (Request-ID: req-4d7a8525-2648-4970-b6e0-55e6becf3a80) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 19:53:35.341860 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23680223-5801-41e3-ae66-67f571f78297 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] Returning 404 to user: Volume 0234b58c-cf13-4036-9dff-c3bd882a4925 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23680223-5801-41e3-ae66-67f571f78297 tempest-VolumesNegativeTest-390594520 tempest-VolumesNegativeTest-390594520-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0234b58c-cf13-4036-9dff-c3bd882a4925" status: 404 len: 109 microversion: 2.1 time: 0.048476 Jul 19 19:53:35.346724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1499/2908] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/os-volumes/0234b58c-cf13-4036-9dff-c3bd882a4925 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:35.455772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f614a416-b9a4-4b91-9baf-7107d46713fa req-9fd90193-f76a-4df6-8649-e9f9f3f798c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1313497f-b80f-4834-ac4d-6f8f15518665", "name": "network-vif-deleted", "tag": "bb733810-9d34-4661-9216-380670ab27f4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:35.476080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f614a416-b9a4-4b91-9baf-7107d46713fa req-9fd90193-f76a-4df6-8649-e9f9f3f798c5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.478294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.478948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.479650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f614a416-b9a4-4b91-9baf-7107d46713fa req-9fd90193-f76a-4df6-8649-e9f9f3f798c5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.488803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.489482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.491876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.493633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.516349 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f614a416-b9a4-4b91-9baf-7107d46713fa req-9fd90193-f76a-4df6-8649-e9f9f3f798c5 service nova] Creating event network-vif-deleted:bb733810-9d34-4661-9216-380670ab27f4 for instance 1313497f-b80f-4834-ac4d-6f8f15518665 on n-h2-843834-3 Jul 19 19:53:35.533423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f614a416-b9a4-4b91-9baf-7107d46713fa req-9fd90193-f76a-4df6-8649-e9f9f3f798c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080959 Jul 19 19:53:35.537208 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1410/2909] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:35.640218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.641224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.655191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.655657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.656451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.657251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.869832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] Lazy-loading 'services' on Instance uuid fd8182b6-fa65-496f-adee-8301374727dc {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:35.889651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4f02d8d0-6579-446c-9228-e5b0a2a622f7 tempest-ServersAdmin275Test-69552418 tempest-ServersAdmin275Test-69552418-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1920 microversion: 2.75 time: 0.253873 Jul 19 19:53:35.890722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1411/2910] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1920 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:53:35.917435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.918009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.924738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:35.925211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.925681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.926470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.926900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.935791 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d59e1dc-4aa0-4ca3-9a6f-0016bd27edb3 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1488 microversion: 2.1 time: 0.461393 Jul 19 19:53:35.948381 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1500/2911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:35 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1488 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:35.954376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:35.955097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:35.958624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:35.962122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.962850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.963839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:35.964440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:35.990888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:53:36.094023 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5945c1e5-9b51-4710-b8e4-de1908d34650 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 204 len: 0 microversion: 2.75 time: 0.180102 Jul 19 19:53:36.099805 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1412/2912] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:53:35 2022] DELETE /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:53:36.107388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.109169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.112458 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-372c424b-a21d-4478-89e8-6402c51c7d01 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 204 len: 0 microversion: 2.1 time: 0.162102 Jul 19 19:53:36.116461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.117164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1501/2913] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:53:35 2022] DELETE /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:53:36.117594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.118709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.119396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.125931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.126158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.133666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.134375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.135433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.135982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.254525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.264838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.266622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.273416 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-174b83de-bd63-4ad3-968b-7c8326685098 tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1444 microversion: 2.75 time: 0.171973 Jul 19 19:53:36.274771 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1413/2914] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:36 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:36.283396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.284615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.293422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.294048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.295001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.295567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.596127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.608161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af21ab19-7507-40a3-864d-07d40a858ebc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1494 microversion: 2.1 time: 0.489456 Jul 19 19:53:36.609131 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1502/2915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:36 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1494 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:36.614084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:36.614992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:36.623320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.624038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.624977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:36.625569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:36.770688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.779403 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-789ec860-8075-428f-bff7-fe3c1e755e80 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1276 microversion: 2.1 time: 0.168918 Jul 19 19:53:36.780004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1503/2916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:36 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:36.792813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:36.802459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb431494-7878-41f7-92bc-047bc54490f0 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.526304 Jul 19 19:53:36.812247 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1414/2917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:36 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:37.295192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:37.295836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:37.307121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.307601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.308490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.308946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.627265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:37.628233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:37.651211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.654156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.657995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.661285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.673057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:37.692253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:37.693784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d13c06d49b4e2da08aa3f7a368ec66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12aee6e32e9a421f8bc97cda939ff9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:37.709278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce92bfd8-537d-41d5-86ee-b4fcdb95ac9f tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 200 len: 1444 microversion: 2.75 time: 0.419158 Jul 19 19:53:37.709877 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1504/2918] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:37 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 1444 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:53:37.797654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:37.799514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:37.812347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.812817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:37.813629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:37.814081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.409258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:38.423681 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e16d7f8f-ab49-4bd4-bdbe-82c57eb31d1b tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1494 microversion: 2.1 time: 0.801255 Jul 19 19:53:38.425413 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1415/2919] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:37 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1494 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:38.453856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:38.469662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:38.494124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.494637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.498664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.499197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.512194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:38.524173 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fedb54c-41d4-4ada-9428-154deebac0b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.727217 Jul 19 19:53:38.538959 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1505/2920] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:37 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:38.732253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:38.732871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] [instance: fd8182b6-fa65-496f-adee-8301374727dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:38.751136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.752798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.756204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:38.756892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:38.808046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] HTTP exception thrown: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Request method failure captured: Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc HTTP/1.1 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wtwuZA9TLX2lToGZ4RrJXEeY2AdJqiUqjxgP67KM8CeL3QlQPcBMTPLGw_XlzB0XWIRP8j42AvOsQXvVuADyqh-axXLvz3GlIAk2A9_iwksRKn6V71Fot2BmvJ5pA5nbDPAJRMx3DMMYJNI3Vd42nLxjnYweVC-fzmKc2n6CfMUFf8 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.75 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 12aee6e32e9a421f8bc97cda939ff9cc Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdmin275Test-516334641 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12aee6e32e9a421f8bc97cda939ff9cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12aee6e32e9a421f8bc97cda939ff9cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12aee6e32e9a421f8bc97cda939ff9cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12aee6e32e9a421f8bc97cda939ff9cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdmin275Test-516334641 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 12aee6e32e9a421f8bc97cda939ff9cc Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdmin275Test-516334641 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdmin275Test-516334641-project Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 53d13c06d49b4e2da08aa3f7a368ec66 Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdmin275Test-516334641-project Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fd8182b6-fa65-496f-adee-8301374727dc'} Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:38.809878 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] Returning 404 to user: Instance fd8182b6-fa65-496f-adee-8301374727dc could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db0ae1aa-f428-4915-ba9d-ef1ee9d395ce tempest-ServersAdmin275Test-516334641 tempest-ServersAdmin275Test-516334641-project] 10.222.0.23 "GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc" status: 404 len: 111 microversion: 2.75 time: 0.087212 Jul 19 19:53:38.821959 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1506/2921] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:53:38 2022] GET /compute/v2.1/servers/fd8182b6-fa65-496f-adee-8301374727dc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:53:39.288766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:39.304574 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5bb9e173-29b5-4337-80a2-17eb09de48fe tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1314 microversion: 2.1 time: 0.865994 Jul 19 19:53:39.305534 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1416/2922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:38 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:39.443765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:39.444722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:39.463739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.466192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.475941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.476847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.556506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:39.557274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:39.593969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.594625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:39.595586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:39.596034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.225705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.250475 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60fad6b3-8cb5-4116-9fd4-1caf53ee9905 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1494 microversion: 2.1 time: 0.812488 Jul 19 19:53:40.254045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1507/2923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:39 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1494 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.305637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.314792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f578ebcf-11ce-4617-ad41-b8e5f95b081b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.772463 Jul 19 19:53:40.318712 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1417/2924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:39 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.324775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:40.325807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:40.336202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.339177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.342077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.343799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.465499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b95098f1-b713-446e-bf41-35a4ed8b486a req-7376b85c-083d-4b7e-8b2c-ae5ce11c7c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a731b7-9aa9-427d-bbef-be48d0320774", "name": "network-vif-deleted", "tag": "c6be8861-6bf1-40cb-a028-70cb1f756199"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:40.487956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b95098f1-b713-446e-bf41-35a4ed8b486a req-7376b85c-083d-4b7e-8b2c-ae5ce11c7c70 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.499667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b95098f1-b713-446e-bf41-35a4ed8b486a req-7376b85c-083d-4b7e-8b2c-ae5ce11c7c70 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.528485 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b95098f1-b713-446e-bf41-35a4ed8b486a req-7376b85c-083d-4b7e-8b2c-ae5ce11c7c70 service nova] Creating event network-vif-deleted:c6be8861-6bf1-40cb-a028-70cb1f756199 for instance 52a731b7-9aa9-427d-bbef-be48d0320774 on n-h2-843834-3 Jul 19 19:53:40.542685 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b95098f1-b713-446e-bf41-35a4ed8b486a req-7376b85c-083d-4b7e-8b2c-ae5ce11c7c70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080929 Jul 19 19:53:40.546592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1418/2925] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:40.816554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:40.834029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dee7b3e-1c88-43b5-a861-d9db6ee32a60 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1500 microversion: 2.1 time: 0.510570 Jul 19 19:53:40.834743 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1508/2926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:40 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1500 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:40.864659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:40.865943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:40.875155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.875884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.877304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:40.877928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:40.933521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lazy-loading 'flavor' on Instance uuid b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:41.106722 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e4c0e3f-3b74-440f-aaba-22d342927f0c tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "POST /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871/action" status: 200 len: 32 microversion: 2.1 time: 0.255615 Jul 19 19:53:41.108340 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1419/2927] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:40 2022] POST /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:53:41.118381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.119826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.147159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.148250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.149327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.150010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.273553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.274546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.285327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.287543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.291108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.292003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.375981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.376642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.376894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lazy-loading 'fault' on Instance uuid 52a731b7-9aa9-427d-bbef-be48d0320774 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:53:41.596038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.605286 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1a149468-2cdd-4ffe-88c0-86ddb363afa7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 200 len: 1304 microversion: 2.1 time: 0.336263 Jul 19 19:53:41.606339 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1420/2928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 1304 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:41.612701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:41.614307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:41.623074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.624108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.625689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:41.626595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:41.892596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:41.901620 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b697482d-3be5-4866-baf6-c4edc7b17fb8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.788692 Jul 19 19:53:41.905573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1509/2929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:42.401953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:42.416193 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-86745fc5-47ab-4704-8d62-5d2c220cd178 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.806350 Jul 19 19:53:42.417137 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1421/2930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:41 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:42.622072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6e9d80a7-1b8b-42bb-8802-dcd9a8c7b377 req-007f18f9-7eb3-4dde-a6c9-8ebe613fe48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49777d5c-c7b5-4494-a546-1be5488509e1", "tag": "d857fc79-a9c3-4ac3-917c-743d749e2c82"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:42.629092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.630047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:42.637636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.638605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.639768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.640950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.645903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6e9d80a7-1b8b-42bb-8802-dcd9a8c7b377 req-007f18f9-7eb3-4dde-a6c9-8ebe613fe48f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.645903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6e9d80a7-1b8b-42bb-8802-dcd9a8c7b377 req-007f18f9-7eb3-4dde-a6c9-8ebe613fe48f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.665639 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 HTTP/1.1 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '52a731b7-9aa9-427d-bbef-be48d0320774'} Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:42.668967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:53:42.674822 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:53:42.675691 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6e9d80a7-1b8b-42bb-8802-dcd9a8c7b377 req-007f18f9-7eb3-4dde-a6c9-8ebe613fe48f service nova] Creating event network-changed:d857fc79-a9c3-4ac3-917c-743d749e2c82 for instance 49777d5c-c7b5-4494-a546-1be5488509e1 on n-h1-843834-3 Jul 19 19:53:42.677465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:42.678620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b0f795e-1f63-4d32-bac9-3ea9c8066631 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 404 len: 111 microversion: 2.1 time: 0.056897 Jul 19 19:53:42.679818 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1422/2931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:42 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:53:42.705872 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6e9d80a7-1b8b-42bb-8802-dcd9a8c7b377 req-007f18f9-7eb3-4dde-a6c9-8ebe613fe48f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089361 Jul 19 19:53:42.706504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1510/2932] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:42.871471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1553642675", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "38e081eb-dc2f-4eb2-904a-c5703f6ae37b"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:42.924533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:42.925968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:42.940104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.940598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.943309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:42.944021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:42.985976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] validate_networks() for [('38e081eb-dc2f-4eb2-904a-c5703f6ae37b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:53:43.775480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:43.787519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e7da71d-5af7-400b-ad14-c25ced3fb4ec tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.868896 Jul 19 19:53:43.789518 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1511/2933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:42 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:43.863359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:44.072682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d44154b-15cc-4747-80c8-57c728becf82 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.087861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d44154b-15cc-4747-80c8-57c728becf82 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.296982 Jul 19 19:53:44.088469 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1512/2934] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:44.094550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.095689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:44.103456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:44.105364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.105845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.106812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.107458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.676170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:44.688507 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23b5dd7b-d187-4d52-9034-356672d9a110 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.598106 Jul 19 19:53:44.690375 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1513/2935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:44.697066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f53fbdf5-3bbd-4686-8be1-7d48cf6f0699 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.730815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f53fbdf5-3bbd-4686-8be1-7d48cf6f0699 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.038825 Jul 19 19:53:44.732466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1514/2936] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:44.749634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d33db8c8-64f6-492d-bcba-78833f529460 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.759317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:44.759841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:44.760274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:44.760690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:44.761104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:44.777739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.778191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.782372 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d33db8c8-64f6-492d-bcba-78833f529460 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040187 Jul 19 19:53:44.783612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.784021 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1515/2937] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:44.784387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.794938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7a72048c-69fc-41e0-803b-602057b221ea tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.800180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:44.805441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:44.818083 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7a72048c-69fc-41e0-803b-602057b221ea tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026848 Jul 19 19:53:44.821298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1516/2938] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:44.842837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:44.846197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:44.847293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:44.859915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.860650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.861594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:44.862836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Getting quotas for user dbab642dd2da409ab3b757945a64d24b and project 1a3c7a8833334ab0b223e1592db6b347. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:44.863496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:44.891298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:53:44.893589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:53:44.965333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1843301d-8199-42a0-a36e-ec16a62801e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.098072 Jul 19 19:53:44.966292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1423/2939] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:53:44.971240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8af969b-56b4-4357-bb32-bafbf2c87739 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.003282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8af969b-56b4-4357-bb32-bafbf2c87739 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035533 Jul 19 19:53:45.013284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1424/2940] 10.222.0.23 () {58 vars in 1164 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.013284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f0510064-093c-4231-8ff3-f078dafc1186 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.013284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f0510064-093c-4231-8ff3-f078dafc1186 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:45.190077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f0510064-093c-4231-8ff3-f078dafc1186 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.200376 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f0510064-093c-4231-8ff3-f078dafc1186 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1215 microversion: 2.1 time: 0.193790 Jul 19 19:53:45.202966 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1425/2941] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.227542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a95fa3f2-d18e-4dd0-ba7d-b033a7eb8a1b tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.256013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a95fa3f2-d18e-4dd0-ba7d-b033a7eb8a1b tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051032 Jul 19 19:53:45.257163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1426/2942] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.279431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-37767a8b-0d34-46e5-9d97-ae130fb0425c tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.298238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:45.314109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e83aef05-2821-47d7-a52f-871b2517c949 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.490591 Jul 19 19:53:45.316148 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1517/2943] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:44 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.359753 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-37767a8b-0d34-46e5-9d97-ae130fb0425c tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.092262 Jul 19 19:53:45.366821 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1427/2944] 10.222.0.23 () {58 vars in 1168 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.381347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bfe11f9-b7d6-4f66-ab73-0bfb00442e49 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.395670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bfe11f9-b7d6-4f66-ab73-0bfb00442e49 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019244 Jul 19 19:53:45.396870 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1518/2945] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.409125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f0694743-f0b1-4265-8fac-78b64aff7e6f tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.420801 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f0694743-f0b1-4265-8fac-78b64aff7e6f tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015447 Jul 19 19:53:45.433657 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1428/2946] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.444814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc706a28-386a-4c42-b93d-842a47bd9a36 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.573325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc706a28-386a-4c42-b93d-842a47bd9a36 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.132473 Jul 19 19:53:45.580268 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1519/2947] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.589490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-51c7ce58-6762-44ae-81bf-f196e7711f6b tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.603135 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-51c7ce58-6762-44ae-81bf-f196e7711f6b tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017726 Jul 19 19:53:45.604448 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1429/2948] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.622549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8fbd9039-0830-4b67-8fb5-2c5977139803 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.674357 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8fbd9039-0830-4b67-8fb5-2c5977139803 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.061441 Jul 19 19:53:45.687551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1c67e46-c38b-4b17-add8-48fcdbe00cec tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.692230 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1520/2949] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.701426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1c67e46-c38b-4b17-add8-48fcdbe00cec tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016300 Jul 19 19:53:45.708371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.709109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:45.718464 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1430/2950] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.727316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fb4b170-715a-41ad-b2e2-1c12045e4717 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.731731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.732197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:45.735347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:45.735852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:45.763167 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fb4b170-715a-41ad-b2e2-1c12045e4717 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.043314 Jul 19 19:53:45.763776 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1431/2951] 10.222.0.23 () {58 vars in 1147 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.796462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7edf55a7-d47a-4351-8964-c22d87d0527a tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.827902 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7edf55a7-d47a-4351-8964-c22d87d0527a tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.037315 Jul 19 19:53:45.832376 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1432/2952] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:45.845022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c5a3721-3aee-431e-a86b-b2adf758fc92 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.863270 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c5a3721-3aee-431e-a86b-b2adf758fc92 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025470 Jul 19 19:53:45.865237 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1433/2953] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:45.890440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c54810a9-f253-4d40-a5f0-b171096c73ac tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:45.909172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:45.956975 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c54810a9-f253-4d40-a5f0-b171096c73ac tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.072656 Jul 19 19:53:45.958277 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1434/2954] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:45.973390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f972d4ad-1d6d-4e27-a795-41827da578ea tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:46.003510 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f972d4ad-1d6d-4e27-a795-41827da578ea tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035960 Jul 19 19:53:46.005450 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1435/2955] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:46.025237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c441d331-d291-4b56-97fa-fc12a9b32127 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:46.039850 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c441d331-d291-4b56-97fa-fc12a9b32127 tempest-FlavorsV2TestJSON-2144782171 tempest-FlavorsV2TestJSON-2144782171-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023662 Jul 19 19:53:46.040528 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1436/2956] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:46.175040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:46.198653 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee25e534-bca6-4d3b-8d85-4be18d755a36 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.492006 Jul 19 19:53:46.211593 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1521/2957] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:45 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:46.222957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:46.224627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:46.235311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.236209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.239802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.242551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.334224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:46.334933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:46.345956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.347831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.348767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:46.349795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:46.353105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:46.368211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c14f601-a34d-4554-9ffe-8722d450b029 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1267 microversion: 2.1 time: 0.150538 Jul 19 19:53:46.369250 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1437/2958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:46 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:46.416492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:46.776792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:46.797406 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53654d9d-b6c7-4c39-8891-426bf7caf98d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.467514 Jul 19 19:53:46.798092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1522/2959] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:46 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.216695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.217510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:47.225138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.235610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.236785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.237359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.470180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] Calling method '.version_select at 0x7f23eed7f280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.550138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 72d489cd-8620-4fcf-93a9-42dddb4de84b could not be found", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:53:47.551607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] HTTP exception thrown: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] Request method failure captured: Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-floating-ips/72d489cd-8620-4fcf-93a9-42dddb4de84b HTTP/1.1 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wvLb_8VXr_Posh8XG0Bz8ycQP48NkRlYXAJg7EGipfTbIDQ8sQWVktRD_3TyUuxOJD2WX-cXFBI6M-XTblcU4wjm2f0SRPy_bkUGU1jeWrRosSkwvitJ65bLoT41hgaO-rV-LdMKIe2bhHG8GLQ0_sj8Jyq-AT7igIBxitAIxJ6Yxg Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: fe994a94244f42ac8c2bc2039b132eee Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1202758323 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe994a94244f42ac8c2bc2039b132eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe994a94244f42ac8c2bc2039b132eee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe994a94244f42ac8c2bc2039b132eee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe994a94244f42ac8c2bc2039b132eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1202758323 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: fe994a94244f42ac8c2bc2039b132eee Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1202758323 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8788e3886aed428693d770d6ff85eb5c Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: exception: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '72d489cd-8620-4fcf-93a9-42dddb4de84b'} Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 72d489cd-8620-4fcf-93a9-42dddb4de84b could not be found Jul 19 19:53:47.558043 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c98c3da-4903-4c8f-b6c1-8f40797cb797'] Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b. Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b Jul 19 19:53:47.562743 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:53:47.572264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] Returning 404 to user: Floating IP not found for ID 72d489cd-8620-4fcf-93a9-42dddb4de84b {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:53:47.573808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32d262b6-c670-425f-a759-95d62ffae43a tempest-FloatingIPDetailsNegativeTestJSON-1202758323 tempest-FloatingIPDetailsNegativeTestJSON-1202758323-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/72d489cd-8620-4fcf-93a9-42dddb4de84b" status: 404 len: 111 microversion: 2.1 time: 0.308581 Jul 19 19:53:47.585085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:47.585430 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1523/2960] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/os-floating-ips/72d489cd-8620-4fcf-93a9-42dddb4de84b => generated 111 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:53:47.591748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.592852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:47.602423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.604509 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d2a8810-56b6-4c68-8d36-bfd5f0cfe9b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.391845 Jul 19 19:53:47.615764 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1438/2961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.618020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.620529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.622225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.779302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:47.789618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b9c8b62-237c-4e33-ad2b-dbd037ae7f08 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1273 microversion: 2.1 time: 0.203023 Jul 19 19:53:47.796612 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1524/2962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:47.819809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:47.820767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:47.831413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.832445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:47.833833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:47.834551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.265996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:48.276152 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c013b303-63c9-4953-8c9b-11af278f59f8 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.460540 Jul 19 19:53:48.282292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1439/2963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:47 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:48.629107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:48.631728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:48.666319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.668832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.669852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.670618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.814272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:48.814944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:48.832559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.833070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:48.833915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:48.834390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:49.752272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:49.771857 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45ee3ff7-889e-4851-95d2-22ba11c266e6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 1.154007 Jul 19 19:53:49.773468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1525/2964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:48 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:49.978071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:50.015608 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4440a1c-a627-48f9-bb3c-f3ec652f6394 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 1.200520 Jul 19 19:53:50.027134 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1440/2965] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:48 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:50.039476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.041902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:50.060860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.062826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.066396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.068902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16151956-3804-47aa-9cf2-e3e7d076f0f9 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eed720d0>, body: {"keypair": {"name": "tempest-keypair-1586192410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQVpcXLRRowJRGbakL2KK8AyTp7/9a2xnofxMLQLKDG1O8ewn0rVq86YAwHOCXMS3Funuij1BBgVdQgpFINXaf/Yjkko6xIKtT4637XkmCBPuGpGTHvOewy2ZgjGhnRoQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.069734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.110122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-16151956-3804-47aa-9cf2-e3e7d076f0f9 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.130066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-16151956-3804-47aa-9cf2-e3e7d076f0f9 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.199368 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16151956-3804-47aa-9cf2-e3e7d076f0f9 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.424576 Jul 19 19:53:50.206983 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1526/2966] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.214755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6474f687-9f46-444a-9df4-4247db4cfe5b req-efde6be1-c199-4de0-bfb8-840623d5210b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49777d5c-c7b5-4494-a546-1be5488509e1", "name": "network-vif-plugged", "status": "completed", "tag": "d857fc79-a9c3-4ac3-917c-743d749e2c82"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.227397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6474f687-9f46-444a-9df4-4247db4cfe5b req-efde6be1-c199-4de0-bfb8-840623d5210b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.228147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6474f687-9f46-444a-9df4-4247db4cfe5b req-efde6be1-c199-4de0-bfb8-840623d5210b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.244612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6474f687-9f46-444a-9df4-4247db4cfe5b req-efde6be1-c199-4de0-bfb8-840623d5210b service nova] Creating event network-vif-plugged:d857fc79-a9c3-4ac3-917c-743d749e2c82 for instance 49777d5c-c7b5-4494-a546-1be5488509e1 on n-h1-843834-3 Jul 19 19:53:50.251004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6474f687-9f46-444a-9df4-4247db4cfe5b req-efde6be1-c199-4de0-bfb8-840623d5210b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041832 Jul 19 19:53:50.252465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1527/2967] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.259473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50c055e9-cf96-4ad2-b1fd-582a33003f61 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eed9c5e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.268615 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50c055e9-cf96-4ad2-b1fd-582a33003f61 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1586192410" status: 200 len: 498 microversion: 2.1 time: 0.014751 Jul 19 19:53:50.275191 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1528/2968] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:53:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1586192410 => generated 498 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.283063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3448a6d3-bb82-45aa-9e77-aec3e1c2b5df tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eed7f040>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.332003 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3448a6d3-bb82-45aa-9e77-aec3e1c2b5df tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586192410" status: 202 len: 0 microversion: 2.1 time: 0.040904 Jul 19 19:53:50.344428 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1529/2969] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586192410 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:50.352200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce30c0c3-ee93-49ea-b3e5-0e55825db450 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eef57d30>, body: {"keypair": {"name": "tempest-keypair-1440469429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwnDcD6Tv0LNFd6k2/i0g/t3G5uJ9hjb3igRqWhaqdVN9zPm9iIEtSxGAHnYPgqUCze0vjcM/ixsvE+ibR8vDH0uCGzOUt4nsJtOoS6SudRPR/Sn5j9o5SfSbNr2UQzQQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.375621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ce30c0c3-ee93-49ea-b3e5-0e55825db450 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.383096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ce30c0c3-ee93-49ea-b3e5-0e55825db450 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.415890 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce30c0c3-ee93-49ea-b3e5-0e55825db450 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068419 Jul 19 19:53:50.417371 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1530/2970] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.428206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e32a4a7-d616-444c-b1c3-de19dc62368d tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eed7f4c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.470751 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e32a4a7-d616-444c-b1c3-de19dc62368d tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440469429" status: 202 len: 0 microversion: 2.1 time: 0.044367 Jul 19 19:53:50.476559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1531/2971] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440469429 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:50.487490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8524795b-3a09-4a2c-bc48-6f717ca0528c tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eef57af0>, body: {"keypair": {"name": "tempest-keypair-1261386514", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.521165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8524795b-3a09-4a2c-bc48-6f717ca0528c tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.533819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8524795b-3a09-4a2c-bc48-6f717ca0528c tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.575671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8524795b-3a09-4a2c-bc48-6f717ca0528c tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.091907 Jul 19 19:53:50.583422 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1532/2972] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.591660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9c0b9cc8-539a-4df3-abce-5a0153de0174 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eef63670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.620564 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9c0b9cc8-539a-4df3-abce-5a0153de0174 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261386514" status: 202 len: 0 microversion: 2.1 time: 0.035615 Jul 19 19:53:50.629764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1533/2973] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261386514 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:50.643631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c214fdea-2956-4850-9e45-3b72b3160696 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eef635e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1711183920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/zJ+ay1+SMo/Ia4e6No9/AwQ9Io4DhTHqUnGgt0DZXd7LMimRCkIc9G2U77z2EDXRaSmPuM10FujdyodgobwfIqYOebOUi3KWydN2XYInNF8uyUAuSCbFrLK6sOD+n9g=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.663529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-c214fdea-2956-4850-9e45-3b72b3160696 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.669216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-c214fdea-2956-4850-9e45-3b72b3160696 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.723758 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c214fdea-2956-4850-9e45-3b72b3160696 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.092477 Jul 19 19:53:50.732003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1534/2974] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.739013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6602af28-3e30-4eec-939a-15b2ad379e47 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eef57a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-803335397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlQ/eOwBOB2VfW8Zzsy/r4LXGLOIyPl7bVUfBxewWJ3/KXyyhQWfjXN1HuePW+oVSoCDtaX9Xgrcyn5HXsAaYGmXjswrqN1sIvpKd4WPCQQjNzd+8l7tkcLKqb2EfBJMA=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.755569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:50.768256 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-264f4ac3-5bdd-4ba4-9d69-55d94d5fb35b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.738260 Jul 19 19:53:50.770999 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1441/2975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:50 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:50.782560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6602af28-3e30-4eec-939a-15b2ad379e47 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.789994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6602af28-3e30-4eec-939a-15b2ad379e47 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.793580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.794583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:50.802344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.803370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.807452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:50.808792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:50.832230 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6602af28-3e30-4eec-939a-15b2ad379e47 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.097245 Jul 19 19:53:50.833279 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1535/2976] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:53:50.848508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3135d67e-4337-470f-a1d7-350832fb7b95 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Action: 'create', calling method: .version_select at 0x7f23eef574c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1846027854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhjFLgh1aYtXsA+sIjhiLZGLOaX4QUsxd+TLkUmGdMXHhL5TDsKcTSuJV9YN/0U/+sU34m1VBcZmCrMRkzM3KU6czSz4Av61HygA9z70LMi/H1N7Z0TVtBhVcd4gKWafg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:50.871974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3135d67e-4337-470f-a1d7-350832fb7b95 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:53:50.879829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3135d67e-4337-470f-a1d7-350832fb7b95 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Getting quotas for user 0b667f1a74614bf99829adce8d9ef898 and project 9a202fa5d37d484cb1efeb63c5e832a2. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:53:50.887729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:50.925423 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3135d67e-4337-470f-a1d7-350832fb7b95 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.082040 Jul 19 19:53:50.932028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1536/2977] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:53:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:50.940108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cfeb9868-6ff5-464b-9c7c-11c7142bc241 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eef63a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.944160 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-cfeb9868-6ff5-464b-9c7c-11c7142bc241 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 19:53:50.951760 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cfeb9868-6ff5-464b-9c7c-11c7142bc241 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.018259 Jul 19 19:53:50.958462 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1537/2978] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:53:50 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:50.964969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4dc72444-9230-4c92-b0c3-328a5d017a5b tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eed733a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:50.995306 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4dc72444-9230-4c92-b0c3-328a5d017a5b tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846027854" status: 202 len: 0 microversion: 2.1 time: 0.035258 Jul 19 19:53:51.000219 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1538/2979] 10.222.0.23 () {58 vars in 1277 bytes} [Tue Jul 19 19:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846027854 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:51.006593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-efa9f496-2ce1-47ca-8d56-d2f8347488f0 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23eed7f280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.038088 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-efa9f496-2ce1-47ca-8d56-d2f8347488f0 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-803335397" status: 202 len: 0 microversion: 2.1 time: 0.036256 Jul 19 19:53:51.042954 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1539/2980] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-803335397 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:51.052750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.053991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.062406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.063124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.064252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.064859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.239141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.252936 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98f2bf8d-5b30-41b9-a6dc-cf8a13795f0f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1318 microversion: 2.1 time: 0.465541 Jul 19 19:53:51.268284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1442/2981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:50 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:51.278403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b980b843-feaa-4ef2-8c5c-c82cb49482d3 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] Calling method '.version_select at 0x7f23ef5e8b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.315518 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b980b843-feaa-4ef2-8c5c-c82cb49482d3 tempest-KeyPairsV2TestJSON-2086602020 tempest-KeyPairsV2TestJSON-2086602020-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1711183920" status: 202 len: 0 microversion: 2.1 time: 0.044960 Jul 19 19:53:51.317165 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1443/2982] 10.222.0.23 () {58 vars in 1277 bytes} [Tue Jul 19 19:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1711183920 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:53:51.330776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-23b018a2-e310-4772-ae92-b46f7b945f82 req-be6ad000-752c-4b9e-84dd-83cea52c8fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aec422f-98eb-4da3-80bf-b443279522cf", "tag": "a0b819e8-d936-4a41-bfaf-9690209ab758"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:51.345406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-23b018a2-e310-4772-ae92-b46f7b945f82 req-be6ad000-752c-4b9e-84dd-83cea52c8fce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.346558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-23b018a2-e310-4772-ae92-b46f7b945f82 req-be6ad000-752c-4b9e-84dd-83cea52c8fce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.361174 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-23b018a2-e310-4772-ae92-b46f7b945f82 req-be6ad000-752c-4b9e-84dd-83cea52c8fce service nova] Creating event network-changed:a0b819e8-d936-4a41-bfaf-9690209ab758 for instance 7aec422f-98eb-4da3-80bf-b443279522cf on n-h2-843834-3 Jul 19 19:53:51.367752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-23b018a2-e310-4772-ae92-b46f7b945f82 req-be6ad000-752c-4b9e-84dd-83cea52c8fce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049056 Jul 19 19:53:51.368666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1444/2983] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:51.537794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:51.547114 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bfd71e31-e613-4a73-9f35-bcbf5bdeacdc tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 0.498822 Jul 19 19:53:51.553396 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1540/2984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:51.789202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:51.790183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:51.799437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.804593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:51.809948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:51.810396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.090728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:52.127602 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0289765b-b104-4dbc-b41f-4e564954714b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.326802 Jul 19 19:53:52.129179 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1445/2985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:51 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:52.270141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.270691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.278193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.278654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.279569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.280194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.581068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.584492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:52.584875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.601835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.603032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.614073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.614631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68351d29-6728-43fe-bd0b-958ad5be8972 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1508 microversion: 2.1 time: 0.348404 Jul 19 19:53:52.615916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.634803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1541/2986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:52.669828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:52.672271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:52.685232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.686060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:52.687865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:52.688576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.154480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.171780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e02e132-ffc8-4952-b1e7-18366b3cf0b1 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1508 microversion: 2.1 time: 0.530193 Jul 19 19:53:53.172401 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1542/2987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.178733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.179402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.191631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.194381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.195130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.200774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.201495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.205165 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85a05739-a73b-4a73-8416-7a8d62075486 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 0.638415 Jul 19 19:53:53.218415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1446/2988] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:52 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:53.228242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:53.242653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.263262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.270408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.272775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.273554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.363846 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ae2ab8b-c1f9-4cf5-8d0f-257176ff45e5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "PUT /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1080 microversion: 2.1 time: 0.143034 Jul 19 19:53:53.374065 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1447/2989] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 19:53:53 2022] PUT /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1080 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.380582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.381689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.392269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.393086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.394204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.395004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.780026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.800100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-79dbe2b8-9370-4161-ab59-c8bcd53c3f86 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.617235 Jul 19 19:53:53.800100 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1543/2990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:53 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.875250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:53.889128 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-093581f9-0f63-4aec-ba4f-2bbbf763a5f9 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1506 microversion: 2.1 time: 0.513406 Jul 19 19:53:53.900448 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1448/2991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:53 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:53.908594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:53.909511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:53.919867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.920314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:53.922388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:53.922825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.203332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:54.215049 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0094394-cd3e-4f8c-9e5e-d8113c4c32b5 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1506 microversion: 2.1 time: 0.310570 Jul 19 19:53:54.216709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1544/2992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:53 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:54.239244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:54.240775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:54.242381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:54.243215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:54.258374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.263115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.263889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.264828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.265278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.266173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.267638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.269865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.423060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:53:54.423562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:53:54.424156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:53:54.424796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:53:54.425337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:53:54.548789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:54.582226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.585549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.586657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.587364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.706104 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-63810d39-d159-43cd-b5b8-d7588e78ab1c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "POST /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1/action" status: 202 len: 1112 microversion: 2.1 time: 0.477100 Jul 19 19:53:54.709749 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1449/2993] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:54 2022] POST /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1/action => generated 1112 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 19:53:54.735003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:54.737919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:54.749328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.749923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.751682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:54.752219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:54.802961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:54.985438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.000758 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0541083f-04fe-49ea-8ade-4f3633cf5fe9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 0.765210 Jul 19 19:53:55.002208 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1545/2994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:54 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:55.018548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:55.019989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:55.026703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:55.027246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:55.028059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:55.028488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:55.178186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.190961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f0e1760b-1ec4-4b95-9d05-50fc68820ad3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.468774 Jul 19 19:53:55.191825 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1450/2995] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:54 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:55.325353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:55.338816 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8df7ea15-4860-4809-a723-3c6f2891e0c4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.335210 Jul 19 19:53:55.342860 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1546/2996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:55 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:56.023713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:56.024604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:56.033762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:56.058601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.059111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.059916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.063752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.215120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:56.217411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:56.231897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.232843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:56.233909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:56.234615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.045568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.061093 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34eb8816-0a6f-49f7-bda6-886d10388cc1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 1.046321 Jul 19 19:53:57.062018 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1451/2997] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:56 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:57.066761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:57.074462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.079973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:57.093696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fbb35e1c-08b6-4623-9b84-a742ecea94be tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.885825 Jul 19 19:53:57.101362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.101827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.102689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.106592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.106756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1547/2998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:56 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:57.146960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9988bccb-b6c5-4213-a331-ea8f041c9e55 req-3735bf90-4ce8-45e8-8116-c0e05e645c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aec422f-98eb-4da3-80bf-b443279522cf", "name": "network-vif-plugged", "status": "completed", "tag": "a0b819e8-d936-4a41-bfaf-9690209ab758"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:57.173098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9988bccb-b6c5-4213-a331-ea8f041c9e55 req-3735bf90-4ce8-45e8-8116-c0e05e645c54 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:57.174665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9988bccb-b6c5-4213-a331-ea8f041c9e55 req-3735bf90-4ce8-45e8-8116-c0e05e645c54 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:57.189451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:53:57.206296 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9988bccb-b6c5-4213-a331-ea8f041c9e55 req-3735bf90-4ce8-45e8-8116-c0e05e645c54 service nova] Creating event network-vif-plugged:a0b819e8-d936-4a41-bfaf-9690209ab758 for instance 7aec422f-98eb-4da3-80bf-b443279522cf on n-h2-843834-3 Jul 19 19:53:57.218171 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9988bccb-b6c5-4213-a331-ea8f041c9e55 req-3735bf90-4ce8-45e8-8116-c0e05e645c54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110319 Jul 19 19:53:57.221099 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1548/2999] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:53:57.461694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:57.471196 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-621bbb43-5bd9-4801-b432-99e3b8aba2ed tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.408011 Jul 19 19:53:57.472095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1452/3000] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:57 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:58.081350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:58.082239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:58.091954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.093253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.093253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.095496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.114436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:58.115135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:58.136281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.136751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.137561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.138006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.573740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:58.584324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a48d6f8-94af-4522-94ae-7fdd85c5ad73 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1315 microversion: 2.1 time: 0.509593 Jul 19 19:53:58.585464 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1549/3001] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:58 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:58.591213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:58.592035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:58.614544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.615577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.617956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:58.619206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:58.756497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:58.766242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fead3f6a-995d-4a91-a917-9b503fe6cdaa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.657568 Jul 19 19:53:58.777308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1453/3002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:58 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:53:58.928548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:58.942435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d193ac8-80c2-4d87-a17f-16ff1769c4fc tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.355531 Jul 19 19:53:58.947812 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1550/3003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:58 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:59.602987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:59.604574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:59.621092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.621593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.622367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.622818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.788862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:53:59.790156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:59.802897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.803796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.804879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.805490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.837265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:53:59.846365 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-64dfdade-238e-4261-b0b8-8ec92a1aa16f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1502 microversion: 2.1 time: 0.248625 Jul 19 19:53:59.851300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1454/3004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:59 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:53:59.877188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:53:59.878211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:53:59.888703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.893889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.898166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:53:59.899690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:53:59.940070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lazy-loading 'flavor' on Instance uuid 7aec422f-98eb-4da3-80bf-b443279522cf {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:54:00.062827 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11f37704-aec1-46dc-99ba-207ceedcfc34 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "POST /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf/action" status: 202 len: 0 microversion: 2.1 time: 0.194005 Jul 19 19:54:00.073991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1455/3005] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:53:59 2022] POST /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:54:00.098928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:00.099923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:00.116692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:00.117610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:00.119321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:00.121576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:00.192226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:00.232658 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96e025aa-1054-4236-9a8c-b1e02a2056f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.431792 Jul 19 19:54:00.243643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1551/3006] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:53:59 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:00.271500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:00.272117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:00.285849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:00.286440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:00.290367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:00.292930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:00.895589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=24 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:00.967316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:00.976469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf2c6605-36f5-41b3-8f78-a5085b8251a1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.900555 Jul 19 19:54:00.980341 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1456/3007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:00 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:01.256075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:01.257455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:01.268678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.269244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:01.270422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:01.270869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:01.704908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:01.719798 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1300a9a-2d15-4328-8183-75dd65c74fd9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1510 microversion: 2.1 time: 1.472682 Jul 19 19:54:01.720896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1552/3008] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:00 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1510 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:01.913915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:01.923043 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8944b5cf-6b76-4370-a57c-ac715482bba6 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.671197 Jul 19 19:54:01.928584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1457/3009] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:01 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:01.996886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:01.997531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:02.005711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.006172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.006983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.007427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.327272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:02.344700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-488ebf55-651f-46d8-ad7d-8e09cd2bea23 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.351612 Jul 19 19:54:02.345504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1553/3010] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:01 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:02.739133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:02.740148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:02.749312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.750320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.751580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.753655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.949854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:02.951154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:02.958541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.959437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:02.960405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:02.961182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.029976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:03.436531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:03.451236 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f32d8e9-c4b9-48ad-8e29-7244b5aac86f tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1493 microversion: 2.1 time: 0.716081 Jul 19 19:54:03.469420 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1458/3011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:02 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1493 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:03.481430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:03.482690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:03.490733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.491561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.492652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.493204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.631715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:03.642546 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36bc7d24-8f79-459e-87da-ea752e5a2e6d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.697031 Jul 19 19:54:03.650573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1554/3012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:02 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:03.660443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:03.662307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:03.675953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.676768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.677772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.678407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.720074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:03.890822 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-145722b6-cc2a-4ee1-82c5-98bda5929690 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 204 len: 0 microversion: 2.1 time: 0.238156 Jul 19 19:54:03.891830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1555/3013] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:03 2022] DELETE /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:03.900469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:03.904340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:03.905277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:03.908491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e49ea02e-6b33-4cf0-be5b-b77692f91b5d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.436890 Jul 19 19:54:03.909096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1459/3014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:03 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:03.915773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.916547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:03.918268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:03.918935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:04.265479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:04.277341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2daccbb9-3c3e-4af2-a80a-4e4b9d299679 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1499 microversion: 2.1 time: 0.377389 Jul 19 19:54:04.278628 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1556/3015] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:03 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1499 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:04.662147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:04.662805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:04.682550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:04.683044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:04.683853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:04.684303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.085438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:05.086652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:05.103442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.104420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.109211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.109894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.165832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-055e3f49-466b-4796-bc75-84631ab0007f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/ips" status: 200 len: 152 microversion: 2.20 time: 0.546415 Jul 19 19:54:05.167246 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1460/3016] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jul 19 19:54:04 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/ips => generated 152 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:54:05.172700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:05.173929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:05.184213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.184972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.186697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.187512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.524538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:05.533695 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80eded58-36e7-4ead-bee9-443c9d386d04 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.365112 Jul 19 19:54:05.544481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1461/3017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:05 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:05.550784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:05.552682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:05.569322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:05.569927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.570242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.571209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:05.571676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:05.584630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d6ec64f-d903-47ec-aa29-a9bdb00de0f7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.926623 Jul 19 19:54:05.585459 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1557/3018] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:04 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:06.425305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbab642dd2da409ab3b757945a64d24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3c7a8833334ab0b223e1592db6b347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:06.441592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9a9f634-8218-4733-b403-1d082bba4466 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 200 len: 1499 microversion: 2.1 time: 0.902700 Jul 19 19:54:06.442223 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1462/3019] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:05 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 1499 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:06.552451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:06.553494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:06.564197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:06.564963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:06.565954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:06.566614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:06.835416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Calling method '.version_select at 0x7f23eef63c10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:06.926543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:54:06.927215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.security_group_api [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Neutron security group b4be885c-d3e8-4161-a202-99859f152dd7 not found {{(pid=131229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:54:06.928957 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] HTTP exception thrown: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.928957 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Request method failure captured: Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-security-groups/b4be885c-d3e8-4161-a202-99859f152dd7 HTTP/1.1 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wvePcjCewOXxZ0IfYj1FtdJ5z-fcyQp5-QmMCndsofjR4hx5Pkn8evkPBJBzS2UeTnfs56M0BvbgOlVhAtBHjXcYumtR-qupEBMsOof9AXGdiYIB765NEQDmPdJLf-LYjxpOnEtXgYqetxJlq6I72FFa3Hm42cSwjErq3kEETZL2Pk Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a306be04aacf40e5a4eb4b72316d6023 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'b4be885c-d3e8-4161-a202-99859f152dd7'} Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:54:06.932693 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Returning 404 to user: Security group b4be885c-d3e8-4161-a202-99859f152dd7 does not exist Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-403d0963-390c-42dd-a7ce-5ff0418e0d3b'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7819016e-ac79-44f8-a986-235992a941cb tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b4be885c-d3e8-4161-a202-99859f152dd7" status: 404 len: 194 microversion: 2.1 time: 0.467226 Jul 19 19:54:06.938076 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1558/3020] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:54:06 2022] DELETE /compute/v2.1/os-security-groups/b4be885c-d3e8-4161-a202-99859f152dd7 => generated 194 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:54:06.947181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:06.952581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:06.966389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:06.966850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:06.969600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:06.970058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:07.217962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:07.242726 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff50dc00-b17d-43ad-8c6c-ffa9edcbe094 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.694400 Jul 19 19:54:07.248210 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1463/3021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:06 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:07.405837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:07.421010 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1aa1b69d-451e-4e88-9a15-571c3fa27694 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.483694 Jul 19 19:54:07.424238 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1559/3022] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:06 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:07.442724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64810b1d-5e38-4cf6-b2fc-a2c4542ac708 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014163 Jul 19 19:54:07.445926 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1560/3023] 10.222.0.23 () {58 vars in 1163 bytes} [Tue Jul 19 19:54:07 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 19:54:07.458321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71eaf073-d312-4a4f-9752-d4b249562ca0 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Calling method '.version_select at 0x7f23eed9c940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:07.653410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-461860459", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "b0603af9-52cd-48d1-ad46-a5b1f0fb250e"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:07.797320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] validate_networks() for [('b0603af9-52cd-48d1-ad46-a5b1f0fb250e', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:08.825546 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71eaf073-d312-4a4f-9752-d4b249562ca0 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.374146 Jul 19 19:54:08.833545 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1561/3024] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 19:54:07 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:08.840348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:08.842446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:08.863106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:08.863566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:08.864484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:08.864945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:08.888123 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf HTTP/1.1 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7aec422f-98eb-4da3-80bf-b443279522cf'} Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:08.889657 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:08.893831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:08.900730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0d00a0c-d1f0-4cc2-85cf-84a2d27d72b1 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 404 len: 111 microversion: 2.1 time: 0.065671 Jul 19 19:54:08.901399 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1562/3025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:08 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:08.914748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4e5a2a8d-c947-450f-ab33-d59742ed1f45 req-df423176-9408-4d56-acef-2831f6f918d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aec422f-98eb-4da3-80bf-b443279522cf", "name": "network-vif-deleted", "tag": "a0b819e8-d936-4a41-bfaf-9690209ab758"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:08.938136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e5a2a8d-c947-450f-ab33-d59742ed1f45 req-df423176-9408-4d56-acef-2831f6f918d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:08.938869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e5a2a8d-c947-450f-ab33-d59742ed1f45 req-df423176-9408-4d56-acef-2831f6f918d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:08.962144 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4e5a2a8d-c947-450f-ab33-d59742ed1f45 req-df423176-9408-4d56-acef-2831f6f918d6 service nova] Creating event network-vif-deleted:a0b819e8-d936-4a41-bfaf-9690209ab758 for instance 7aec422f-98eb-4da3-80bf-b443279522cf on n-h2-843834-3 Jul 19 19:54:08.982821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4e5a2a8d-c947-450f-ab33-d59742ed1f45 req-df423176-9408-4d56-acef-2831f6f918d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078260 Jul 19 19:54:08.985280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1563/3026] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:08.998299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:08.999411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.014075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.014542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.021714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.022188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.504455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:09.521674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:09.522584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8668d69c-a81e-4bd8-972c-1046b3230fa9 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.535413 Jul 19 19:54:09.522937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:09.523614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:09.524222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:09.524837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:09.524965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1564/3027] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:08 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:09.536390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.536578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:09.537001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.537349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.538344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.539014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.552196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.553980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.554843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.558388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.560007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Getting quotas for project 2e391722d74847559831df402a7338a9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:09.566597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Getting quotas for user df47edb63ec548468e2b95c7838d3a4e and project 2e391722d74847559831df402a7338a9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:09.603833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:09.606687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:09.631316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lazy-loading 'flavor' on Instance uuid 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:54:09.682022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cada7ce8-fdde-40f7-b911-88c02485e604 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.422045 Jul 19 19:54:09.683043 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1464/3028] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:09.689304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:09.690538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:09.701204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.702194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.703364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:09.704792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:09.919717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:09.928063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de41aa35-e166-4c4e-85b2-6438e8eb621a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.243674 Jul 19 19:54:09.933897 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1465/3029] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:09 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:09.945907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Calling method '.version_select at 0x7f2400a1b940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.269050 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3850d0d-69e6-41ab-90d4-30c1ce054ed8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/action" status: 202 len: 0 microversion: 2.20 time: 0.742748 Jul 19 19:54:10.270541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1565/3030] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:54:09 2022] POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:10.297284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.300037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.324652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:54:10.326012 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 19 19:54:10.326012 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.329008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.329489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Request method failure captured: Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/0402f1b9-44c9-467b-b0c3-a75e0a970689 HTTP/1.1 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wvePcjCewOXxZ0IfYj1FtdJ5z-fcyQp5-QmMCndsofjR4hx5Pkn8evkPBJBzS2UeTnfs56M0BvbgOlVhAtBHjXcYumtR-qupEBMsOof9AXGdiYIB765NEQDmPdJLf-LYjxpOnEtXgYqetxJlq6I72FFa3Hm42cSwjErq3kEETZL2Pk Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a306be04aacf40e5a4eb4b72316d6023 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: exception: Insufficient rights for removing default security group. Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0402f1b9-44c9-467b-b0c3-a75e0a970689'} Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:54:10.329751 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] Jul 19 19:54:10.335342 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.340145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.340145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.342747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 19 19:54:10.342747 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-1f23abc0-0fd4-4906-a51f-29e2f5454b13'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:10.342747 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62bb6057-d561-4a15-a2c2-751c45bb1562 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0402f1b9-44c9-467b-b0c3-a75e0a970689" status: 400 len: 182 microversion: 2.1 time: 0.407104 Jul 19 19:54:10.342747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1466/3031] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:54:09 2022] DELETE /compute/v2.1/os-security-groups/0402f1b9-44c9-467b-b0c3-a75e0a970689 => generated 182 bytes in 408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:54:10.358084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-907b58b9-15fa-4710-b30c-9ba813925aa1 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.359202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-907b58b9-15fa-4710-b30c-9ba813925aa1 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.374016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf HTTP/1.1 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7aec422f-98eb-4da3-80bf-b443279522cf'} Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:10.385269 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.391037 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.395430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:10.396823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6b6d4c9-0257-4f7f-8d40-075878496849 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 404 len: 111 microversion: 2.1 time: 0.124768 Jul 19 19:54:10.397702 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1566/3032] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:10 2022] DELETE /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:10.407000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.407668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.419830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.420289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.421085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.421860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.523370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-907b58b9-15fa-4710-b30c-9ba813925aa1 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.538710 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-907b58b9-15fa-4710-b30c-9ba813925aa1 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1215 microversion: 2.1 time: 0.192912 Jul 19 19:54:10.550169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1467/3033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:10.559196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Calling method '.version_select at 0x7f23ef5d4550>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.677376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:54:10.678539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Neutron security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:54:10.679595 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] HTTP exception thrown: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.679595 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Request method failure captured: Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-security-groups/6dcd6b07-7b33-44a2-9bfd-651f0edc5175 HTTP/1.1 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wvePcjCewOXxZ0IfYj1FtdJ5z-fcyQp5-QmMCndsofjR4hx5Pkn8evkPBJBzS2UeTnfs56M0BvbgOlVhAtBHjXcYumtR-qupEBMsOof9AXGdiYIB765NEQDmPdJLf-LYjxpOnEtXgYqetxJlq6I72FFa3Hm42cSwjErq3kEETZL2Pk Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a306be04aacf40e5a4eb4b72316d6023 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6dcd6b07-7b33-44a2-9bfd-651f0edc5175'} Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:54:10.683261 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] Jul 19 19:54:10.690340 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.697235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Returning 404 to user: Security group 6dcd6b07-7b33-44a2-9bfd-651f0edc5175 does not exist Jul 19 19:54:10.697235 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-0bab6c13-2b10-4830-a732-d5eb66289fd0'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:10.698488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d167d841-cb0c-447f-a1a7-b7cae0f97912 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/6dcd6b07-7b33-44a2-9bfd-651f0edc5175" status: 404 len: 194 microversion: 2.1 time: 0.146655 Jul 19 19:54:10.699376 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1468/3034] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/os-security-groups/6dcd6b07-7b33-44a2-9bfd-651f0edc5175 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:10.708357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.708988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 7aec422f-98eb-4da3-80bf-b443279522cf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.719570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.720574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.722166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.723278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.746268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf HTTP/1.1 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '7aec422f-98eb-4da3-80bf-b443279522cf'} Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:10.748654 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. Jul 19 19:54:10.755074 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:10.757308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 7aec422f-98eb-4da3-80bf-b443279522cf could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:10.758847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-336c44d8-24ec-49c6-b3a4-f4fe7d32a245 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf" status: 404 len: 111 microversion: 2.1 time: 0.058083 Jul 19 19:54:10.759851 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1469/3035] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/servers/7aec422f-98eb-4da3-80bf-b443279522cf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:10.774904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:10.775738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:10.785123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.786607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.787709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:10.788548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:10.960724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.982390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.992426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:10.993806 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d81ec4a-985d-42ec-825e-e310b0fbd902 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.594904 Jul 19 19:54:10.994386 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1567/3036] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:11.010267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Action: 'update', calling method: .version_select at 0x7f23eec400d0>, body: {"security_group": {"name": "tempest-sg-1898923182", "description": "tempest-description-169588372"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:11.174894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG neutronclient.v2_0.client [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist", "detail": ""}} {{(pid=131229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:54:11.177624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.security_group_api [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Neutron security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 not found {{(pid=131229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:54:11.179288 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] HTTP exception thrown: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.179288 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Request method failure captured: Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/os-security-groups/cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 HTTP/1.1 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 101 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wvePcjCewOXxZ0IfYj1FtdJ5z-fcyQp5-QmMCndsofjR4hx5Pkn8evkPBJBzS2UeTnfs56M0BvbgOlVhAtBHjXcYumtR-qupEBMsOof9AXGdiYIB765NEQDmPdJLf-LYjxpOnEtXgYqetxJlq6I72FFa3Hm42cSwjErq3kEETZL2Pk Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a9cc9d5a124127ae9ae3ec16f6f9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: f5a9cc9d5a124127ae9ae3ec16f6f9de Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a306be04aacf40e5a4eb4b72316d6023 Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2065588607-project Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: {"security_group": {"name": "tempest-sg-1898923182", "description": "tempest-description-169588372"}} Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: exception: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8', 'body': {'security_group': {'name': 'tempest-sg-1898923182', 'description': 'tempest-description-169588372'}}} Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:54:11.184401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] Jul 19 19:54:11.190280 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.194475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] Returning 404 to user: Security group cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 does not exist Jul 19 19:54:11.194475 n-d-843834-3 devstack@n-api.service[131229]: Neutron server returns request_ids: ['req-ad46bcaf-dffe-40a3-a9a1-2e05b8c65700'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.195989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b4b58cb-f081-498f-b60b-9746ba931817 tempest-SecurityGroupsNegativeTestJSON-2065588607 tempest-SecurityGroupsNegativeTestJSON-2065588607-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8" status: 404 len: 194 microversion: 2.1 time: 0.195764 Jul 19 19:54:11.205272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1568/3037] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Jul 19 19:54:10 2022] PUT /compute/v2.1/os-security-groups/cb5678a6-1b7a-4c8e-b607-a0f2e1a598e8 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.219068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.219516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.241088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.241599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.245999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.246461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.268584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:11.278800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3065a1a-f9d3-418e-a683-cf647cf1d9d4 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.512388 Jul 19 19:54:11.279816 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1470/3038] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:10 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 HTTP/1.1 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '52a731b7-9aa9-427d-bbef-be48d0320774'} Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:11.289880 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.294511 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c9b1276-4873-4314-8c26-be5dbe5b4422 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 404 len: 111 microversion: 2.1 time: 0.080854 Jul 19 19:54:11.296935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1569/3039] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:11 2022] DELETE /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.301973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.302902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.302902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 52a731b7-9aa9-427d-bbef-be48d0320774] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.303175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.310646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.311318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.312194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.312798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.325651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.326284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.327753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.328408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.361446 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 HTTP/1.1 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '52a731b7-9aa9-427d-bbef-be48d0320774'} Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.364830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. Jul 19 19:54:11.372335 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.396248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 52a731b7-9aa9-427d-bbef-be48d0320774 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.400034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ddee7dd0-8c56-4a92-ba34-9355f5249c70 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774" status: 404 len: 111 microversion: 2.1 time: 0.100783 Jul 19 19:54:11.406843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1570/3040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/52a731b7-9aa9-427d-bbef-be48d0320774 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.422032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.424400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.447524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.449227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.453467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.454645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.501483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 HTTP/1.1 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1ca4469c-d47e-4dd7-8c38-0e3902be7d95'} Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:11.507924 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.514189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.516228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae63419d-fda5-416e-a7a0-d2c63dd04945 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 404 len: 111 microversion: 2.1 time: 0.104479 Jul 19 19:54:11.516228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1571/3041] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:11 2022] DELETE /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.532242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.534191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 1ca4469c-d47e-4dd7-8c38-0e3902be7d95] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.549285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.556971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.559216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.560577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.608223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 HTTP/1.1 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1ca4469c-d47e-4dd7-8c38-0e3902be7d95'} Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.610581 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. Jul 19 19:54:11.616338 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.618532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 1ca4469c-d47e-4dd7-8c38-0e3902be7d95 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.618733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-375434ac-8f1a-4873-9942-7ce84361f41e tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95" status: 404 len: 111 microversion: 2.1 time: 0.095461 Jul 19 19:54:11.622965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1572/3042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/1ca4469c-d47e-4dd7-8c38-0e3902be7d95 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.640424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.641777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.657780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.658542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.659659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.660289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.820662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:11.834411 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5bfb0987-1bf1-4339-bb32-d3ca717c72b6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1275 microversion: 2.1 time: 0.209373 Jul 19 19:54:11.835059 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1573/3043] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:11.848839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:11.865344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b04bf75a-655b-4bec-9549-bb7397b55411 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.567337 Jul 19 19:54:11.865578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.866106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.873682 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1471/3044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:11.886966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.887551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.888390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.888832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.905963 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 HTTP/1.1 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'bbc67e86-3d69-45a9-89b5-59268d316af5'} Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:11.908013 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:11.911979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:11.915503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:11.917208 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6c0f5e8-f9f5-4cd2-8582-18f5810fd5f9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 404 len: 111 microversion: 2.1 time: 0.078549 Jul 19 19:54:11.918039 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1574/3045] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:11 2022] DELETE /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:11.927941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:11.928849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: bbc67e86-3d69-45a9-89b5-59268d316af5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:11.940663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.942045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.944157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:11.945749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:11.976928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:12.005493 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 HTTP/1.1 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bbc67e86-3d69-45a9-89b5-59268d316af5'} Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.012317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance bbc67e86-3d69-45a9-89b5-59268d316af5 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:12.019378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12703057-4af4-4de3-bcc7-f10730caefde tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5" status: 404 len: 111 microversion: 2.1 time: 0.090618 Jul 19 19:54:12.020623 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1472/3046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:11 2022] GET /compute/v2.1/servers/bbc67e86-3d69-45a9-89b5-59268d316af5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:12.028935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.032255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.032452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.035099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.045031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.045571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.046365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.046852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.056598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.057648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.059956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.060718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.093129 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 HTTP/1.1 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8c29567f-8e52-4670-8590-fef766eb4309'} Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:12.101477 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.105637 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.108148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:12.109232 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ae34b92-a987-419c-b937-0d7f86b237c7 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 404 len: 111 microversion: 2.1 time: 0.083765 Jul 19 19:54:12.110704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1473/3047] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:12 2022] DELETE /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:54:12.139403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.140634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 8c29567f-8e52-4670-8590-fef766eb4309] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.149745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:12.152603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.153551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.155297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.155962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.181233 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 HTTP/1.1 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8c29567f-8e52-4670-8590-fef766eb4309'} Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:12.183658 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. Jul 19 19:54:12.187814 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:12.192003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 8c29567f-8e52-4670-8590-fef766eb4309 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:12.192658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2e32d44-34f1-4f77-ae36-34556513c5e4 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309" status: 404 len: 111 microversion: 2.1 time: 0.066361 Jul 19 19:54:12.193848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1474/3048] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:12 2022] GET /compute/v2.1/servers/8c29567f-8e52-4670-8590-fef766eb4309 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:12.300532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.301304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.315353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.316126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.317231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.317835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.565085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:12.583039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:12.589204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:12.596007 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd88cf82-f74f-4076-a983-aeba6a71d952 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.584818 Jul 19 19:54:12.597492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1575/3049] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:12 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:12.832234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:12.842284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a21c6976-9140-4a8e-a936-ac7987b9a2ee tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.547686 Jul 19 19:54:12.855494 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1475/3050] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:12 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:12.857181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.857833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.871759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.872307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.873227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.873784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.892934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:12.894448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:12.913446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.915324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:12.916920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:12.921176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.047203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.053429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:13.070324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab53d4fd-26f9-4bbe-b571-7f92a11eb91c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1273 microversion: 2.1 time: 0.214655 Jul 19 19:54:13.073585 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1576/3051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:12 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:13.289193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.304082 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85ca3144-37ad-483e-a8ad-1aa1b452c017 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.417738 Jul 19 19:54:13.304941 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1476/3052] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:12 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:13.618443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:13.619239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:13.631334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.631830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.632597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.633230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.865769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:13.867747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:13.890013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.891971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.893351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:13.893999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:13.908746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.922033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.926162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:13.930106 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7358e6c7-63a2-436b-81aa-735ec15e9f6e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.315953 Jul 19 19:54:13.932584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1577/3053] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:13 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:14.096230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:14.097287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:14.111462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.112178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:14.113164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.115540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:14.557817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:14.567248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7707f7f-7fd4-4764-a0eb-4f2d09363564 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.707432 Jul 19 19:54:14.572526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1477/3054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:13 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:14.606292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:14.606902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:14.607081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:14.621637 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dfbe2623-d668-4d54-8163-e47a5537408f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.528286 Jul 19 19:54:14.636834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.638452 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1578/3055] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:14 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:14.640740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:14.641600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.642050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:14.953181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:14.954432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:14.967504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.968407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:14.970317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:14.971724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.699397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.727996 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8eee4bc7-cf2a-41f5-9e6b-3664a6854a37 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 1.151811 Jul 19 19:54:15.732314 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1478/3056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:14 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:15.748124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.748804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:15.768064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.769024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.770034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.770806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.820500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.833947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.836129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:15.842794 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-208efa29-330d-490f-9a70-0e223c749ffd tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.896382 Jul 19 19:54:15.846157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1579/3057] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:14 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:15.874105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:15.879479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:15.895855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.896329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:15.897627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:15.898425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.376293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:16.390997 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf304cfa-e664-478d-a0a7-3a68745a6088 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.527073 Jul 19 19:54:16.391611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1580/3058] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:16.413650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-10b46472-2311-4256-9f22-06222fb18f76 req-ba8e8e56-8750-4fc2-95e1-f09193e64678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728c31ed-3b6f-4d74-9a13-2a6ed3284784", "tag": "10b4f4ca-41f0-4829-8969-7c5a3f3442c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:16.481763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-10b46472-2311-4256-9f22-06222fb18f76 req-ba8e8e56-8750-4fc2-95e1-f09193e64678 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.484441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-10b46472-2311-4256-9f22-06222fb18f76 req-ba8e8e56-8750-4fc2-95e1-f09193e64678 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.532674 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-10b46472-2311-4256-9f22-06222fb18f76 req-ba8e8e56-8750-4fc2-95e1-f09193e64678 service nova] Creating event network-changed:10b4f4ca-41f0-4829-8969-7c5a3f3442c4 for instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 on n-h2-843834-3 Jul 19 19:54:16.550805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-10b46472-2311-4256-9f22-06222fb18f76 req-ba8e8e56-8750-4fc2-95e1-f09193e64678 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157938 Jul 19 19:54:16.552157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1581/3059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:16.755035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:16.757049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:16.780256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.782654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.784379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.786327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.834344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:16.849804 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36ec4aed-32bd-4117-8ccd-3cbc10dbccd1 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 1.115699 Jul 19 19:54:16.850430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1479/3060] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:15 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:16.872349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:16.872972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:16.889758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.895246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:16.896359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:16.897962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.286135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.295521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a66ff5c-6fa8-4eab-b4a1-bcba98e8030d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.549064 Jul 19 19:54:17.307042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1582/3061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:16 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:17.313355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.314244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.319400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:17.330217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.331595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.332782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.336144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.355760 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d HTTP/1.1 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '74ad89d6-fc11-41ff-a00b-f8b53b5d538d'} Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:17.364345 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.369358 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.374593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:17.374998 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-424791a8-a794-4c5b-acd8-62aff6ea7ea5 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 404 len: 111 microversion: 2.1 time: 0.066018 Jul 19 19:54:17.376938 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1583/3062] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:17 2022] DELETE /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:17.382809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.395405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.399420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.400394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.401804 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-db8c5854-9741-4e09-8835-3dc733d90b89 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.534144 Jul 19 19:54:17.402531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 74ad89d6-fc11-41ff-a00b-f8b53b5d538d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.417488 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1480/3063] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:16 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:17.422960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.427489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.430421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.432847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.433973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.436534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.443819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.444440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.445519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.445858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.461481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d HTTP/1.1 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '74ad89d6-fc11-41ff-a00b-f8b53b5d538d'} Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.472410 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. Jul 19 19:54:17.476559 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.479164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 74ad89d6-fc11-41ff-a00b-f8b53b5d538d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:17.482382 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-401d8474-2003-41b2-a4e0-66f86cbb99a0 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d" status: 404 len: 111 microversion: 2.1 time: 0.089395 Jul 19 19:54:17.483414 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1584/3064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/74ad89d6-fc11-41ff-a00b-f8b53b5d538d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:17.491904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.498762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.509298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.510116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.511430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.517280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.551536 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d HTTP/1.1 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '72c062a9-d5b3-4ce8-b1b4-e2db78787c3d'} Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:17.553129 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2a20a9b-d9af-4cb2-a960-88fdec8070ad tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 404 len: 111 microversion: 2.1 time: 0.066526 Jul 19 19:54:17.557153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1585/3065] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:17 2022] DELETE /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:17.571616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.573058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] [instance: 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.586575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.586575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.594369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.594842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.614066 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] HTTP exception thrown: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Request method failure captured: Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d HTTP/1.1 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqF4JggEWG0TTNz_ayU5xHApr1-W8unupjYxRDyxM8Fky4T8aMcRbzx7MkLQYkZOsZKNKeQTHCN-GldNwn6ocE8zc7PKtb68jYgnY66PvmdzJckMeZ9t5vr4JjcqADsJxbPuz9DALXPagehkxWeyiO7SQqrRTW-zQnL0-mnPdao-lI Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3c7a8833334ab0b223e1592db6b347"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1a3c7a8833334ab0b223e1592db6b347 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-459148885 Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: dbab642dd2da409ab3b757945a64d24b Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-459148885-project Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '72c062a9-d5b3-4ce8-b1b4-e2db78787c3d'} Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:17.615870 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] Returning 404 to user: Instance 72c062a9-d5b3-4ce8-b1b4-e2db78787c3d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:17.620593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c3a9606-e0a1-4f31-bf60-4a7c8660c1b9 tempest-DeleteServersTestJSON-459148885 tempest-DeleteServersTestJSON-459148885-project] 10.222.0.23 "GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d" status: 404 len: 111 microversion: 2.1 time: 0.054123 Jul 19 19:54:17.633006 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1586/3066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/72c062a9-d5b3-4ce8-b1b4-e2db78787c3d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:17.852567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:17.862777 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d9c63ac-5c04-4571-bf08-a6ca7d96c5ac tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.443667 Jul 19 19:54:17.864924 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1481/3067] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:17.886352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:17.887145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:17.899337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.899737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:17.900610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:17.901219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:18.313111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:18.314031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:18.327608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:18.331889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:18.333079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:18.333743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:18.894552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:18.904799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3ec00bba-57bf-41af-8492-18c47545d81f tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.595973 Jul 19 19:54:18.909551 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1482/3068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:18 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:18.921712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:18.925267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:18.939852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:18.942401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:18.945243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:18.946750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.015510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.032196 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9908a01d-cb77-4914-84f6-e3afffb05b39 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 1.150782 Jul 19 19:54:19.049938 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1587/3069] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:17 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.060015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.060944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:19.072504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.073424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.074533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.076715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.403769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.419466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bcaaf04-8eb2-4f36-ae2c-f868e5cf523d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.359318 Jul 19 19:54:19.420711 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1588/3070] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:19 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:19.424495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.443422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.445950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:19.449219 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8fba03ae-ee69-4847-8085-c2296cca2c62 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.538175 Jul 19 19:54:19.449782 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1483/3071] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:18 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:19.925264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:19.925774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:19.934026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.935024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:19.936032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:19.936629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.056634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:20.057249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:20.064152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:20.066231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.066711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.067675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.068142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.321505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:20.366970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2e7d5a5-0da9-49cc-ac88-77d1ae54df6c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.446697 Jul 19 19:54:20.368458 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1589/3072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:19 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:20.440448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:20.452688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:20.455149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:20.470561 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5c37d47-3a4e-43f4-8a2a-5f0b98c37118 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1486 microversion: 2.1 time: 0.420657 Jul 19 19:54:20.472072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.472395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1484/3073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:20 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1486 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:20.473807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.476056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.476984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.481287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:20.482936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:20.505997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.506463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.507290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:20.508996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:20.529721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:21.259290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.273555 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-69d86b49-97d3-4a12-abf1-585345f1ff1e tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.831652 Jul 19 19:54:21.281251 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1590/3074] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:20 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:21.287423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:21.288454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:21.296634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.297431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.298592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.299251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.318348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.334180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.341444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:21.345413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9bd39326-1efa-40f2-8d69-2531886900e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.871694 Jul 19 19:54:21.347159 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1485/3075] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:20 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:21.388337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:21.411949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:21.423529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f450d3d6-b518-4c2a-9a4e-c134dc98a33e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "POST /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871/action" status: 202 len: 0 microversion: 2.1 time: 0.140087 Jul 19 19:54:21.426242 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1591/3076] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:54:21 2022] POST /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:54:21.432040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.445548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:21.447228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.448452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:21.450650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.453073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.465258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.466053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:21.467102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:21.467741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:22.296340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.327372 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e335e41-5de0-451c-b202-27438621b53a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1517 microversion: 2.1 time: 0.942922 Jul 19 19:54:22.342078 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1486/3077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:21 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1517 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:22.353691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:22.356199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:22.370005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.380958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:22.381393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:22.382426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:22.382821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a15dc6b4-a9a5-45c9-9a01-9a268cd93e16 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1494 microversion: 2.1 time: 0.951380 Jul 19 19:54:22.383575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:22.391396 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1592/3078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:21 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1494 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:22.401018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:22.405661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:22.420406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:22.421127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:22.424687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:22.425739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:22.812701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.824675 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-438b684f-d6be-48f7-b5e2-70a90ad25e6c tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.479942 Jul 19 19:54:22.826757 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1487/3079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:22 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:22.836410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.850551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.852271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:22.853897 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f825d96-236c-4de4-9898-e52f55ef6677 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1743 microversion: 2.20 time: 0.459201 Jul 19 19:54:22.854901 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1593/3080] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:22 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1743 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:23.031352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-08ca106c-28e7-441e-9f41-4220d34d6e7e req-6158269d-8c72-40eb-b225-8aa1fb873148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728c31ed-3b6f-4d74-9a13-2a6ed3284784", "name": "network-vif-plugged", "status": "completed", "tag": "10b4f4ca-41f0-4829-8969-7c5a3f3442c4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:23.047009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-08ca106c-28e7-441e-9f41-4220d34d6e7e req-6158269d-8c72-40eb-b225-8aa1fb873148 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.047474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-08ca106c-28e7-441e-9f41-4220d34d6e7e req-6158269d-8c72-40eb-b225-8aa1fb873148 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.069066 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-08ca106c-28e7-441e-9f41-4220d34d6e7e req-6158269d-8c72-40eb-b225-8aa1fb873148 service nova] Creating event network-vif-plugged:10b4f4ca-41f0-4829-8969-7c5a3f3442c4 for instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 on n-h2-843834-3 Jul 19 19:54:23.078450 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-08ca106c-28e7-441e-9f41-4220d34d6e7e req-6158269d-8c72-40eb-b225-8aa1fb873148 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050853 Jul 19 19:54:23.081710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1488/3081] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:23.346130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.347284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.359994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.360734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.361698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.362138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.407586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.408963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.423465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.424162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.429087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.434191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.717363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:23.727793 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e564b574-a239-452c-aca7-54967a9ee76b tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1523 microversion: 2.1 time: 0.386063 Jul 19 19:54:23.730792 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1594/3082] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:23.787818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:23.805969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b82545c-2b25-4a33-a07b-c2c9a19f3d7b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1494 microversion: 2.1 time: 0.402222 Jul 19 19:54:23.807770 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1489/3083] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1494 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:23.848392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.849371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.862520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.863476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.864896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.867601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.881199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:23.882154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:23.891651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.892532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:23.893628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:23.896495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.163499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.174997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.179273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.185975 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-886814c3-2fda-491d-b091-b37da51742c4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.312815 Jul 19 19:54:24.188190 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1490/3084] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:24.217527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:24.221847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:24.231054 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0126525-8493-4d33-9d7e-afb29b1b8b9f tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.386756 Jul 19 19:54:24.233248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1595/3085] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:23 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:24.748768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:24.749528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:24.771052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.771695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.776075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.776855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.825486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:24.826719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:24.837154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:24.846723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.847382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:24.848279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:24.848965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.371105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:25.383529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d4b7dbfc-e0c4-4515-9c8e-c4d8dd7f59cb tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1500 microversion: 2.1 time: 0.560452 Jul 19 19:54:25.384481 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1596/3086] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:24 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1500 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:25.391954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:25.392578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:25.411697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.412460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.413436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.415322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.625273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:25.672070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2d5ef7f-de60-47ab-9b90-40520b5bc66c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1523 microversion: 2.1 time: 0.903978 Jul 19 19:54:25.673322 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1491/3087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:24 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1523 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:54:25.693891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:25.695695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:25.722157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.725007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.727659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:25.728627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:25.972259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:25.997002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:25.999981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:26.001886 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c08e60b-681a-4741-b61e-3068caac2fa4 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.616405 Jul 19 19:54:26.016264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1597/3088] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:25 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:26.026685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.027542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:26.037703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.038850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.040172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.041090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.098702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:26.261391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:26.274366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17cad813-b78f-4641-8c02-7df08ad8fa14 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1315 microversion: 2.1 time: 0.597046 Jul 19 19:54:26.277260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1492/3089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:25 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:26.286215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.291107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:26.309259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.310017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.311002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.313011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.319184 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4738666-c796-4d40-86ee-a2bbf91a7abf tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 204 len: 0 microversion: 2.1 time: 0.298443 Jul 19 19:54:26.325490 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1598/3090] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:26 2022] DELETE /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:26.340810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-955ddefc-bf1e-4ea9-a924-b3f84cfaa9fe req-083cc563-b4f8-4abf-8361-97eb39268c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "name": "network-vif-plugged", "status": "completed", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:26.363684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-955ddefc-bf1e-4ea9-a924-b3f84cfaa9fe req-083cc563-b4f8-4abf-8361-97eb39268c10 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.365793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-955ddefc-bf1e-4ea9-a924-b3f84cfaa9fe req-083cc563-b4f8-4abf-8361-97eb39268c10 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.393764 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-955ddefc-bf1e-4ea9-a924-b3f84cfaa9fe req-083cc563-b4f8-4abf-8361-97eb39268c10 service nova] Creating event network-vif-plugged:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:54:26.404282 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-955ddefc-bf1e-4ea9-a924-b3f84cfaa9fe req-083cc563-b4f8-4abf-8361-97eb39268c10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075496 Jul 19 19:54:26.410194 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1599/3091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:26.422202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.429805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:26.456410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.457755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.459650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:26.460155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:26.949949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:26.966515 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee0f8e4e-bfd5-4538-b76b-45dc2a2a0441 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.554687 Jul 19 19:54:26.967710 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1600/3092] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:26 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:26.984808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:26.985009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:26.986277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.000906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.002526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.003916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.013434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67e9cc42-55f0-49ee-ac91-bfbd74f5c036 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2952 microversion: 2.32 time: 0.733525 Jul 19 19:54:27.014048 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1493/3093] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:26 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2952 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:27.022296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.023199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.023628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.037666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.038200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.061685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.073903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.074758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.075226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.359050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.368432 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-80bcc89c-8af0-42ce-8d9d-30eca2a5bcb0 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1523 microversion: 2.1 time: 0.396316 Jul 19 19:54:27.384636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1601/3094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:26 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:27.395890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.399074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.431305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.434097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.438151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.439527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.685040 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2920825-95b2-4279-9bf8-a7120287fcc3 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.298533 Jul 19 19:54:27.685896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1602/3095] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393/os-interface => generated 1832 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:27.690805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.691468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.702531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.704470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.704940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.705774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.706216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:27.719161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.727196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.730924 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-312dfcfd-cb6c-45ca-8edf-8b3284ba3012 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.713897 Jul 19 19:54:27.735921 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1494/3096] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:27.949027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:27.958121 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-daf70b86-e7a7-4a90-a8b7-e36be20f7a01 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1502 microversion: 2.1 time: 0.270823 Jul 19 19:54:27.961119 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1603/3097] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:27.984421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.985181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:27.985786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.986653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:27.997329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.997758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:27.998389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.001879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.002657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.005709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.006553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.012605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.141248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:28.370247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4c347d7-f419-4108-b8a2-6d54139c757b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 204 len: 0 microversion: 2.1 time: 0.390391 Jul 19 19:54:28.378481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1495/3098] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:27 2022] DELETE /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:28.391072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:28.392508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:28.401512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.402717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.406839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.407703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.415534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:28.427095 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9917b15-51d0-4893-9b4a-4d7edac4d73a tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.446556 Jul 19 19:54:28.433191 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1604/3099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:27 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:28.450268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:28.451431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:28.478474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.481002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.483521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.484109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.832088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:28.848127 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7848e5b1-1cf3-4982-b7e9-fbb5b7d5d4cd tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1508 microversion: 2.1 time: 0.467671 Jul 19 19:54:28.862512 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1496/3100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:28 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:28.867474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5cf663c5-a06c-4311-9d1d-64e6b6ba0618 req-a7dd4802-e7e9-4d9b-a209-355774f08ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49777d5c-c7b5-4494-a546-1be5488509e1", "name": "network-vif-plugged", "status": "completed", "tag": "d857fc79-a9c3-4ac3-917c-743d749e2c82"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:28.894946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5cf663c5-a06c-4311-9d1d-64e6b6ba0618 req-a7dd4802-e7e9-4d9b-a209-355774f08ff2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.895458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5cf663c5-a06c-4311-9d1d-64e6b6ba0618 req-a7dd4802-e7e9-4d9b-a209-355774f08ff2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.898448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:28.911352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d3619e9-617a-467a-86a5-33fd2008d029 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1523 microversion: 2.1 time: 0.474883 Jul 19 19:54:28.914963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1605/3101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:28 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:28.918766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:28.919411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:28.935111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.935651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.937026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:28.937977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:28.951154 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5cf663c5-a06c-4311-9d1d-64e6b6ba0618 req-a7dd4802-e7e9-4d9b-a209-355774f08ff2 service nova] Creating event network-vif-plugged:d857fc79-a9c3-4ac3-917c-743d749e2c82 for instance 49777d5c-c7b5-4494-a546-1be5488509e1 on n-h1-843834-3 Jul 19 19:54:28.966484 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5cf663c5-a06c-4311-9d1d-64e6b6ba0618 req-a7dd4802-e7e9-4d9b-a209-355774f08ff2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111817 Jul 19 19:54:28.967165 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1497/3102] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:29.285220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.303939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.309764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.314881 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8bba6f4d-670f-4c76-a990-eebe008b8388 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.397555 Jul 19 19:54:29.317227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1606/3103] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:28 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:29.450803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:29.451924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:29.474809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.475655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.476654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.477483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.788918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:29.797022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9216c619-e9f3-450a-bc57-97ef92affced tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.352576 Jul 19 19:54:29.809049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1498/3104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:29 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:29.873495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:29.874237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:29.889375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.891475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.897500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.898300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.930654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:29.932543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:29.957961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.958490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:29.967332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:29.967927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.266498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.281505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-21de065f-bcc9-4b6f-aab8-d4d7d869651b tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1508 microversion: 2.1 time: 0.410954 Jul 19 19:54:30.282729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1607/3105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:29 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:30.331785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.336602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:30.337340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:30.342657 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0df6c7ff-1e31-4435-a7c8-d3dcb6da6592 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1523 microversion: 2.1 time: 0.418167 Jul 19 19:54:30.343592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1499/3106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:29 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:30.351715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.359746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.360825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.361392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.620071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.632315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.634444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:30.637541 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e9d3d60-6d77-4e12-9f3f-0a7ff3ded2f9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.303840 Jul 19 19:54:30.640803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1608/3107] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:30 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:30.817892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:30.818520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:30.841032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.841516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:30.842344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:30.842790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.300107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:31.300728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:31.310385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.310836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.315868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.316320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.493806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:31.503714 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3e32ed9e-8267-4655-a6c0-3c3580bad38e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1506 microversion: 2.1 time: 0.692261 Jul 19 19:54:31.509085 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1500/3108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:30 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:31.520852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:31.521672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:31.541677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.542517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:31.543655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:31.544419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.529501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:32.549488 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3083ae7-1c10-4eed-be68-61d839459cd8 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1508 microversion: 2.1 time: 1.253621 Jul 19 19:54:32.550022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1609/3109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:31 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1508 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:32.582526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:32.584955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:32.632399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.634028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.635806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.637312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.760006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:32.773685 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8319379-ef66-4c72-9cd6-156a99abee5c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1508 microversion: 2.1 time: 1.263061 Jul 19 19:54:32.783614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1501/3110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:31 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1508 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:32.788835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:32.796873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:32.814488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.815630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.816763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.817493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.905228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:32.906072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:32.906764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lazy-loading 'fault' on Instance uuid b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:54:33.064778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.075268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5981543-a600-4038-83e6-fccaa31f6e9d tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 200 len: 1304 microversion: 2.1 time: 0.290165 Jul 19 19:54:33.086435 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1502/3111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:32 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:33.099897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5b891cc5-4ac6-4089-8eb1-4e92ad971b15 req-590480ee-a816-4dc4-952a-42e9e8d9cb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b560e6d3-359e-4b9f-9df1-2ff3fa7d5871", "name": "network-vif-deleted", "tag": "c5770355-a060-41d6-bea7-d5afd379f1c5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:33.123991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5b891cc5-4ac6-4089-8eb1-4e92ad971b15 req-590480ee-a816-4dc4-952a-42e9e8d9cb33 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.124588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5b891cc5-4ac6-4089-8eb1-4e92ad971b15 req-590480ee-a816-4dc4-952a-42e9e8d9cb33 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.143627 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5b891cc5-4ac6-4089-8eb1-4e92ad971b15 req-590480ee-a816-4dc4-952a-42e9e8d9cb33 service nova] Creating event network-vif-deleted:c5770355-a060-41d6-bea7-d5afd379f1c5 for instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 on n-h2-843834-3 Jul 19 19:54:33.156319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5b891cc5-4ac6-4089-8eb1-4e92ad971b15 req-590480ee-a816-4dc4-952a-42e9e8d9cb33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068088 Jul 19 19:54:33.157379 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1503/3112] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:33.166430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:33.169264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:33.187093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.187819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.188888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:33.189546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:33.942293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.961891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.969657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:33.972645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-94c48aab-4908-447a-95c2-f675ac8663ac tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 1.420746 Jul 19 19:54:33.974755 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1610/3113] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:32 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:33.992629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.012625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.036835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.039528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.045020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.052297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.083515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:34.110025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c1a4dc8c-118f-4123-9db7-968eae16334d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 200 len: 1508 microversion: 2.1 time: 0.949039 Jul 19 19:54:34.114995 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1504/3114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:33 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 1508 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:34.128475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-bd6238b3-92f9-420a-9c4a-3f9725f6ac25 req-3f0fe194-27e2-4b17-9ff9-5fc3e223be01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728c31ed-3b6f-4d74-9a13-2a6ed3284784", "name": "network-vif-deleted", "tag": "10b4f4ca-41f0-4829-8969-7c5a3f3442c4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:34.184600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bd6238b3-92f9-420a-9c4a-3f9725f6ac25 req-3f0fe194-27e2-4b17-9ff9-5fc3e223be01 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.185522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-bd6238b3-92f9-420a-9c4a-3f9725f6ac25 req-3f0fe194-27e2-4b17-9ff9-5fc3e223be01 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.215439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-bd6238b3-92f9-420a-9c4a-3f9725f6ac25 req-3f0fe194-27e2-4b17-9ff9-5fc3e223be01 service nova] Creating event network-vif-deleted:10b4f4ca-41f0-4829-8969-7c5a3f3442c4 for instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 on n-h2-843834-3 Jul 19 19:54:34.223632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-bd6238b3-92f9-420a-9c4a-3f9725f6ac25 req-3f0fe194-27e2-4b17-9ff9-5fc3e223be01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106963 Jul 19 19:54:34.226344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1505/3115] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:34.237335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.238475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: b560e6d3-359e-4b9f-9df1-2ff3fa7d5871] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.247477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.248319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.249611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.250224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.267530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] HTTP exception thrown: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Request method failure captured: Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 HTTP/1.1 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wuCZ-bPDyz01ZmZ_W0G5KAPsvQd4MfgwXi5g2UbD3VAaFDFnBW2MvfFAAKabuD9PMg-sCdwbPfgCOa5khhShdrgSgE5ZYyyrELfQNeAbMyOWRRmgfzzeZdB8uPknFlxDzFrksrx47f71F3ekJFhMhK7zhIeK0HmDFFcLA1WAvXV974 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1db260f44fa445459b9f0493a4afcf12 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1db260f44fa445459b9f0493a4afcf12 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueTestJSON-726337571-project Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d0aaf646bf424940b18407df636c82ff Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueTestJSON-726337571-project Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b560e6d3-359e-4b9f-9df1-2ff3fa7d5871'} Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:34.269844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. Jul 19 19:54:34.274565 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:54:34.276890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Returning 404 to user: Instance b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:34.278099 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d85a8135-63fb-4d7d-8f92-13050ee48be2 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871" status: 404 len: 111 microversion: 2.1 time: 0.049961 Jul 19 19:54:34.278867 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1506/3116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:34 2022] GET /compute/v2.1/servers/b560e6d3-359e-4b9f-9df1-2ff3fa7d5871 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:34.285906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.287382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.299966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.301981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.303173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.303862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.309475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df47edb63ec548468e2b95c7838d3a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e391722d74847559831df402a7338a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:34.321815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:34.334634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5681560-8d8a-4124-ab21-3d41d8d98a23 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 200 len: 1300 microversion: 2.1 time: 0.355737 Jul 19 19:54:34.352016 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1611/3117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:33 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 1300 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:34.364634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.368187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.383536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.384080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.385000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.390888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.408357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:34.467251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:54:34.511258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:34.712918 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4eb2cd34-d978-4c5b-8b0c-a6eb4696cf3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 204 len: 0 microversion: 2.1 time: 0.430821 Jul 19 19:54:34.713547 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1507/3118] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:34 2022] DELETE /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:34.760672 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72c62263-449c-437e-b4a9-075b8880b029 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 204 len: 0 microversion: 2.1 time: 0.405319 Jul 19 19:54:34.761625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1612/3119] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:34 2022] DELETE /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:34.773517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.775330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:34.805709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.806171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.815399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:34.815999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:34.994156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:34.994860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:35.007448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.011241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.017120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:35.020715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:35.808960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:35.823558 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57250c50-576b-4a72-a649-98cb4a5abd6e tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1491 microversion: 2.1 time: 1.056636 Jul 19 19:54:35.825742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1508/3120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:34 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1491 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:35.838074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1869270863", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "11ed988d-6878-4e43-b2e8-a2da5fae9603"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:35.941611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] validate_networks() for [('11ed988d-6878-4e43-b2e8-a2da5fae9603', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:36.342750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.353570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.360392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:36.366237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2200ed4c-b6cf-4c3a-b16c-9981103bdf4c tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 1.376626 Jul 19 19:54:36.369173 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1613/3121] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:34 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:36.377755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.380583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.401906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.402375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.406781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.407358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.433984 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 HTTP/1.1 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '728c31ed-3b6f-4d74-9a13-2a6ed3284784'} Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.435733 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9e75397-cbd7-421f-8ebe-3a27c69edf7d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 404 len: 111 microversion: 2.1 time: 0.066879 Jul 19 19:54:36.442124 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1614/3122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.447612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1133520662", "metadata": {"image_type": "test"}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:36.448800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.455722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.456418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.457409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.458038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.475621 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784/action HTTP/1.1 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 112 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1133520662", "metadata": {"image_type": "test"}}} Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '728c31ed-3b6f-4d74-9a13-2a6ed3284784', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1133520662', 'metadata': {'image_type': 'test'}}}} Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:54:36.477606 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.481793 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.485950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.485950 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f14f78c7-8f61-4b6a-a38f-52677d45a5e6 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "POST /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784/action" status: 404 len: 111 microversion: 2.1 time: 0.042836 Jul 19 19:54:36.485950 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1615/3123] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Jul 19 19:54:36 2022] POST /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.502879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-516733472", "metadata": {"image_type": "test"}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:36.504885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Failed to fetch instance by id tempest-invalid-2018414759 {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:54:36.505619 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance tempest-invalid-2018414759 could not be found. Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/tempest-invalid-2018414759/action HTTP/1.1 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 111 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-516733472", "metadata": {"image_type": "test"}}} Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance tempest-invalid-2018414759 could not be found. Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'tempest-invalid-2018414759', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-516733472', 'metadata': {'image_type': 'test'}}}} Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2018414759 could not be found. Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.509001 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2018414759 could not be found. Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2018414759 could not be found. Jul 19 19:54:36.513157 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.515410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance tempest-invalid-2018414759 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.516512 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee1f373a-7794-499d-8b8a-476f8287a715 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-2018414759/action" status: 404 len: 101 microversion: 2.1 time: 0.022452 Jul 19 19:54:36.518503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1616/3124] 10.222.0.23 () {60 vars in 1248 bytes} [Tue Jul 19 19:54:36 2022] POST /compute/v2.1/servers/tempest-invalid-2018414759/action => generated 101 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.544066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1065545875"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:36.545317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:54:36.547887 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 57 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "tempest-test-snap-1065545875"}} Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1065545875'}}} Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.551755 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.556849 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.558297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.559453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9cfab3cf-45f6-41c5-bd4e-09ec2ff18177 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.021809 Jul 19 19:54:36.560295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1617/3125] 10.222.0.23 () {60 vars in 1274 bytes} [Tue Jul 19 19:54:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.575702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1667839123"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:36.577105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 19:54:36.577884 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 57 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "tempest-test-snap-1667839123"}} Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1667839123'}}} Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.579730 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 19:54:36.583800 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.586063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.587350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3425846b-3920-4bb8-bc75-a03701e43ba7 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017692 Jul 19 19:54:36.588680 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1618/3126] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Jul 19 19:54:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.597556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.598400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.605600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.606826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.610316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.611059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.629046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 HTTP/1.1 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '728c31ed-3b6f-4d74-9a13-2a6ed3284784'} Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.631353 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.636381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.638221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f32185cb-f50b-4e0d-96af-9748cc71db53 tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 404 len: 111 microversion: 2.1 time: 0.045081 Jul 19 19:54:36.640714 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1619/3127] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:54:36 2022] DELETE /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:54:36.659045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.660103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] [instance: 728c31ed-3b6f-4d74-9a13-2a6ed3284784] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.679280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.680787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.683235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.683973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.723470 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] HTTP exception thrown: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Request method failure captured: Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 HTTP/1.1 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wveojX_kMEQgKCfdfN92NA-PfeQDOxXCjr3H6eWvKk4zaPgQPhoSzXYKRDIynXjH_FYZDVtl9Vw6C7NvIUWoHflNkOoGt9KsH4Xhi4the-xU6wuWqc8Ev_0uUyEKrpx5Chaz--Yl0nlwNsklBVqOBFvBTFFItu9o3WtFdfmDqxxpx0 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2e391722d74847559831df402a7338a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2e391722d74847559831df402a7338a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2e391722d74847559831df402a7338a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2e391722d74847559831df402a7338a9 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1829458739 Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: df47edb63ec548468e2b95c7838d3a4e Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesNegativeTestJSON-1829458739-project Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '728c31ed-3b6f-4d74-9a13-2a6ed3284784'} Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:36.728077 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. Jul 19 19:54:36.732182 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:36.738875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] Returning 404 to user: Instance 728c31ed-3b6f-4d74-9a13-2a6ed3284784 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:36.741104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26bbcae3-ea7f-4b12-a88d-60155260a70d tempest-ImagesNegativeTestJSON-1829458739 tempest-ImagesNegativeTestJSON-1829458739-project] 10.222.0.23 "GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784" status: 404 len: 111 microversion: 2.1 time: 0.092195 Jul 19 19:54:36.743907 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1620/3128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/728c31ed-3b6f-4d74-9a13-2a6ed3284784 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:36.842504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:36.843249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:36.861914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.862398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:36.863261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:36.863865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.473707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:38.485866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c4961d6-6c15-4fc7-8336-a11a19633448 tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1491 microversion: 2.1 time: 1.648840 Jul 19 19:54:38.486711 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1621/3129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:36 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1491 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:38.497039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:38.497885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:38.514198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.514857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:38.515821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:38.516418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.212330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:39.213946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:39.214581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:39.216003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:39.216428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:39.228622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.228986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.229781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.231277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.256640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:39.266823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Getting quotas for user 3cdca318e2f44c2c8148cdd29aaa5747 and project dd31c999394c4025a78cfb2f60f3a101. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:39.286146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:39.289409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:39.370926 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b58981f4-6888-496a-bdaa-a07b62c1e536 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.542550 Jul 19 19:54:39.372075 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1509/3130] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:39.383594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ecfdda4f-8edc-4327-9244-93184a03a6f2 req-b591df40-2b62-4d40-969c-dedadd7b06a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5a87da-2358-4ee1-8249-537c3f2bfba8", "name": "network-vif-deleted", "tag": "d6c1ead5-69f7-49b3-9538-0578e1fd5855"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:39.388950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:39.406623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ecfdda4f-8edc-4327-9244-93184a03a6f2 req-b591df40-2b62-4d40-969c-dedadd7b06a0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.425444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ecfdda4f-8edc-4327-9244-93184a03a6f2 req-b591df40-2b62-4d40-969c-dedadd7b06a0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.451008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ecfdda4f-8edc-4327-9244-93184a03a6f2 req-b591df40-2b62-4d40-969c-dedadd7b06a0 service nova] Creating event network-vif-deleted:d6c1ead5-69f7-49b3-9538-0578e1fd5855 for instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 on n-h1-843834-3 Jul 19 19:54:39.478788 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ecfdda4f-8edc-4327-9244-93184a03a6f2 req-b591df40-2b62-4d40-969c-dedadd7b06a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099149 Jul 19 19:54:39.479731 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1510/3131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:39.490765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a7b6ab1-e807-4466-8e29-585ef3287194 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:39.491748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a7b6ab1-e807-4466-8e29-585ef3287194 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:39.706586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:39.721665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:39.724241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:39.742672 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-38cca0db-9668-4fc7-b981-12cfa095ec0b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 1.250278 Jul 19 19:54:39.744621 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1622/3132] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:38 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:39.763783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:39.764803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:39.793206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.793676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.794484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.799602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.928903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:39.931511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:39.932250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lazy-loading 'fault' on Instance uuid 7c5a87da-2358-4ee1-8249-537c3f2bfba8 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:54:40.085844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a7b6ab1-e807-4466-8e29-585ef3287194 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:40.099736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a7b6ab1-e807-4466-8e29-585ef3287194 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1218 microversion: 2.1 time: 0.616387 Jul 19 19:54:40.103439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1511/3133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:39 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1218 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:40.376075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aaf646bf424940b18407df636c82ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db260f44fa445459b9f0493a4afcf12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:40.389453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-819f677e-81f0-464c-99cc-379d3797cbcd tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 200 len: 1304 microversion: 2.1 time: 0.643450 Jul 19 19:54:40.390211 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1623/3134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:39 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 1304 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:40.763746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:40.763746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:40.779522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:40.780070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:40.781277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:40.781801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.130864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-30099be4-0e9c-4f96-9134-ad966d0d6a58 req-f04bdd13-33a7-4167-bbbf-804a9d0cf247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49777d5c-c7b5-4494-a546-1be5488509e1", "name": "network-vif-deleted", "tag": "d857fc79-a9c3-4ac3-917c-743d749e2c82"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:41.172574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-30099be4-0e9c-4f96-9134-ad966d0d6a58 req-f04bdd13-33a7-4167-bbbf-804a9d0cf247 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.179320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-30099be4-0e9c-4f96-9134-ad966d0d6a58 req-f04bdd13-33a7-4167-bbbf-804a9d0cf247 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.233472 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-30099be4-0e9c-4f96-9134-ad966d0d6a58 req-f04bdd13-33a7-4167-bbbf-804a9d0cf247 service nova] Creating event network-vif-deleted:d857fc79-a9c3-4ac3-917c-743d749e2c82 for instance 49777d5c-c7b5-4494-a546-1be5488509e1 on n-h1-843834-3 Jul 19 19:54:41.245954 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-30099be4-0e9c-4f96-9134-ad966d0d6a58 req-f04bdd13-33a7-4167-bbbf-804a9d0cf247 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.472120 Jul 19 19:54:41.247890 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1624/3135] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:54:41.260272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:41.263222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:41.280872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.281644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.282884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.283543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.714280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:41.722695 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6555fa16-64c0-40fc-a417-397bc847e7eb tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1288 microversion: 2.1 time: 0.472380 Jul 19 19:54:41.732529 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1625/3136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:41 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1288 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:41.737493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:41.738117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] [instance: 7c5a87da-2358-4ee1-8249-537c3f2bfba8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:41.758768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.759546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.761646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:41.762340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:41.778004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] HTTP exception thrown: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Request method failure captured: Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 HTTP/1.1 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wuCZ-bPDyz01ZmZ_W0G5KAPsvQd4MfgwXi5g2UbD3VAaFDFnBW2MvfFAAKabuD9PMg-sCdwbPfgCOa5khhShdrgSgE5ZYyyrELfQNeAbMyOWRRmgfzzeZdB8uPknFlxDzFrksrx47f71F3ekJFhMhK7zhIeK0HmDFFcLA1WAvXV974 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1db260f44fa445459b9f0493a4afcf12 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1db260f44fa445459b9f0493a4afcf12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1db260f44fa445459b9f0493a4afcf12 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerRescueTestJSON-726337571 Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerRescueTestJSON-726337571-project Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: d0aaf646bf424940b18407df636c82ff Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerRescueTestJSON-726337571-project Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7c5a87da-2358-4ee1-8249-537c3f2bfba8'} Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:54:41.780075 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. Jul 19 19:54:41.785154 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:54:41.787124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] Returning 404 to user: Instance 7c5a87da-2358-4ee1-8249-537c3f2bfba8 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:54:41.788502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d081aa9-c722-427c-acc8-4ccc677e6b3b tempest-ServerRescueTestJSON-726337571 tempest-ServerRescueTestJSON-726337571-project] 10.222.0.23 "GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8" status: 404 len: 111 microversion: 2.1 time: 0.054883 Jul 19 19:54:41.789299 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1626/3137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:41 2022] GET /compute/v2.1/servers/7c5a87da-2358-4ee1-8249-537c3f2bfba8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:54:42.241937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.257947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.259573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:42.260794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65b36f81-4d59-4aa3-9315-b1795828a180 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 1.502293 Jul 19 19:54:42.265845 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1512/3138] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:40 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:42.750568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:42.751285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:42.767146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:42.771079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.771943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:42.772415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:42.835802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-212f7d4c-6ca0-42cf-9b67-1b96db4c49ab tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Action: 'create', calling method: .version_select at 0x7f23ef635ca0>, body: {"keypair": {"name": "tempest-keypair-260163271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9VgYAZ0RlztUqB6mBVOB/wJNdHe4bkILAs0mZqTU5YY+UwxkQowTuPIEorLM+fXY24iktBN4rTpvoSd3uhF1yhHxf1OyeJI2v6oxwip3JrJLxgVXVgloj/mHdN3ukRA=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:42.859971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-212f7d4c-6ca0-42cf-9b67-1b96db4c49ab tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for project dbdc36bc81bd4f08972675efff393bb3. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:42.865689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:42.867078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-212f7d4c-6ca0-42cf-9b67-1b96db4c49ab tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for user 809a147ae2664f758b703237ebc6048a and project dbdc36bc81bd4f08972675efff393bb3. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:42.911445 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-212f7d4c-6ca0-42cf-9b67-1b96db4c49ab tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201304 Jul 19 19:54:42.912992 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1627/3139] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:54:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:43.033369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:43.046753 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6d42d844-b371-42c5-ba80-71ddc811976e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1276 microversion: 2.1 time: 0.301085 Jul 19 19:54:43.057090 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1513/3140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:42 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:43.287050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:43.287973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:43.301223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.303683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:43.308743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:43.310211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.064927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:44.066239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:44.082754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:44.083263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.084072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:44.094530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:44.782269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.790253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4943c06f-27e7-4ec2-9f83-403c9a48d6ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1276 microversion: 2.1 time: 0.729281 Jul 19 19:54:44.795570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1514/3141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:44 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1276 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:44.889822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.917362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.940422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:44.954640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-05b6b2fd-6970-43f3-9b17-57937fdd9c38 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 1.674294 Jul 19 19:54:44.966008 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1628/3142] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:43 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:45.812031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:45.813429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:45.837199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:45.845824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:45.850424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:45.855038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:45.974326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:45.976391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:45.989159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:45.992795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:45.994757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:45.996831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:46.904966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:46.914982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:46.928234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:46.937465 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f002240d-fb10-4513-b157-9acb18ee86bd tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 1.118608 Jul 19 19:54:46.938213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:46.939010 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1515/3143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:45 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:46.941077 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2578f349-e418-4a24-bbf1-41f561c2298e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1738 microversion: 2.20 time: 0.971169 Jul 19 19:54:46.942847 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1629/3144] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:45 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1738 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:47.957250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:47.958524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:47.963560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:47.964279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:47.974282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:47.975136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:47.979514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:47.980189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:47.985255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:47.986210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:47.987076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:47.987757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:49.248252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:49.256402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:49.262239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a50e9fb6-09f4-4e4e-89cf-4e422de138aa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 1.307165 Jul 19 19:54:49.263263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1516/3145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:47 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:49.438435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:49.449643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:49.451234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:49.452697 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ecb31af-6810-4f6e-b776-9c5899ac47eb tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1720 microversion: 2.20 time: 1.496626 Jul 19 19:54:49.453479 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1630/3146] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:47 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1720 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:50.279622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:50.280525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:50.284111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:50.301408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:50.302284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:50.310398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:50.311416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:50.472128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:50.473727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:50.482206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:50.483130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:50.484177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:50.484877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:50.876746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:50.891845 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6dfc1f57-9f4f-4418-a1a6-93bcca2a59ac tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 0.616464 Jul 19 19:54:50.902610 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1517/3147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:50 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:51.405379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-275651a0-c57f-46ed-aad9-f940ed45fd4d req-3f51d955-e780-448a-af10-2b03ec2a943c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "name": "network-vif-unplugged", "status": "completed", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:51.421101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-275651a0-c57f-46ed-aad9-f940ed45fd4d req-3f51d955-e780-448a-af10-2b03ec2a943c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:51.425621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-275651a0-c57f-46ed-aad9-f940ed45fd4d req-3f51d955-e780-448a-af10-2b03ec2a943c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:51.452698 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-275651a0-c57f-46ed-aad9-f940ed45fd4d req-3f51d955-e780-448a-af10-2b03ec2a943c service nova] Creating event network-vif-unplugged:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:54:51.462319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-275651a0-c57f-46ed-aad9-f940ed45fd4d req-3f51d955-e780-448a-af10-2b03ec2a943c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061280 Jul 19 19:54:51.472203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1518/3148] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:54:51.489263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:51.504249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:51.506087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:51.507359 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-053ff8a2-ce98-4a18-928f-d55690eedba3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1720 microversion: 2.20 time: 1.039583 Jul 19 19:54:51.510579 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1631/3149] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:50 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1720 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:54:51.910088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:51.910790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:51.920490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:51.921204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:51.922176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:51.922859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.528786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:52.529477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:52.549804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.550562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.558345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:52.560570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:52.878595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:53.063316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:53.080812 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8ce2bdd-8ecf-4f17-a5f9-4df559f00cc2 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 1.173461 Jul 19 19:54:53.084073 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1519/3150] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:51 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:53.102060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c9e39516-7b48-4b57-8248-689c5c8a21ca req-46162acb-c72e-4bb5-b42d-2fac2f435dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47cc446-115e-4852-802b-3d6771e597b2", "tag": "aa337846-b2e6-4007-891e-81c4e6db4d45"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:53.160949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c9e39516-7b48-4b57-8248-689c5c8a21ca req-46162acb-c72e-4bb5-b42d-2fac2f435dad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:53.162212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c9e39516-7b48-4b57-8248-689c5c8a21ca req-46162acb-c72e-4bb5-b42d-2fac2f435dad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:53.194272 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c9e39516-7b48-4b57-8248-689c5c8a21ca req-46162acb-c72e-4bb5-b42d-2fac2f435dad service nova] Creating event network-changed:aa337846-b2e6-4007-891e-81c4e6db4d45 for instance d47cc446-115e-4852-802b-3d6771e597b2 on n-h2-843834-3 Jul 19 19:54:53.204718 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c9e39516-7b48-4b57-8248-689c5c8a21ca req-46162acb-c72e-4bb5-b42d-2fac2f435dad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106596 Jul 19 19:54:53.207631 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1520/3151] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:54:53.602282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:53.622493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:53.624388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:53.628521 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91daf833-ef0e-4188-b640-f66595a64ef6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1720 microversion: 2.20 time: 1.104044 Jul 19 19:54:53.639297 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1632/3152] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:52 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1720 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:54.103630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:54.105704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:54.114137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.115026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.116623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.117509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.504655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:54.529292 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8334e058-d209-4d8d-989b-8fd44f23286e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 0.431493 Jul 19 19:54:54.530656 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1521/3153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:54 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:54.649197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:54.649905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:54.669778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.671676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:54.676659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:54.678772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.235960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-883976883", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "a8ae70dc-3a84-48b5-afb1-478d143aea3f"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:55.318243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.334091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.337085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:55.344605 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a299ffdc-023c-4332-af6d-41eca59f4513 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1663 microversion: 2.20 time: 0.700120 Jul 19 19:54:55.348309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1633/3154] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:54 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1663 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:55.369315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "942fe277-4a78-4be3-b233-52566978694f"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:55.375390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:55.382962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] validate_networks() for [('a8ae70dc-3a84-48b5-afb1-478d143aea3f', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:54:55.414157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.414628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.417036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:55.419547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:55.466339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:54:56.059808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d46dd8b8-80da-49ec-991a-c9a0099fe4f7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.697482 Jul 19 19:54:56.062103 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1634/3155] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jul 19 19:54:55 2022] POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments => generated 188 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:54:56.069596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:56.070258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:56.079391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.080122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:56.081147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:56.082055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.149906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:57.159125 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b02d959-e926-4f6e-9218-7ebf96fa6a16 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 1.095227 Jul 19 19:54:57.164503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1635/3156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:56 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:57.176822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:57.177698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:57.194986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.195509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.196599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.197400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.664089 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9a59d75c-a9e4-434d-8a6b-9b0a4b073f6f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments/942fe277-4a78-4be3-b233-52566978694f" status: 202 len: 0 microversion: 2.20 time: 0.497959 Jul 19 19:54:57.664790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1636/3157] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jul 19 19:54:57 2022] DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments/942fe277-4a78-4be3-b233-52566978694f => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:54:57.753094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:54:57.753581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:54:57.754022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:54:57.754374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:54:57.754791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:54:57.764702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:54:57.765785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:57.778502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.779472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.780041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.780882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.782113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.784778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.785377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:57.787683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:57.837366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Getting quotas for project d7dea7b0f3824690aac8d043aa93fa51. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:54:57.854986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Getting quotas for user 52508b8b455c487da99b756309175f16 and project d7dea7b0f3824690aac8d043aa93fa51. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:54:57.887711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:54:57.893249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:54:58.016633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b06df4c-5e41-4519-8dfa-651db9db914e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/action" status: 202 len: 0 microversion: 2.20 time: 0.255363 Jul 19 19:54:58.019483 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1637/3158] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:54:57 2022] POST /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:54:58.040985 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.944344 Jul 19 19:54:58.043694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.051335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:58.054352 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1522/3159] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:54:58.089035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce853e68-7fe4-45b8-8570-93dd1154b43b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.089666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce853e68-7fe4-45b8-8570-93dd1154b43b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:58.092925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.097457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.100193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.113933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.549991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce853e68-7fe4-45b8-8570-93dd1154b43b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.568903 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce853e68-7fe4-45b8-8570-93dd1154b43b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1216 microversion: 2.1 time: 0.512196 Jul 19 19:54:58.573797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1523/3160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:58 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1216 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:58.578721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:58.586226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:58.597059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.599306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.603660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:58.604114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:58.932200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.954759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.961858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:58.979481 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d17686d5-bd30-4725-ad53-5eac7b40c1c3 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1671 microversion: 2.20 time: 0.954610 Jul 19 19:54:58.983587 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1638/3161] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:58 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1671 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:54:59.528818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:59.546486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce9003ad-955a-4466-b490-bbf6c9e0e531 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 0.970937 Jul 19 19:54:59.549431 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1524/3162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:58 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:54:59.590887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:54:59.592189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:54:59.623393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:59.623866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:59.624769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:54:59.627638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:54:59.869395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:54:59.891017 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f8eaa9a-4f6b-4e16-9a0e-dc1a81408446 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1212 microversion: 2.1 time: 0.304043 Jul 19 19:54:59.891817 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1639/3163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:54:59 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1212 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:00.005318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:00.006713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:00.045040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.048320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.050857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.052406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.341305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c2ca42a1-6ba1-4aa1-97b0-c512dadaefb3 req-7338e19a-d41d-497d-b459-eef23f3daded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47cc446-115e-4852-802b-3d6771e597b2", "name": "network-vif-plugged", "status": "completed", "tag": "aa337846-b2e6-4007-891e-81c4e6db4d45"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:00.362284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c2ca42a1-6ba1-4aa1-97b0-c512dadaefb3 req-7338e19a-d41d-497d-b459-eef23f3daded service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.363343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c2ca42a1-6ba1-4aa1-97b0-c512dadaefb3 req-7338e19a-d41d-497d-b459-eef23f3daded service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.410240 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c2ca42a1-6ba1-4aa1-97b0-c512dadaefb3 req-7338e19a-d41d-497d-b459-eef23f3daded service nova] Creating event network-vif-plugged:aa337846-b2e6-4007-891e-81c4e6db4d45 for instance d47cc446-115e-4852-802b-3d6771e597b2 on n-h2-843834-3 Jul 19 19:55:00.425456 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c2ca42a1-6ba1-4aa1-97b0-c512dadaefb3 req-7338e19a-d41d-497d-b459-eef23f3daded service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508596 Jul 19 19:55:00.427385 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1525/3164] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:00.566070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:00.567118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:00.578568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.579067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.579868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.580312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.779639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:00.798233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:00.801714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:00.803031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44996207-f4f5-4ff5-bd45-7467a91aa8c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1671 microversion: 2.20 time: 0.803720 Jul 19 19:55:00.806290 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1640/3165] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:54:59 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1671 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:00.914748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:00.916364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:00.933005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.933756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:00.935163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:00.936445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:01.226181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:01.243373 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7d3708eb-f122-4c74-8e43-464604f2bbc8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1274 microversion: 2.1 time: 0.337620 Jul 19 19:55:01.247936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1641/3166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:00 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:01.364264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:01.374247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11cef075-102e-470c-90c2-2d02dc7034e7 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1318 microversion: 2.1 time: 0.813876 Jul 19 19:55:01.381325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1526/3167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:00 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:01.822623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:01.824232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:01.837102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:01.839870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:01.840897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:01.841502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.261427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:02.262148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:02.282724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.283699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.289613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.290007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.548339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.569163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.582303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:02.586753 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-411e2f1f-cf00-4a8f-94ba-003680ec9560 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 0.768947 Jul 19 19:55:02.589667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1642/3168] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:01 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:02.609078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:02.617850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:02.638747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.640192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:02.642610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:02.646382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.030559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:04.047808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6664c981-5c27-4890-83ef-d47a380c1511 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1509 microversion: 2.1 time: 1.454972 Jul 19 19:55:04.050390 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1643/3169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:02 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1509 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:04.058691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:04.066832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:04.102619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.104907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.106052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.110320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.146725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:04.164025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b930308-9c2f-44b8-ae14-dac604bc7c8e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 1.906502 Jul 19 19:55:04.178638 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1527/3170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:02 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:04.212065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:04.215809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:04.234986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.236946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:04.240324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:04.242083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.200409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:05.214998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:05.223604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:05.225303 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-94b3dddf-3fd8-48a3-9653-a7860f8c022d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.171296 Jul 19 19:55:05.227541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1644/3171] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:04 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:05.236286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:05.240601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:05.260481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.261377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.267620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.268597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.272976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:05.363593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:05.383866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:05.388666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-863084cc-38df-4a04-a744-ed5d65890234 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1509 microversion: 2.1 time: 1.208743 Jul 19 19:55:05.389334 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1528/3172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:04 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1509 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:05.418969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:05.421509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:05.452979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.459999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.461944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.465158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.713693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-188201f7-2447-473b-97d9-a9410fcacc5a tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "PUT /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1081 microversion: 2.1 time: 0.307345 Jul 19 19:55:05.715122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1529/3173] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 19:55:05 2022] PUT /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1081 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:05.731158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:05.731976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:05.740295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.741453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:05.743119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:05.743765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.197696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:07.221999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d430ef4-a1e4-4b4a-aee4-092cd39507d1 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 1.989086 Jul 19 19:55:07.222634 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1645/3174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:05 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:07.250132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:07.254386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:07.278847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.283663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.287087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.292733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.655059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:07.676519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e9702079-e5b3-4b6e-98cc-6349c8f085fa tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1507 microversion: 2.1 time: 1.949596 Jul 19 19:55:07.697631 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1530/3175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:05 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1507 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:07.720451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:07.721384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:07.735202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.738725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.742560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:07.743319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:07.809802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:08.568663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:08.639026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.650603 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b73d1ab-5b66-4c8e-9288-bfa1a89e0339 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1507 microversion: 2.1 time: 0.949701 Jul 19 19:55:08.673133 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1531/3176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:07 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1507 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:08.682954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:08.692765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:08.705314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.727561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.729662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:08.731184 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49293a26-4744-46e4-8679-a38374ba55e1 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.504552 Jul 19 19:55:08.731979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1646/3177] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:07 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:08.742937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:08.745874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:08.756462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.758195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.760636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.761119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.764372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.765273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.766392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:08.770491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:08.974066 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5e04fa9-90dd-4e50-aca7-ce3ff48b3fb3 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "PUT /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1083 microversion: 2.1 time: 0.237773 Jul 19 19:55:08.985775 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1647/3178] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 19:55:08 2022] PUT /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1083 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:09.001069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:09.004101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:09.018859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.024113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:09.025357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:09.026640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:09.902409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:09.915640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70912884-48b8-45f0-843b-81c8a862d70d tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 1.245830 Jul 19 19:55:09.916160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1532/3179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:08 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:09.940647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-98a4d5a7-f3c7-4f85-b331-77b4424cd5d3 req-e8b518f6-267f-4a55-9021-dee14ed8eab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912f324c-8dc0-44bf-960f-97db3ac3760c", "tag": "079c8835-9e91-40cc-86b7-cb4583e20266"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:09.994627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:10.002785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-98a4d5a7-f3c7-4f85-b331-77b4424cd5d3 req-e8b518f6-267f-4a55-9021-dee14ed8eab4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.003321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-98a4d5a7-f3c7-4f85-b331-77b4424cd5d3 req-e8b518f6-267f-4a55-9021-dee14ed8eab4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.061046 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-98a4d5a7-f3c7-4f85-b331-77b4424cd5d3 req-e8b518f6-267f-4a55-9021-dee14ed8eab4 service nova] Creating event network-changed:079c8835-9e91-40cc-86b7-cb4583e20266 for instance 912f324c-8dc0-44bf-960f-97db3ac3760c on n-h1-843834-3 Jul 19 19:55:10.076383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-98a4d5a7-f3c7-4f85-b331-77b4424cd5d3 req-e8b518f6-267f-4a55-9021-dee14ed8eab4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146075 Jul 19 19:55:10.079592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1533/3180] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:10.097277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:10.098525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:10.209970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.212892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.213911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.216679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.253949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:10.272327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee4e7543-d2cf-421d-821a-d3b649ed82f8 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1509 microversion: 2.1 time: 1.285183 Jul 19 19:55:10.272983 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1648/3181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:08 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1509 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:10.300809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:10.301889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:10.329404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.333381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:10.336173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:10.339309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.681777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:11.695132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:11.710890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:11.716290 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4fc1833-3f4d-4582-8a5f-9b7e6622d937 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.629295 Jul 19 19:55:11.732666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1534/3182] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:10 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:11.741738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:11.742464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:11.784002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.785291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.786817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.788787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.795844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:11.807907 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bfd003cb-355d-4514-b611-ffa4ce89b816 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1509 microversion: 2.1 time: 1.522113 Jul 19 19:55:11.808507 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1649/3183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:10 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1509 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:11.831595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:11.835875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:11.869476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.876625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.878528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:11.885843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:11.950641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:12.092945 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be8712fe-5eb5-40ed-9493-a546c754c758 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 204 len: 0 microversion: 2.1 time: 0.270728 Jul 19 19:55:12.094547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1650/3184] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:11 2022] DELETE /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:12.177987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:12.204254 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9ae9f88-8128-4e11-bf0d-c45254156c06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 0.467824 Jul 19 19:55:12.204996 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1535/3185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:11 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:12.219468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:12.220009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:12.233151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:12.233554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:12.234352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:12.234896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:12.323761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:12.399759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1331741860", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "2f1427c7-5a01-4952-a2be-ab5593970bf4"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:12.407061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Instance is already in deleting state, ignoring this request Jul 19 19:55:12.411239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd6425bf-ba1f-46b7-a995-5bac82e2787c tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 204 len: 0 microversion: 2.1 time: 0.200792 Jul 19 19:55:12.415370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1536/3186] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:12 2022] DELETE /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:12.421000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:12.421939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:12.429616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:12.431220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:12.432553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:12.433089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:12.552573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] validate_networks() for [('2f1427c7-5a01-4952-a2be-ab5593970bf4', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:13.502766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:13.528638 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36a379b2-e09d-4527-a2fc-d9bf925c3b06 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1515 microversion: 2.1 time: 1.109699 Jul 19 19:55:13.529698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1537/3187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:12 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1515 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:13.548098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:13.551774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:13.576228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:13.579174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:13.583712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:13.584501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:15.202970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:15.220357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:15.229609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:15.231439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d4be830-349a-4de9-9bbf-73d3bbf71cf9 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.696773 Jul 19 19:55:15.234803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1538/3188] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:13 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:15.250213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:15.252783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:15.269709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:15.271037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:15.273060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:15.276318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:16.475601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:16.476995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:16.477831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:16.478541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:16.479349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:16.484989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:16.510632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:16.515457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:16.516683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:16.517593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:16.580390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:16.599934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for user 15202808da354b619062b62fcd6ef782 and project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:16.659187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:16.664168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:16.918147 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ed4dfc2-e628-484e-bba3-0c62bc675970 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.818235 Jul 19 19:55:16.923668 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1651/3189] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:55:16.944411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:16.945254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:16.991983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:16.998123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:16.999184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:16.999641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.554441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:17.569947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e0b0eb16-9806-4426-a658-06660ec64f51 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 2.332058 Jul 19 19:55:17.570629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1539/3190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:15 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:17.608501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:17.611511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:17.657831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.658846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.659973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:17.660665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:17.785748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:17.802354 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e87c59c2-00dc-4653-b71d-9352af4528ec tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1515 microversion: 2.1 time: 0.875384 Jul 19 19:55:17.805050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1652/3191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:16 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1515 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:17.835817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5dd8c98c-e9c2-4bef-bb84-e7912ea838da tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:17.837671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5dd8c98c-e9c2-4bef-bb84-e7912ea838da tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:18.403042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5dd8c98c-e9c2-4bef-bb84-e7912ea838da tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:18.414864 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5dd8c98c-e9c2-4bef-bb84-e7912ea838da tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1225 microversion: 2.1 time: 0.608407 Jul 19 19:55:18.431286 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1653/3192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:17 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1225 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:18.588963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:18.590138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:18.599984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:18.612622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:18.614228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:18.615477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:18.863265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:18.872482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:18.878608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:18.879910 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c8f12fc-da1a-44c1-861f-5c700f3f82e0 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.282706 Jul 19 19:55:18.891315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1540/3193] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:17 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:18.893166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-85a7c04c-c543-49f3-b31a-0a7c9d1ad8b9 req-2b36abe0-8bc8-4668-8f2f-693802e345b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47cc446-115e-4852-802b-3d6771e597b2", "name": "network-vif-deleted", "tag": "aa337846-b2e6-4007-891e-81c4e6db4d45"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:18.941735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-85a7c04c-c543-49f3-b31a-0a7c9d1ad8b9 req-2b36abe0-8bc8-4668-8f2f-693802e345b8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:18.942192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-85a7c04c-c543-49f3-b31a-0a7c9d1ad8b9 req-2b36abe0-8bc8-4668-8f2f-693802e345b8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.009036 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-85a7c04c-c543-49f3-b31a-0a7c9d1ad8b9 req-2b36abe0-8bc8-4668-8f2f-693802e345b8 service nova] Creating event network-vif-deleted:aa337846-b2e6-4007-891e-81c4e6db4d45 for instance d47cc446-115e-4852-802b-3d6771e597b2 on n-h2-843834-3 Jul 19 19:55:19.029757 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-85a7c04c-c543-49f3-b31a-0a7c9d1ad8b9 req-2b36abe0-8bc8-4668-8f2f-693802e345b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136513 Jul 19 19:55:19.037811 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1541/3194] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:19.056779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:19.060146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:19.086286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.087438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.089139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.089811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.251307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.255964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.259714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lazy-loading 'fault' on Instance uuid d47cc446-115e-4852-802b-3d6771e597b2 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:55:19.852138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdca318e2f44c2c8148cdd29aaa5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31c999394c4025a78cfb2f60f3a101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:19.867413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a536df95-f895-4ea4-a7c8-a2cba2eece3d tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 200 len: 1308 microversion: 2.1 time: 0.827036 Jul 19 19:55:19.869117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1542/3195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:19 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 1308 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:19.875449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:19.876669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:19.885680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.886882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:19.899452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:19.901658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.158014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:20.177412 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45b0be31-a701-41f7-9f44-4d0321cce88b tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 1.593203 Jul 19 19:55:20.188980 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1654/3196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:18 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:20.195236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:20.197617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:20.198764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:20.210069 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7e12ee0-2c5e-4cc2-a59e-e1e7e974c683 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1283 microversion: 2.1 time: 0.339353 Jul 19 19:55:20.220477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.223159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.224967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.225606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.227363 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1543/3197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:19 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1283 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:20.236798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-455d50fd-9fe7-427d-9901-5cf3b1887a30 req-8c192b80-311b-4f84-8643-8f50003c087b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f324c-8dc0-44bf-960f-97db3ac3760c", "name": "network-vif-plugged", "status": "completed", "tag": "079c8835-9e91-40cc-86b7-cb4583e20266"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:20.254722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-455d50fd-9fe7-427d-9901-5cf3b1887a30 req-8c192b80-311b-4f84-8643-8f50003c087b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.255558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-455d50fd-9fe7-427d-9901-5cf3b1887a30 req-8c192b80-311b-4f84-8643-8f50003c087b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.276063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-455d50fd-9fe7-427d-9901-5cf3b1887a30 req-8c192b80-311b-4f84-8643-8f50003c087b service nova] Creating event network-vif-plugged:079c8835-9e91-40cc-86b7-cb4583e20266 for instance 912f324c-8dc0-44bf-960f-97db3ac3760c on n-h1-843834-3 Jul 19 19:55:20.283310 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-455d50fd-9fe7-427d-9901-5cf3b1887a30 req-8c192b80-311b-4f84-8643-8f50003c087b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054425 Jul 19 19:55:20.284345 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1544/3198] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:20.887511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:20.888606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: d47cc446-115e-4852-802b-3d6771e597b2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:20.896693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.897551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.899108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.899819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.923280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:20.926776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] HTTP exception thrown: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Request method failure captured: Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 HTTP/1.1 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wtz627XVyl00bHz9FbwP5fR9clRthJN7Z2ggOyd-L-HeV2o10R-VnaAvG4v9SHuzxs0-kEg2MnhFyw4njgKSnWD1mBr7l2i_PQULEbWJx1rzwDaslWF4COcLzPEeL4NUQIdbgtNkqFKYIC5JwdytBBzB3BfzspIHhJ9U77qulMFC9k Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3cdca318e2f44c2c8148cdd29aaa5747 Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd47cc446-115e-4852-802b-3d6771e597b2'} Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:20.932248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. Jul 19 19:55:20.936844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.939633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Returning 404 to user: Instance d47cc446-115e-4852-802b-3d6771e597b2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:20.940736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c027e0b-6db5-4226-bde7-8a661e2d7471 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2" status: 404 len: 111 microversion: 2.1 time: 0.058451 Jul 19 19:55:20.945701 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1545/3199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:20 2022] GET /compute/v2.1/servers/d47cc446-115e-4852-802b-3d6771e597b2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:55:20.954207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:20.954980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:20.968434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.969275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.970882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:20.971730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:20.992596 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] HTTP exception thrown: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Request method failure captured: Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 HTTP/1.1 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wtz627XVyl00bHz9FbwP5fR9clRthJN7Z2ggOyd-L-HeV2o10R-VnaAvG4v9SHuzxs0-kEg2MnhFyw4njgKSnWD1mBr7l2i_PQULEbWJx1rzwDaslWF4COcLzPEeL4NUQIdbgtNkqFKYIC5JwdytBBzB3BfzspIHhJ9U77qulMFC9k Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3cdca318e2f44c2c8148cdd29aaa5747 Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '49777d5c-c7b5-4494-a546-1be5488509e1'} Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:20.996460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.000630 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.006772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Returning 404 to user: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:21.008348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35a88c58-c74f-46d1-864a-b00fdc941b14 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 404 len: 111 microversion: 2.1 time: 0.061008 Jul 19 19:55:21.010298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1546/3200] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:20 2022] DELETE /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:21.019141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:21.020959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 49777d5c-c7b5-4494-a546-1be5488509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:21.029567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.030479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.031612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.032441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.058521 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] HTTP exception thrown: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Request method failure captured: Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 HTTP/1.1 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wtz627XVyl00bHz9FbwP5fR9clRthJN7Z2ggOyd-L-HeV2o10R-VnaAvG4v9SHuzxs0-kEg2MnhFyw4njgKSnWD1mBr7l2i_PQULEbWJx1rzwDaslWF4COcLzPEeL4NUQIdbgtNkqFKYIC5JwdytBBzB3BfzspIHhJ9U77qulMFC9k Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3cdca318e2f44c2c8148cdd29aaa5747 Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '49777d5c-c7b5-4494-a546-1be5488509e1'} Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.061299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. Jul 19 19:55:21.065479 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.068733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Returning 404 to user: Instance 49777d5c-c7b5-4494-a546-1be5488509e1 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:21.070278 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-78a216de-883d-4226-a2b0-8afa016e3a8e tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1" status: 404 len: 111 microversion: 2.1 time: 0.055358 Jul 19 19:55:21.071263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1547/3201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:21 2022] GET /compute/v2.1/servers/49777d5c-c7b5-4494-a546-1be5488509e1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:55:21.083615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:21.084797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:21.095930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.096921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.098541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.099184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.123599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] HTTP exception thrown: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Request method failure captured: Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 HTTP/1.1 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wtz627XVyl00bHz9FbwP5fR9clRthJN7Z2ggOyd-L-HeV2o10R-VnaAvG4v9SHuzxs0-kEg2MnhFyw4njgKSnWD1mBr7l2i_PQULEbWJx1rzwDaslWF4COcLzPEeL4NUQIdbgtNkqFKYIC5JwdytBBzB3BfzspIHhJ9U77qulMFC9k Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3cdca318e2f44c2c8148cdd29aaa5747 Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1313497f-b80f-4834-ac4d-6f8f15518665'} Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:21.125053 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.130009 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.132071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Returning 404 to user: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:21.133414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29d8fd74-251d-4ca7-b950-7f07474dae64 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 404 len: 111 microversion: 2.1 time: 0.056086 Jul 19 19:55:21.134876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1548/3202] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:21 2022] DELETE /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:21.147569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:21.148557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] [instance: 1313497f-b80f-4834-ac4d-6f8f15518665] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:21.156197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.156938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.157958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.158577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.167459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:21.179319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] HTTP exception thrown: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.179765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Request method failure captured: Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 HTTP/1.1 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wtz627XVyl00bHz9FbwP5fR9clRthJN7Z2ggOyd-L-HeV2o10R-VnaAvG4v9SHuzxs0-kEg2MnhFyw4njgKSnWD1mBr7l2i_PQULEbWJx1rzwDaslWF4COcLzPEeL4NUQIdbgtNkqFKYIC5JwdytBBzB3BfzspIHhJ9U77qulMFC9k Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dd31c999394c4025a78cfb2f60f3a101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dd31c999394c4025a78cfb2f60f3a101 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1897485122 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3cdca318e2f44c2c8148cdd29aaa5747 Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1897485122-project Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1313497f-b80f-4834-ac4d-6f8f15518665'} Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:21.181460 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. Jul 19 19:55:21.186470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:21.190213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] Returning 404 to user: Instance 1313497f-b80f-4834-ac4d-6f8f15518665 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:21.191648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:21.192115 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76e76454-164b-4d20-bc5b-01e98fb24160 tempest-ServerDiskConfigTestJSON-1897485122 tempest-ServerDiskConfigTestJSON-1897485122-project] 10.222.0.23 "GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665" status: 404 len: 111 microversion: 2.1 time: 0.053081 Jul 19 19:55:21.193123 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1549/3203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:21 2022] GET /compute/v2.1/servers/1313497f-b80f-4834-ac4d-6f8f15518665 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:55:21.202108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:21.208382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:21.218761 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-efcf9eb8-89fd-4086-b8bb-3489b6b6e92a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.020473 Jul 19 19:55:21.219733 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1655/3204] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:20 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:21.234584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.235612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.236918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.237514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.240425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:21.240995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:21.254623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.257436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.258399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:21.259373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:21.519939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:21.530860 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f30160a6-8191-464b-9a78-d7c1d301ea09 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1283 microversion: 2.1 time: 0.294466 Jul 19 19:55:21.540989 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1656/3205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:21 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1283 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:21.715456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:21.731803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49a54dfa-d95e-43ad-8cdc-8c505a404bd7 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1316 microversion: 2.1 time: 0.537342 Jul 19 19:55:21.732933 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1550/3206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:21 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:22.237834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:22.239183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:22.248321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.248988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:22.250005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.250627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:22.442003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1215276749", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fecfb25d-f638-4d89-a44c-d46f7892148b"}], "security_groups": [{"name": "tempest-securitygroup--924128638"}], "key_name": "tempest-keypair-260163271", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1fe51a1c-60a3-4eba-8121-c564546964ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:22.755502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:22.761565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] validate_networks() for [('fecfb25d-f638-4d89-a44c-d46f7892148b', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:22.768753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:22.770653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:22.771929 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ef955d8-bd2f-4149-b7ba-ec860096940e tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 0.538173 Jul 19 19:55:22.772526 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1657/3207] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:22 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:22.789346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:22.791464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:22.807708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.808177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:22.808987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:22.809425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.404833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:23.441236 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33cac8d0-3af0-4dcb-840b-16c2869cf804 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.667471 Jul 19 19:55:23.452619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1658/3208] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:22 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:23.469473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:23.470269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:23.491130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.495030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:23.496877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:23.498613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:24.153206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:24.166329 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96f1bf1b-192a-483f-82c1-48feb54b8a06 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1505 microversion: 2.1 time: 0.709680 Jul 19 19:55:24.181430 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1659/3209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:23 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:24.194199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:24.198873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:24.216348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:24.217238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:24.218451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:24.219906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:24.889434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for project dbdc36bc81bd4f08972675efff393bb3. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:24.915579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for user 809a147ae2664f758b703237ebc6048a and project dbdc36bc81bd4f08972675efff393bb3. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:24.940599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:24.941415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:24.942000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:24.942690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:24.943380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:24.977521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:24.977965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:24.984814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:24.985553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.016835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for project dbdc36bc81bd4f08972675efff393bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:25.028904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Getting quotas for user 809a147ae2664f758b703237ebc6048a and project dbdc36bc81bd4f08972675efff393bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:25.110640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:25.113054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fe51a1c-60a3-4eba-8121-c564546964ec',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:25.249333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.294634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.297873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.301128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be9e14b1-7709-446a-8e9a-42588a5f69a6 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 1.114033 Jul 19 19:55:25.301993 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1660/3210] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:24 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:25.309622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:25.310516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.316484 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8be9886e-55f2-46ef-942c-9c8e014d7fae tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.879086 Jul 19 19:55:25.323834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.324580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.325520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.326100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.328192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1551/3211] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:55:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:55:25.332675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:25.334257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:25.334942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.351700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.351700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.351700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.351700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.408870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.409891 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d83b5d9c-ca1b-4baf-9c86-187afc507367 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/os-instance-actions/req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd" status: 200 len: 313 microversion: 2.1 time: 0.106705 Jul 19 19:55:25.418356 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1661/3212] 10.222.0.23 () {58 vars in 1418 bytes} [Tue Jul 19 19:55:25 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/os-instance-actions/req-7dd91ab5-8a2b-4a44-87b0-a84d1d688fcd => generated 313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:25.428116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c71bc65-00ae-4846-8bfe-cf0039e3d24b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:25.428760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8c71bc65-00ae-4846-8bfe-cf0039e3d24b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.576167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8c71bc65-00ae-4846-8bfe-cf0039e3d24b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:25.587262 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8c71bc65-00ae-4846-8bfe-cf0039e3d24b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1121 microversion: 2.1 time: 0.167637 Jul 19 19:55:25.601095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1662/3213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:25 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1121 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:25.606982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:25.607738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.621378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.629865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.630023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.630475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.812349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40438f89-9f8e-470d-a6e1-8201c0983e83 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "POST /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/action" status: 202 len: 0 microversion: 2.1 time: 0.219594 Jul 19 19:55:25.828935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1663/3214] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:25 2022] POST /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:55:25.855219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:25.861631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:25.890343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.890812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:25.899070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:25.904404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.139711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.151749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e273a3f9-6bca-47ca-96dd-dd4673278a27 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.822303 Jul 19 19:55:26.152680 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1552/3215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:25 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:26.166023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-be37caba-2616-49c8-8e08-e41c6e33e189 req-074acfad-b4c1-4b72-88fd-e2071f43b9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51746b8f-103e-494e-bdd3-6dd50755575c", "tag": "967e1b5c-4d73-49e5-a378-ffc0c18c3083"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:26.191603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-be37caba-2616-49c8-8e08-e41c6e33e189 req-074acfad-b4c1-4b72-88fd-e2071f43b9f4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.192854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-be37caba-2616-49c8-8e08-e41c6e33e189 req-074acfad-b4c1-4b72-88fd-e2071f43b9f4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.230118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-be37caba-2616-49c8-8e08-e41c6e33e189 req-074acfad-b4c1-4b72-88fd-e2071f43b9f4 service nova] Creating event network-changed:967e1b5c-4d73-49e5-a378-ffc0c18c3083 for instance 51746b8f-103e-494e-bdd3-6dd50755575c on n-h2-843834-3 Jul 19 19:55:26.246025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-be37caba-2616-49c8-8e08-e41c6e33e189 req-074acfad-b4c1-4b72-88fd-e2071f43b9f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090907 Jul 19 19:55:26.247097 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1553/3216] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:26.322445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.323218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:26.350074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.352685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.356178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.367306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.560853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:26.734458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.750960 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3da57e08-e22f-4bad-9146-7d98ea32d8bb tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1507 microversion: 2.1 time: 0.913772 Jul 19 19:55:26.753190 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1664/3217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:25 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:26.779158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-85347e83-0a38-48ba-aeec-41baace431e4 req-59629225-84ee-4f58-be62-e61bba3b3341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "name": "network-vif-plugged", "status": "completed", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:26.780444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.791352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.795132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.798696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85347e83-0a38-48ba-aeec-41baace431e4 req-59629225-84ee-4f58-be62-e61bba3b3341 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.800366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-987f6c47-0684-4d00-9e5a-3838c1531330 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 0.484360 Jul 19 19:55:26.801232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1554/3218] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:26 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:26.802563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85347e83-0a38-48ba-aeec-41baace431e4 req-59629225-84ee-4f58-be62-e61bba3b3341 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.814807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:26.815488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:26.826550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.827037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.827830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:26.828269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:26.841390 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-85347e83-0a38-48ba-aeec-41baace431e4 req-59629225-84ee-4f58-be62-e61bba3b3341 service nova] Creating event network-vif-plugged:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:55:26.848496 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-85347e83-0a38-48ba-aeec-41baace431e4 req-59629225-84ee-4f58-be62-e61bba3b3341 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093874 Jul 19 19:55:26.852139 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1665/3219] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:26.957849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:26.970226 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-26f12280-fe4a-4fae-9866-44177a2aa479 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1219 microversion: 2.1 time: 0.167854 Jul 19 19:55:26.971244 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1555/3220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:26 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:27.171840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:27.172559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:27.191778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.192305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.195369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.197733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.733773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:27.742401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e50d715-862a-4e11-8f4d-75f61cc45e37 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.576269 Jul 19 19:55:27.748703 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1666/3221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:27 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:27.773282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:27.774202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:27.817736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.819027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.820704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:27.821385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:27.822801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.824043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.832137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.835316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:27.836193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:27.836692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.207973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.222529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f84773c2-d863-480e-b8b9-03418eda629e tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1507 microversion: 2.1 time: 0.456165 Jul 19 19:55:28.223550 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1556/3222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:27 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:28.235905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:28.239644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.247896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:28.254745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.257016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.258539 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d38505c-d2b3-4828-8871-d50e1e39da1d tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 0.442610 Jul 19 19:55:28.266449 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1667/3223] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:27 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:28.277725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.278192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.279033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.279482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.437085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:28.455965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc421438-e5b6-4b29-882e-f611465583f0 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1237 microversion: 2.1 time: 0.223981 Jul 19 19:55:28.460606 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1557/3224] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:28 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1237 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:28.759442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:28.760589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:28.785571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.786238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:28.787272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:28.803676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.243685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.245396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:29.257140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.258293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.259662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.263286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.808655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:29.824584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-653c7afb-aee3-47ff-a991-ad70b5a63460 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 1.069516 Jul 19 19:55:29.838283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1668/3225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:28 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:29.843579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.845291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:29.853929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.854612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.855720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.856378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.870429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:29.882592 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d05ed814-739e-4cad-b2bf-e790a3936d37 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1505 microversion: 2.1 time: 0.643930 Jul 19 19:55:29.896904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1558/3226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:29.896904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:29.896904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:29.921428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.921892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:29.922701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:29.923175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.142741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.159203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b27ddc0-6fea-4243-9f02-61fb2e53b23a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1237 microversion: 2.1 time: 0.270624 Jul 19 19:55:30.160912 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1559/3227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1237 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:30.173935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '.version_select at 0x7f23ef72da60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:30.179336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:30.199367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.207180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.208258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.208798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.295747 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4429dc3-421f-48b4-8f54-678b9d267a47 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.128130 Jul 19 19:55:30.296622 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1560/3228] 10.222.0.23 () {58 vars in 1295 bytes} [Tue Jul 19 19:55:30 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c/os-instance-actions => generated 611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:30.346072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.360313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.364087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.371998 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-863ad6e6-cec3-4a3d-8a1e-acf8ba1bbba7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1729 microversion: 2.20 time: 0.532084 Jul 19 19:55:30.384334 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1669/3229] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:29 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1729 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:30.390839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:30.391375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:30.409397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.409849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.410664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.411146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.482242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:30.646519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-040f922d-8c94-4c34-815d-1ee5d12b7c4c tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "DELETE /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 204 len: 0 microversion: 2.1 time: 0.260644 Jul 19 19:55:30.647412 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1670/3230] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:30 2022] DELETE /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:30.657282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:30.662588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:30.677642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.679904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.680847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:30.681935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:30.930614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1771386158", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:30.978948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:30.995877 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3bd4832-5412-4c31-b8c7-a9c6b498730f tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1511 microversion: 2.1 time: 0.343638 Jul 19 19:55:30.996484 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1671/3231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:30 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:31.001175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.001797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.013811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.014263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.015164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.015536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.039849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:31.040327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:31.040845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:31.043385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:31.044859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:31.067959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.073673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.075029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.076795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.115221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Getting quotas for project e748b47201bc49e49662f79778770f14. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:31.135377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Getting quotas for user 2a856799802646a5adce643f96ada1dd and project e748b47201bc49e49662f79778770f14. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:31.165297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:31.169375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:31.261734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.267276 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e0fbc94-351c-40d0-8151-ed4bd0801cfe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.968792 Jul 19 19:55:31.268889 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1561/3232] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:55:31.273970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91325f0a-fb54-4ee8-9e53-2009f92c5dea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.276387 Jul 19 19:55:31.282982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1672/3233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:30 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:31.286506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.286506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.286877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.286877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.299773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.301861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.302854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.305022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.404711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.413780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.426208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.431063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7fda6580-f6d5-4851-bd42-a3d6bc68eaa9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 200 len: 1278 microversion: 2.47 time: 0.153413 Jul 19 19:55:31.431713 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1673/3234] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:31 2022] GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:31.449482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:31.454735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:31.478002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.478456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.483929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:31.484455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:31.781375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.817368 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b47a6529-ec0a-484f-9b1b-5ea7b74cf2b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1304 microversion: 2.1 time: 0.545298 Jul 19 19:55:31.818600 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1562/3235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:31 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1304 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:31.845418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1301432281", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:31.874724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:31.904275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.927417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.929544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:31.932128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-112255b5-42c8-4be0-8699-e38051e9c9c8 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1716 microversion: 2.20 time: 0.497046 Jul 19 19:55:31.944403 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1674/3236] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:31 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1716 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:31.988126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:31.988859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:31.989995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:31.990586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:31.991359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:32.012626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.017413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.019087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.019759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.019967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:32.020997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:32.030332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.032800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.033964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.034887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.084262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Getting quotas for project e748b47201bc49e49662f79778770f14. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:32.094199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Getting quotas for user 2a856799802646a5adce643f96ada1dd and project e748b47201bc49e49662f79778770f14. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:32.128613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:32.134117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:32.291077 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd889e50-09a3-4a08-a719-25b2e372bed7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.460810 Jul 19 19:55:32.298114 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1563/3237] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 19:55:32.319680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:32.323198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:32.363961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.365076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.366172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.366874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.707228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:32.725109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54e605bd-278d-4131-a72e-9bb0b5d9ed49 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1511 microversion: 2.1 time: 0.714025 Jul 19 19:55:32.734611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1675/3238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:32 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:32.761120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-02ebd400-b6d1-48eb-8d39-8e0a7f1f0d1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:32.768010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-02ebd400-b6d1-48eb-8d39-8e0a7f1f0d1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:32.890483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-02ebd400-b6d1-48eb-8d39-8e0a7f1f0d1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "PUT /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 992 microversion: 2.47 time: 0.151293 Jul 19 19:55:32.892834 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1676/3239] 10.222.0.23 () {62 vars in 1296 bytes} [Tue Jul 19 19:55:32 2022] PUT /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 992 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:55:32.912395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:32.917177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:32.937152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.938232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:32.942262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:32.943874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.694604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.710380 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-353d5218-c316-4d12-89b8-8106e5a4b0f7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 1.410392 Jul 19 19:55:33.725463 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1564/3240] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:32 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:33.741524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:33.744656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:33.767820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:33.768522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.769490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:33.776842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:33.921237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.933182 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e31ef110-c6b8-4092-8491-77924c3c1be8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1304 microversion: 2.1 time: 1.037832 Jul 19 19:55:33.944150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.952683 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1677/3241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:32 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1304 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:33.961152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.966556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:33.970687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-987f0fe7-0070-4194-adc3-14bbac549d15 req-d6835587-28b0-4901-b65e-653a4ff4993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51746b8f-103e-494e-bdd3-6dd50755575c", "name": "network-vif-plugged", "status": "completed", "tag": "967e1b5c-4d73-49e5-a378-ffc0c18c3083"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:33.972412 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c21e722-5dc5-4a41-b004-ac2a89d8af87 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1330 microversion: 2.47 time: 0.245265 Jul 19 19:55:33.980333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1565/3242] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:33 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1330 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:34.000713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:34.003899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:34.005508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-987f0fe7-0070-4194-adc3-14bbac549d15 req-d6835587-28b0-4901-b65e-653a4ff4993d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.010004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-987f0fe7-0070-4194-adc3-14bbac549d15 req-d6835587-28b0-4901-b65e-653a4ff4993d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.023575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.024255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.026258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.026964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.041663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-987f0fe7-0070-4194-adc3-14bbac549d15 req-d6835587-28b0-4901-b65e-653a4ff4993d service nova] Creating event network-vif-plugged:967e1b5c-4d73-49e5-a378-ffc0c18c3083 for instance 51746b8f-103e-494e-bdd3-6dd50755575c on n-h2-843834-3 Jul 19 19:55:34.061810 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-987f0fe7-0070-4194-adc3-14bbac549d15 req-d6835587-28b0-4901-b65e-653a4ff4993d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102609 Jul 19 19:55:34.063629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1678/3243] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:34.550341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-07349520-2406-4d26-bf33-15407003702f req-da2c3ea7-3a8f-4784-8d91-320844cb55fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451fa00b-e484-4703-8fc5-84598e7262c1", "tag": "7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:34.580884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-07349520-2406-4d26-bf33-15407003702f req-da2c3ea7-3a8f-4784-8d91-320844cb55fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.581391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-07349520-2406-4d26-bf33-15407003702f req-da2c3ea7-3a8f-4784-8d91-320844cb55fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.608289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-07349520-2406-4d26-bf33-15407003702f req-da2c3ea7-3a8f-4784-8d91-320844cb55fd service nova] Creating event network-changed:7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8 for instance 451fa00b-e484-4703-8fc5-84598e7262c1 on n-h1-843834-3 Jul 19 19:55:34.617071 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-07349520-2406-4d26-bf33-15407003702f req-da2c3ea7-3a8f-4784-8d91-320844cb55fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.551353 Jul 19 19:55:34.618048 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1679/3244] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:34.626122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52508b8b455c487da99b756309175f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dea7b0f3824690aac8d043aa93fa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:34.629044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-dbd88df2-9a86-46b6-bf66-0205666b0f4c req-d10f3893-ceb4-4aea-b312-1406da2ed481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f324c-8dc0-44bf-960f-97db3ac3760c", "name": "network-vif-deleted", "tag": "079c8835-9e91-40cc-86b7-cb4583e20266"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:34.640324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-dbd88df2-9a86-46b6-bf66-0205666b0f4c req-d10f3893-ceb4-4aea-b312-1406da2ed481 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.640884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-dbd88df2-9a86-46b6-bf66-0205666b0f4c req-d10f3893-ceb4-4aea-b312-1406da2ed481 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.641080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4db69563-6280-4e8b-ab14-1f1aeae5b549 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 200 len: 1511 microversion: 2.1 time: 0.658022 Jul 19 19:55:34.642059 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1566/3245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:33 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 1511 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:34.662022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:34.665528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-dbd88df2-9a86-46b6-bf66-0205666b0f4c req-d10f3893-ceb4-4aea-b312-1406da2ed481 service nova] Creating event network-vif-deleted:079c8835-9e91-40cc-86b7-cb4583e20266 for instance 912f324c-8dc0-44bf-960f-97db3ac3760c on n-h1-843834-3 Jul 19 19:55:34.686618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-dbd88df2-9a86-46b6-bf66-0205666b0f4c req-d10f3893-ceb4-4aea-b312-1406da2ed481 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066743 Jul 19 19:55:34.694525 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1680/3246] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:34.737679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:34.739178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:34.751115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.754499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.758954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.759812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.956543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:34.965689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:34.980606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.981918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.983567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:34.984765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:34.997088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.004256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:35.006972 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05345f5d-3f62-497a-851c-3a16ccbc396d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.279183 Jul 19 19:55:35.007636 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1567/3247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:34 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:35.035714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.036567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:35.045380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.046122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.047584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.048857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.232885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.251605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.255120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.257805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec1b3488-c707-46f6-a02e-2aaff7db0765 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1338 microversion: 2.47 time: 0.239305 Jul 19 19:55:35.260549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1568/3248] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:35.318178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:35.331502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4663af73-abb7-416e-9742-0801ca21be5b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1304 microversion: 2.1 time: 0.379938 Jul 19 19:55:35.333724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1681/3249] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:34 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1304 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:35.660982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:35.662386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] [instance: 912f324c-8dc0-44bf-960f-97db3ac3760c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:35.671658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.672745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.673768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:35.674792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:35.731706 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] HTTP exception thrown: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Request method failure captured: Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c HTTP/1.1 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwOmxBaOGTE_ry5t__EeYfoeHyWaQRbEFBUnZIxiASvven8y1I1Zl3HGiCM_XgVGerZHNIdTGVO5fRVP0ng1QYNJV29xB0_Nu2IkaPKLn0MMGA0IAmie6jBr1_u3hySJQKHS5bRJs6I-TMfQ-7V5zyaCNh5VpgER2Ac0CXV8V1yFVo Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d7dea7b0f3824690aac8d043aa93fa51 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsTestJSON-288472194 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7dea7b0f3824690aac8d043aa93fa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7dea7b0f3824690aac8d043aa93fa51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7dea7b0f3824690aac8d043aa93fa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7dea7b0f3824690aac8d043aa93fa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsTestJSON-288472194 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d7dea7b0f3824690aac8d043aa93fa51 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsTestJSON-288472194 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsTestJSON-288472194-project Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 52508b8b455c487da99b756309175f16 Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsTestJSON-288472194-project Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '912f324c-8dc0-44bf-960f-97db3ac3760c'} Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:35.734005 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. Jul 19 19:55:35.738978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:35.741986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] Returning 404 to user: Instance 912f324c-8dc0-44bf-960f-97db3ac3760c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:35.743326 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e5c364f-1b39-4a98-ab14-09e290b082f8 tempest-InstanceActionsTestJSON-288472194 tempest-InstanceActionsTestJSON-288472194-project] 10.222.0.23 "GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c" status: 404 len: 111 microversion: 2.1 time: 0.088080 Jul 19 19:55:35.751661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1569/3250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:35 2022] GET /compute/v2.1/servers/912f324c-8dc0-44bf-960f-97db3ac3760c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:55:36.025203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:36.027042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:36.035004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.035777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.036804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.037458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.281204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:36.281830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:36.291789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.295339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.297855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.299629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.490164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:36.500303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:36.502142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:36.503958 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce35de1d-3710-4c2e-8504-1736f1257f1c tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1336 microversion: 2.47 time: 0.226695 Jul 19 19:55:36.517505 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1570/3251] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:36 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1336 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:36.523447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:36.524413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:36.533097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.533809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.534842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:36.535557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:36.542123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:36.550571 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb8bbca6-c52f-4349-a9a0-e307e9ef3a91 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1325 microversion: 2.1 time: 0.530183 Jul 19 19:55:36.551967 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1682/3252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:36 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1325 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:36.792602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:36.805839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d81024c6-4e97-42f0-acfe-178f9ef10751 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.286700 Jul 19 19:55:36.806758 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1571/3253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:36 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:37.526347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.527527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:37.540387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.540922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.541812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.542324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.572496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.573270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:37.581299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.585720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.593588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.594690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.668693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.682364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.684536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.686248 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a7bd8313-4c65-4141-9da6-f82075f587ff tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1336 microversion: 2.47 time: 0.164111 Jul 19 19:55:37.687574 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1683/3254] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:37.828605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.830446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:37.840630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.841396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.842403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.843647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.883957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:37.900379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-792a732e-6b04-4260-9f20-2e4ec40df1f2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.332274 Jul 19 19:55:37.901489 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1572/3255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:37.917851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:37.919051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:37.925827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.926569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:37.927699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:37.928470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.285831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:38.296031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:38.330204 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f18f711-b002-438c-97cb-5ba4f822b0c5 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.509812 Jul 19 19:55:38.342754 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1684/3256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:38.347735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a1c0711-3ca3-4ff4-a672-157fc5b2959c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.432614 Jul 19 19:55:38.348468 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1573/3257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:37 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:38.366369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5354f57-2027-46d7-822e-189e34a21558 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1056746468", "metadata": {"": ""}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5354f57-2027-46d7-822e-189e34a21558 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action HTTP/1.1 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 107 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1056746468", "metadata": {"": ""}}} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1056746468', 'metadata': {'': ''}}}} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'': ''} Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:38.370209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5354f57-2027-46d7-822e-189e34a21558 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5354f57-2027-46d7-822e-189e34a21558 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action" status: 400 len: 170 microversion: 2.1 time: 0.009584 Jul 19 19:55:38.376662 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1685/3258] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Jul 19 19:55:38 2022] POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action => generated 170 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:38.384352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:38.384881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:38.393659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.394115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.400106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.400989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.696270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:38.706780 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4cba66e-792d-483b-9f8c-8d0f0b006411 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.326880 Jul 19 19:55:38.709424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:38.710229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:38.714529 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1574/3259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:38 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:38.721622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.729282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.730217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.730683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.731849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:38.732774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:38.748434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.748759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:38.749557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:38.749988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.306318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.318549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.321241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.323452 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e66be11e-4c65-4bc0-8029-5f2918c54e43 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1336 microversion: 2.47 time: 0.621462 Jul 19 19:55:39.324397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1686/3260] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:38 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1336 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:39.349266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.350158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:39.352772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:39.359859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.363563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.365004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.365396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.528666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.539393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b34131be-1aa0-4fb6-bade-8aa9f8146ac8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.812377 Jul 19 19:55:39.540735 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1575/3261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:38 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:39.557258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2944cfa6-73c8-4b69-adec-ca55c82aa18e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-781019256", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2944cfa6-73c8-4b69-adec-ca55c82aa18e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action HTTP/1.1 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 618 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-781019256", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-781019256', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:55:39.560664 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:55:39.563876 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:39.569271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2944cfa6-73c8-4b69-adec-ca55c82aa18e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:39.570275 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2944cfa6-73c8-4b69-adec-ca55c82aa18e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action" status: 400 len: 938 microversion: 2.1 time: 0.018056 Jul 19 19:55:39.570959 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1576/3262] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Jul 19 19:55:39 2022] POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:55:39.584247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.590880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:39.601938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.602494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.603383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.603831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.844866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.862056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3187c61c-0426-434e-88ad-3d0c7357a3bd tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.518368 Jul 19 19:55:39.862873 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1687/3263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:39 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:39.950354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:39.960732 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1eff2657-00e1-4f2c-8de4-ee7603d0e7ea tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.382563 Jul 19 19:55:39.961213 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1577/3264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:39 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:39.981121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:39.981746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:39.988175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.988841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:39.989823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:39.990456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.345487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.346365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.354982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.355741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.356946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.357714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.404124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.412821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dbf8ace-677b-4e9c-8b1d-2c235200fc81 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.435511 Jul 19 19:55:40.413472 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1688/3265] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:39 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:40.432389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62d7c7f7-c5eb-4008-ad4c-f13ee272b660 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62d7c7f7-c5eb-4008-ad4c-f13ee272b660 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action HTTP/1.1 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 285 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.436021 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:40.440382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62d7c7f7-c5eb-4008-ad4c-f13ee272b660 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:40.442597 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62d7c7f7-c5eb-4008-ad4c-f13ee272b660 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action" status: 400 len: 619 microversion: 2.1 time: 0.013746 Jul 19 19:55:40.444271 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1689/3266] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Jul 19 19:55:40 2022] POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:55:40.450559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.451209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.459719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.463034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.463034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.463034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.493721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.515430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.519153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.520788 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-272bfecb-3164-4e5d-ac2f-42ebd230a5ca tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1357 microversion: 2.47 time: 0.180951 Jul 19 19:55:40.522113 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1578/3267] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:40.545046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:40.547412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.560588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.561425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.563088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.564503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.679534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:40.679793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:40.682150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:40.682457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:40.682799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:40.786818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.797029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.797536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.798342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.798861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.832478 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7b7ccc5-ba4a-4cbc-872b-8dabc0a6d8d3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "POST /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88/action" status: 202 len: 1079 microversion: 2.47 time: 0.291609 Jul 19 19:55:40.843999 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1579/3268] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 19 19:55:40 2022] POST /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88/action => generated 1079 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 19 19:55:40.850773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.851544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.866740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.867558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.871526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.872156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.873877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:40.885544 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c943ec8d-8899-45c5-a33d-b371a08d1fff tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.439489 Jul 19 19:55:40.891578 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1690/3269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:40.897100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:40.900658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:40.918653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.919616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.920727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:40.921424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:40.992858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.005336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.009770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.016001 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a392b499-b038-4c69-be2b-2b9403adffbe tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.170135 Jul 19 19:55:41.017994 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1580/3270] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:41.038280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:41.051841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:41.060435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.061329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.062751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.063573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.319799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.334901 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-471e9c60-c33e-4ac6-88df-f8bbb2eb1fd6 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.437846 Jul 19 19:55:41.336219 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1691/3271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:40 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:41.399967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:41.409664 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-552105c5-abb4-4d29-a424-0dec8aa7d0e8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 0.375303 Jul 19 19:55:41.410610 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1581/3272] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:41 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:41.429602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-560045766"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:41.430663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:41.439369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:41.448598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.449051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.449845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.450255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.813787 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bf3e087-12f1-4030-a0b3-90e4e017acd8 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action" status: 202 len: 0 microversion: 2.1 time: 0.388275 Jul 19 19:55:41.815494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1692/3273] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:41 2022] POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 19:55:41.843011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1112137112"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:41.843011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:41.866417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.867003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.867860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:41.868690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:41.904396 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Cannot 'createImage' instance 51746b8f-103e-494e-bdd3-6dd50755575c while it is in task_state image_snapshot_pending Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action HTTP/1.1 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 85 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1112137112"}} Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'createImage' instance 51746b8f-103e-494e-bdd3-6dd50755575c while it is in task_state image_snapshot_pending Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1112137112'}}} Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51746b8f-103e-494e-bdd3-6dd50755575c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 19:55:41.906288 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 51746b8f-103e-494e-bdd3-6dd50755575c while it is in task_state image_snapshot_pending Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 51746b8f-103e-494e-bdd3-6dd50755575c while it is in task_state image_snapshot_pending Jul 19 19:55:41.910281 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:55:41.912571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 409 to user: Cannot 'createImage' instance 51746b8f-103e-494e-bdd3-6dd50755575c while it is in task_state image_snapshot_pending {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:41.913583 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3dee7d40-5fb0-4a1a-80b9-b0615a910678 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action" status: 409 len: 167 microversion: 2.1 time: 0.089045 Jul 19 19:55:41.914253 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1582/3274] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:55:41 2022] POST /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c/action => generated 167 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:55:41.923536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0d128b2-25d4-4816-ac34-c2a0fe2a6ee7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f23ef924820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.046529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.047823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:42.057328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.057936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.059809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.060593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.061231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:42.093218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0d128b2-25d4-4816-ac34-c2a0fe2a6ee7 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/images/cf2668e6-6203-4efd-abb4-abedf20b8e6c" status: 204 len: 0 microversion: 2.1 time: 0.173928 Jul 19 19:55:42.094237 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1693/3275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:41 2022] DELETE /compute/v2.1/images/cf2668e6-6203-4efd-abb4-abedf20b8e6c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:55:42.103025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.104479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:42.111173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=22 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:42.128734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.129525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.130541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.132903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.156166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.165615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.167189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.168793 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9bbf459c-d4af-4a7f-8af8-35911a0018e1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.134693 Jul 19 19:55:42.170218 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1583/3276] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:42 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:42.355159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:42.356565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:42.365220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.366188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.367444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.367759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:42.368298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:42.386972 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3a61237-c177-4319-96b6-c6387a7c8c9b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1533 microversion: 2.1 time: 0.287769 Jul 19 19:55:42.388025 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1694/3277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:42 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1533 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:42.389780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:42.581903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:42.595324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc18d68a-102d-4d4f-a6f5-73c9670d39d8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.245599 Jul 19 19:55:42.608879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1584/3278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:42 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:43.191755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.193153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.204022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.204837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.206051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.206712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.302595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.314636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.317687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.319784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e096705a-19d1-46e5-80ec-62957fd46f53 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.133482 Jul 19 19:55:43.321374 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1695/3279] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:43 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:43.405374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.406642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.416756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.417198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.419906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.420337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.592324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.600364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1011472c-23aa-4d0e-b9eb-579060cb97de tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1539 microversion: 2.1 time: 0.199867 Jul 19 19:55:43.611428 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1585/3280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:43 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:43.618998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:43.619910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:43.629129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.629938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.630973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:43.631712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:43.938594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:43.956109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b4278e04-e978-403c-b1e0-501e7bfbeec9 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.343556 Jul 19 19:55:43.957884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1696/3281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:43 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:44.344867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.346075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.367164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.369513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.370676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.373414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.619116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.620211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.625768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:44.635146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.635974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:44.637206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.648794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:44.652955 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4281cd2a-70f7-460e-be50-33c12fec5b2e tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.316571 Jul 19 19:55:44.656167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1586/3282] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:44.662154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.663867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.973685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:44.974627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:44.982250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.982699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:44.989754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:44.990403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.261268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.280809 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16390b04-0af7-4094-9346-ac0eee9df93a tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1539 microversion: 2.1 time: 0.666923 Jul 19 19:55:45.282146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1697/3283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1539 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:45.516729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.532778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40f2c8d2-1d8c-4471-aaf5-b0edebf9840a tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.562166 Jul 19 19:55:45.538438 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1587/3284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:44 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:45.673933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:45.675242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:45.693031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.693803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.694823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:45.695468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:45.869451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.886383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.887956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:45.889423 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3572945c-baf6-4260-8d8a-eb3e1d6a14a3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.219504 Jul 19 19:55:45.893315 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1698/3285] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:45 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:46.299819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:46.302266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:46.331243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.332988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.335925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.339872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.554248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:46.555181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:46.566205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.567024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.568218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:46.569837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:46.640828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:47.460380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.475096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8fbec9ee-ebe7-4a43-968c-ef35d8e78598 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.922374 Jul 19 19:55:47.476847 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1699/3286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:46 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:47.490053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.491520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.511453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.512206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.513145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.513705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.518009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.533909 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1bc0dbd6-342f-43b6-a6b9-1e5e9b7018d1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1521 microversion: 2.1 time: 1.238948 Jul 19 19:55:47.534769 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1588/3287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:46 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1521 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:47.551934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.552611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.559822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.560286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.561094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.561546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.608429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:55:47.643164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.680330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.683186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:47.687414 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a07495d-1e9b-4c2d-b22a-7a271d3bc903 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.207230 Jul 19 19:55:47.702738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1700/3288] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:47 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:47.775439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e715797b-11df-4b97-8433-9f3261b53ac2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 204 len: 0 microversion: 2.1 time: 0.228318 Jul 19 19:55:47.779609 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1589/3289] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:55:47 2022] DELETE /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:55:47.785914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:47.786680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:47.833160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.834139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:47.835293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:47.836262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.161854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:48.182999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd42ba47-eb66-4eec-85d3-f51d4b353621 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1527 microversion: 2.1 time: 0.394182 Jul 19 19:55:48.184117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1701/3290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:47 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1527 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:48.496065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:48.497122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:48.508816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.511598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.513128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.513549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.662440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-028a11f8-fa96-4f59-be2c-8351e3f3a064 req-bbdd0d97-95db-4a78-9f44-aad41ba24f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451fa00b-e484-4703-8fc5-84598e7262c1", "name": "network-vif-plugged", "status": "completed", "tag": "7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:48.709707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-028a11f8-fa96-4f59-be2c-8351e3f3a064 req-bbdd0d97-95db-4a78-9f44-aad41ba24f1e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.711846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-028a11f8-fa96-4f59-be2c-8351e3f3a064 req-bbdd0d97-95db-4a78-9f44-aad41ba24f1e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.769502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-028a11f8-fa96-4f59-be2c-8351e3f3a064 req-bbdd0d97-95db-4a78-9f44-aad41ba24f1e service nova] Creating event network-vif-plugged:7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8 for instance 451fa00b-e484-4703-8fc5-84598e7262c1 on n-h1-843834-3 Jul 19 19:55:48.791412 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-028a11f8-fa96-4f59-be2c-8351e3f3a064 req-bbdd0d97-95db-4a78-9f44-aad41ba24f1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148354 Jul 19 19:55:48.794601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1702/3291] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:55:48.819186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:48.825521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:48.863775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.871733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:48.873090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:48.873782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.058838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.080827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.087101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.089193 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-87952d4e-d978-45b3-9ab0-7d0919dbf1cf tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.293058 Jul 19 19:55:49.089972 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1703/3292] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:48 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:49.127392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.145856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3551772-6a5f-4a46-9d47-da16b9a61e49 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.654278 Jul 19 19:55:49.157846 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1590/3293] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:48 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:49.201010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:49.202237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:49.219591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.220046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.220855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:49.232287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:49.534881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:49.544177 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-179dabaf-46e4-4b17-ab87-f69beebc5a99 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1527 microversion: 2.1 time: 0.347569 Jul 19 19:55:49.554958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1704/3294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:49 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:50.108827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:50.113362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:50.121061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.121517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.122305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.122738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.166846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:50.168420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:50.184675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.185565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.188668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.189396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.386834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:50.407511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:50.410343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:50.417000 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3130f19d-cd3c-4095-91e7-2ff6dbbff104 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.312676 Jul 19 19:55:50.434268 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1591/3295] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:50 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:50.567856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:50.570841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:50.576975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:50.580603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.581605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.582617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:50.583338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:50.586311 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f269857-3aa0-426f-8d28-317f2b5485da tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1292 microversion: 2.1 time: 0.424968 Jul 19 19:55:50.601070 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1705/3296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:50 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:50.971492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.003024 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-482394ae-cd29-4efd-8e13-0d2e31475a13 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1527 microversion: 2.1 time: 0.441387 Jul 19 19:55:51.007547 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1592/3297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:50 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:51.441946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:51.442555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:51.462176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.462864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.465185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.467505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.612692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.617050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:51.621182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:51.644061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.649199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.649552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.650575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:51.651234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:51.654168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:51.656949 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2f69d90-81fb-4465-96fb-542a7f9822a7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.219083 Jul 19 19:55:51.663051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1706/3298] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:51 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:52.021061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.021708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.035937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.036413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.037234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.037691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.053001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.074729 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2ddad955-5715-4379-8b88-c2ded00504a3 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1483 microversion: 2.1 time: 0.468692 Jul 19 19:55:52.076129 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1593/3299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:51 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1483 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:52.108355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.109253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.120187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.121517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.124790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.125907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.421569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.434403 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f50b677d-92cb-4015-b022-0a941637e718 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 200 len: 1485 microversion: 2.1 time: 0.414595 Jul 19 19:55:52.436002 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1707/3300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 1485 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:52.444800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb32e878-5006-449b-b3fd-802e2d8f6ec8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.346467 Jul 19 19:55:52.444800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1594/3301] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:55:52.447026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8c13e6fd-bc75-4e3b-a8d7-a074281595d7 req-13a8ba8a-27d5-4012-938c-df60fe1061b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51746b8f-103e-494e-bdd3-6dd50755575c", "name": "network-vif-deleted", "tag": "967e1b5c-4d73-49e5-a378-ffc0c18c3083"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:52.460517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c13e6fd-bc75-4e3b-a8d7-a074281595d7 req-13a8ba8a-27d5-4012-938c-df60fe1061b4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.460978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c13e6fd-bc75-4e3b-a8d7-a074281595d7 req-13a8ba8a-27d5-4012-938c-df60fe1061b4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.476873 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8c13e6fd-bc75-4e3b-a8d7-a074281595d7 req-13a8ba8a-27d5-4012-938c-df60fe1061b4 service nova] Creating event network-vif-deleted:967e1b5c-4d73-49e5-a378-ffc0c18c3083 for instance 51746b8f-103e-494e-bdd3-6dd50755575c on n-h2-843834-3 Jul 19 19:55:52.482837 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8c13e6fd-bc75-4e3b-a8d7-a074281595d7 req-13a8ba8a-27d5-4012-938c-df60fe1061b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043645 Jul 19 19:55:52.483498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1595/3302] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:52.680550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:52.681241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:52.698626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.699123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.699970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:52.700414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:52.861697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.876924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.881675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:52.883912 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9a859ee-b736-400f-952e-8bfb4cf7333a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.207317 Jul 19 19:55:52.887668 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1708/3303] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:52 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:53.058677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1384807881", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5c2d2c57-d981-46eb-85ca-737bd8619b62"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:53.130682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] validate_networks() for [('5c2d2c57-d981-46eb-85ca-737bd8619b62', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:53.452867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.453496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.468759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.469148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.470141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.470588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.500547 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c HTTP/1.1 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c'} Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:53.502290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:55:53.508318 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-807958f6-6c99-4204-8854-4b511ff3af11 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 404 len: 111 microversion: 2.1 time: 0.055137 Jul 19 19:55:53.511007 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1709/3304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:53 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:55:53.516180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32bc0672-9602-44e3-af47-9291d375786c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'create', calling method: .version_select at 0x7f23ef808e50>, body: {"keypair": {"name": "tempest-keypair-1099300258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHspkHsrpnSbBXQUVFeWN5VObNPlHZ09o2SEXqpw2NP/2QMaFUCBZixIqjtshBExbvC4laIqlrSaFRGHjXupWltjRh8+fGpV1wvp15U5YCcv0zMAvv0Uu6eIN9Vh3DVqEg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:53.532015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-32bc0672-9602-44e3-af47-9291d375786c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for project 313f01989837474e9072dd49cc2b501a. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:53.537870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-32bc0672-9602-44e3-af47-9291d375786c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for user 15202808da354b619062b62fcd6ef782 and project 313f01989837474e9072dd49cc2b501a. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:53.565953 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32bc0672-9602-44e3-af47-9291d375786c tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053713 Jul 19 19:55:53.572897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1710/3305] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:55:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:55:53.912346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:53.913240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:53.928749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.929211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:53.930168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:53.930513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.048243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.064391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.066246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.068113 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75877e60-90fa-4e89-b082-e81e4cdb09d0 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.166173 Jul 19 19:55:54.069243 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1711/3306] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:53 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:54.189503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:54.190024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:54.190454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:54.191014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:54.191395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:54.208231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.209374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.210510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.211478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.238297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Getting quotas for project 5a3a044f20af4080bc608b86ff959be8. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:54.244400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Getting quotas for user 6598aef7c1c3442486f9b4f45d86d000 and project 5a3a044f20af4080bc608b86ff959be8. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:54.265174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Going to run 2 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:54.268307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:54.308935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:54.320459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:54.439705 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-804dfca3-435e-485e-abab-abc5adb751b2 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678627 Jul 19 19:55:54.442757 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1596/3307] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:55:54.464153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:54.491366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.496362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Searching by: {'deleted': False, 'project_id': '5a3a044f20af4080bc608b86ff959be8'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:55:54.556671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.559263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.560861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:54.562600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:54.610525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e8aa128-4f99-420c-8400-8892032e688d tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.159105 Jul 19 19:55:54.613646 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1712/3308] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:55:54 2022] GET /compute/v2.1/servers => generated 677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:54.626437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08eb8571-8056-4f7b-ae25-1e2c18c5eeca tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:54.627373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08eb8571-8056-4f7b-ae25-1e2c18c5eeca tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:54.733212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08eb8571-8056-4f7b-ae25-1e2c18c5eeca tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:54.750824 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08eb8571-8056-4f7b-ae25-1e2c18c5eeca tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1220 microversion: 2.1 time: 0.128958 Jul 19 19:55:54.763197 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1597/3309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:54 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1220 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:55.090170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:55.091063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:55.147089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.148137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.151598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.154039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.327613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:55.342596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:55.344174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:55.345416 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4547b625-e355-4279-9f4e-34c67bb2ffc8 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.261293 Jul 19 19:55:55.358955 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1713/3310] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:55 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:55:55.439281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:55.439902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:55.460307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.460798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.461684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.462397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.482639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1198138c-5320-4159-ba51-a30bcd7465ba req-a7202c13-c2c0-4da8-a259-b737463439bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451fa00b-e484-4703-8fc5-84598e7262c1", "tag": "7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:55.499496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1198138c-5320-4159-ba51-a30bcd7465ba req-a7202c13-c2c0-4da8-a259-b737463439bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.499707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1198138c-5320-4159-ba51-a30bcd7465ba req-a7202c13-c2c0-4da8-a259-b737463439bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.551913 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1198138c-5320-4159-ba51-a30bcd7465ba req-a7202c13-c2c0-4da8-a259-b737463439bd service nova] Creating event network-changed:7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8 for instance 451fa00b-e484-4703-8fc5-84598e7262c1 on n-h1-843834-3 Jul 19 19:55:55.572105 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1198138c-5320-4159-ba51-a30bcd7465ba req-a7202c13-c2c0-4da8-a259-b737463439bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093468 Jul 19 19:55:55.573319 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1714/3311] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:55:55.770076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:55.770791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:55.790674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.791187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.791980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:55.792423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:55.842328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:55.851480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4f8cb842-50ea-41b8-aee8-25c6ee257f8c tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1483 microversion: 2.1 time: 0.416012 Jul 19 19:55:55.852406 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1598/3312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:55 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1483 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:56.364027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:56.364922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:56.379359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.380236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.381273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:56.381964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:56.826051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:56.841920 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4fcca799-34bb-4cc7-8e64-6d3b8f983f24 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1224 microversion: 2.1 time: 1.075092 Jul 19 19:55:56.842595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1715/3313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:55 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1224 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:57.129030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:57.146606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:57.155127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:57.160989 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1473296b-467e-4c06-812e-7aef953ea7c7 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.800756 Jul 19 19:55:57.162776 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1599/3314] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:56 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:57.621468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-82500325", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:55:57.690613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] validate_networks() for [('2f1427c7-5a01-4952-a2be-ab5593970bf4', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:55:57.860212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:57.860845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:57.869455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:57.870309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:57.871418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:57.872115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.053601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.074219 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52202c1f-d4d1-49fd-9f08-8b631d0d6b37 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1278 microversion: 2.1 time: 0.218456 Jul 19 19:55:58.098214 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1600/3315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:57 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:55:58.181485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:58.182866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:58.191328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.192015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.193012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.193488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.387343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.393310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:55:58.421318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.423601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:58.428559 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6dfb2198-51b5-4d8f-bcc6-747d5c7d69ea tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.247871 Jul 19 19:55:58.429571 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1601/3316] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:58 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:55:58.936036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:55:58.937164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:55:58.937905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:55:58.938694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:55:58.939502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:55:58.963882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.965018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:58.968244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:58.970276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.020457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:55:59.035156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for user 15202808da354b619062b62fcd6ef782 and project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:55:59.074870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:55:59.080149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:55:59.095399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:59.096936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:59.146834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.151322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.152469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.153135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.175557 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07e0ea59-98f3-43eb-809c-cd3eb84147ef tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.558310 Jul 19 19:55:59.180528 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1716/3317] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:55:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:55:59.197596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bac9bf0-3e69-4192-ba9c-bbc2c7cf418e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:59.198616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0bac9bf0-3e69-4192-ba9c-bbc2c7cf418e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:59.479333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0bac9bf0-3e69-4192-ba9c-bbc2c7cf418e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.488060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bac9bf0-3e69-4192-ba9c-bbc2c7cf418e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1223 microversion: 2.1 time: 0.301028 Jul 19 19:55:59.499659 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1717/3318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:59 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1223 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:59.514051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:55:59.514821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:55:59.525057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.525891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.526991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:55:59.527663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:55:59.825164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.834380 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9b59c94-d8c2-4625-bb3a-dbbef5db4ded tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.746440 Jul 19 19:55:59.838601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1602/3319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:55:59 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:55:59.839965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.857717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.859775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:55:59.869708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e4c82a9-5547-4425-bfd1-a42c383f5a40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.377481 Jul 19 19:55:59.870491 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1718/3320] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:55:59 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:00.507951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:00.508983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:00.517008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.517903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.519026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.519768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.660234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:00.669493 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a360aeb-9004-4851-8ce7-61e426f507ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1275 microversion: 2.1 time: 0.165756 Jul 19 19:56:00.670098 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1603/3321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:00 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:00.855244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:00.856814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:00.872271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.873031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.874049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.874738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.890561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:00.892395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:00.910066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.911004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:00.912056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:00.912687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.198324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.207354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.209198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.210587 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9bbc5d64-e852-41b8-a546-a0276a4551f1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.324853 Jul 19 19:56:01.211272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1604/3322] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:00 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:01.457492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.467912 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78759b32-bc62-49b0-836d-dade1ab95df5 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.617310 Jul 19 19:56:01.478524 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1719/3323] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:00 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:01.631376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9bbddc1b-c644-4bde-b03f-20022dfbb283 req-97207a59-eead-43de-92fb-133996551b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2432a73-f653-47ed-9a48-cf0680e9f786", "tag": "f346f57d-b989-4991-b2c5-556d42cd8b94"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:01.669438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9bbddc1b-c644-4bde-b03f-20022dfbb283 req-97207a59-eead-43de-92fb-133996551b43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.673971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9bbddc1b-c644-4bde-b03f-20022dfbb283 req-97207a59-eead-43de-92fb-133996551b43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.689378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:01.690012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:01.709788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.710334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.723490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:01.724070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:01.734183 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9bbddc1b-c644-4bde-b03f-20022dfbb283 req-97207a59-eead-43de-92fb-133996551b43 service nova] Creating event network-changed:f346f57d-b989-4991-b2c5-556d42cd8b94 for instance e2432a73-f653-47ed-9a48-cf0680e9f786 on n-h1-843834-3 Jul 19 19:56:01.751893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9bbddc1b-c644-4bde-b03f-20022dfbb283 req-97207a59-eead-43de-92fb-133996551b43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125572 Jul 19 19:56:01.753938 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1605/3324] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:01.914125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:01.926447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fe5c228e-85f1-4d9d-9050-9a5b7361e1ed tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1281 microversion: 2.1 time: 0.243235 Jul 19 19:56:01.935765 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1720/3325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:01 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:02.230703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.231769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.246560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.246560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.247136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.247499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.470699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.485448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.486217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.489464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.492384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:02.494071 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd90af2e-f6df-4b45-932a-c8c61794da6a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.267888 Jul 19 19:56:02.501469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.501601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.502379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.502819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.508044 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1606/3326] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:02.525550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:02.952334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:02.953704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:02.965487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.966346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:02.967970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:02.969736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.262069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.271331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8138428a-673c-42a5-b7e2-172b4c342116 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.789664 Jul 19 19:56:03.281572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1721/3327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:03.287155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.288728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.296135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.296664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.297562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.298084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.335955 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af9ec734-1962-4c4b-97fd-e5eab49de02a tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052801 Jul 19 19:56:03.337217 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1722/3328] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:03.414837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.415745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.423073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.423533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.424354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.425179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.454391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:03.489821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.507981 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f2d4f03a-e319-48a3-a567-f87626f4f698 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.559548 Jul 19 19:56:03.509684 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1607/3329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:02 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:03.516271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.517498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.526801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.528092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.529254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.530063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.575855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:03.593308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac0fa6ef-2dfb-4f3d-a2e6-7595ffec1b36 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 204 len: 0 microversion: 2.20 time: 0.182550 Jul 19 19:56:03.595262 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1723/3330] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:03 2022] DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 19:56:03.607241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:03.609869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:03.622025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.622687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.624715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.625674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.647217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.663542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.666173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.668367 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f001fb8-8cce-4519-9cc5-439053e7420d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.157461 Jul 19 19:56:03.682415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1608/3331] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:03.806694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ee17cb03-e066-4989-9156-3e2786beadc2 req-38744a28-5b2a-48a8-a284-4a6119b42d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778", "tag": "110196a3-b467-4f9b-8f6a-c2fcf6364ad7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:03.817953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ee17cb03-e066-4989-9156-3e2786beadc2 req-38744a28-5b2a-48a8-a284-4a6119b42d59 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:03.818791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ee17cb03-e066-4989-9156-3e2786beadc2 req-38744a28-5b2a-48a8-a284-4a6119b42d59 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:03.839611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ee17cb03-e066-4989-9156-3e2786beadc2 req-38744a28-5b2a-48a8-a284-4a6119b42d59 service nova] Creating event network-changed:110196a3-b467-4f9b-8f6a-c2fcf6364ad7 for instance f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 on n-h1-843834-3 Jul 19 19:56:03.845912 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ee17cb03-e066-4989-9156-3e2786beadc2 req-38744a28-5b2a-48a8-a284-4a6119b42d59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043161 Jul 19 19:56:03.846565 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1609/3332] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:03.902444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.916614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.918605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:03.920112 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81e85211-2efa-4b6c-8579-490b9d081e54 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.320095 Jul 19 19:56:03.921615 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1724/3333] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:03 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:04.289383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.290730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:04.297204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:04.301043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.302000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.303962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.304681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.431354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c328451d-a19a-40e3-9941-b8c517093698 req-3fd45e5f-1635-4bb2-9460-6ac1c5f841e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcc3764-65b9-481e-b124-61ed7b7acae6", "tag": "f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:04.455812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c328451d-a19a-40e3-9941-b8c517093698 req-3fd45e5f-1635-4bb2-9460-6ac1c5f841e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.456616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c328451d-a19a-40e3-9941-b8c517093698 req-3fd45e5f-1635-4bb2-9460-6ac1c5f841e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.473641 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c328451d-a19a-40e3-9941-b8c517093698 req-3fd45e5f-1635-4bb2-9460-6ac1c5f841e4 service nova] Creating event network-changed:f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944 for instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 on n-h2-843834-3 Jul 19 19:56:04.480233 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c328451d-a19a-40e3-9941-b8c517093698 req-3fd45e5f-1635-4bb2-9460-6ac1c5f841e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061226 Jul 19 19:56:04.481971 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1725/3334] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:04.538879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.540054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:04.549276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.549932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.551081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.551727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.739276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:04.930739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:04.940538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b551e725-756d-404b-bcbf-719c0d0ec11e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.418249 Jul 19 19:56:04.941361 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1726/3335] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:04 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:04.949528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:04.950897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:04.964619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.965120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.965990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:04.968405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:04.997137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.009333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-feb32f89-e56c-4918-8c2c-0954965ff088 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.723475 Jul 19 19:56:05.024303 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1610/3336] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:04 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:05.031688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:05.032752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:05.053944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.064921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.069127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.072689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.144954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.160861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.162847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.164130 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-451bb55b-a298-484d-a69c-3144d5b625d9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.221950 Jul 19 19:56:05.175758 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1727/3337] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:04 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:05.365000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.374464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.376202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:05.377838 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23534380-05d8-4df6-8507-5660e5b44489 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.351894 Jul 19 19:56:05.378662 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1611/3338] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:05 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:05.958563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:05.960090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:05.967111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.967919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:05.968983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:05.969656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.029040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:06.030545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:06.042967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.043701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.045355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.046096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.838590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.851024 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-509a3713-cac9-4966-8898-21454cdefd6b tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.896197 Jul 19 19:56:06.851639 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1728/3339] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:05 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:06.859440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:06.860350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:06.873987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.874485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.881634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.882433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.922018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:06.936814 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fce437e-61d0-4247-af60-1409f41f506b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.914452 Jul 19 19:56:06.940687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1612/3340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:06 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:06.948001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:06.949759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:06.960162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.961551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:06.962783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:06.963508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.007607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.017519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.019505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.021182 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a210465-9a2b-474d-ae58-a281297b12b9 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.168455 Jul 19 19:56:07.022107 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1729/3341] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:06 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:07.333799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.345978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.348304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:07.349638 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19b64898-b295-4dc2-a0dc-9deb00977492 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.407769 Jul 19 19:56:07.350473 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1613/3342] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:06 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:07.870157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:07.871175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:07.880939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.881858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.883684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.884879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.957255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:07.958155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:07.966708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.967421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:07.968215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:07.968822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.100078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.108776 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa1e7913-f3f4-45aa-9264-edd235c7deb5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.243198 Jul 19 19:56:08.118952 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1730/3343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:07 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:08.129008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:08.131990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:08.153358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.155332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.157467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.158117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.250228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.254043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.262275 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ae641f9-2c12-43b0-b39c-9fedc655b59b tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.308875 Jul 19 19:56:08.272670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.272670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.272670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aadf211f-389b-4d43-b554-309acf9eeadd tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.150674 Jul 19 19:56:08.272670 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1731/3344] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:08 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:08.280137 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1614/3345] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:07 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:08.302365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c923d0ea-f180-42b6-8234-c8640437e7da req-5a27c276-1aa0-475d-8a84-fce531be3a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2432a73-f653-47ed-9a48-cf0680e9f786", "name": "network-vif-plugged", "status": "completed", "tag": "f346f57d-b989-4991-b2c5-556d42cd8b94"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:08.317157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c923d0ea-f180-42b6-8234-c8640437e7da req-5a27c276-1aa0-475d-8a84-fce531be3a17 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.317613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c923d0ea-f180-42b6-8234-c8640437e7da req-5a27c276-1aa0-475d-8a84-fce531be3a17 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.334467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c923d0ea-f180-42b6-8234-c8640437e7da req-5a27c276-1aa0-475d-8a84-fce531be3a17 service nova] Creating event network-vif-plugged:f346f57d-b989-4991-b2c5-556d42cd8b94 for instance e2432a73-f653-47ed-9a48-cf0680e9f786 on n-h1-843834-3 Jul 19 19:56:08.341875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c923d0ea-f180-42b6-8234-c8640437e7da req-5a27c276-1aa0-475d-8a84-fce531be3a17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068169 Jul 19 19:56:08.342514 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1732/3346] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:08.370099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:08.371202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:08.380695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.381320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.382372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.382817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.820602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.830504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.832459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23a43026b121469baad2d3978d113bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f78585de12146399a7ae194aae19e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:08.834040 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad927d17-2112-4ad1-975f-11218cad78dc tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 200 len: 1722 microversion: 2.20 time: 0.469661 Jul 19 19:56:08.835295 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1615/3347] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:08 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:08.974984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0ba5a4f7-2691-488e-91ee-ea11e99bdc38 req-3fde89cb-ba5b-4daa-ba48-2643764a50f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b3496-ca6b-454f-9ec8-9cec20f9e9f9", "name": "network-vif-deleted", "tag": "46219631-20b4-4afd-bbff-da87e9339ac1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:08.986881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0ba5a4f7-2691-488e-91ee-ea11e99bdc38 req-3fde89cb-ba5b-4daa-ba48-2643764a50f6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:08.987799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0ba5a4f7-2691-488e-91ee-ea11e99bdc38 req-3fde89cb-ba5b-4daa-ba48-2643764a50f6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:08.999272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:09.002753 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0ba5a4f7-2691-488e-91ee-ea11e99bdc38 req-3fde89cb-ba5b-4daa-ba48-2643764a50f6 service nova] Creating event network-vif-deleted:46219631-20b4-4afd-bbff-da87e9339ac1 for instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 on n-h1-843834-3 Jul 19 19:56:09.009294 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0ba5a4f7-2691-488e-91ee-ea11e99bdc38 req-3fde89cb-ba5b-4daa-ba48-2643764a50f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037650 Jul 19 19:56:09.009842 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1733/3348] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:09.125898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:09.126525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:09.134018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.134755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.135744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.136351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.284574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:09.285920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:09.294320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.294992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.295828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.296264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.488229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:09.607854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.616643 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03d100ed-a7d9-4715-8747-6d255a701423 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.494570 Jul 19 19:56:09.627565 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1616/3349] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:09 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:09.633405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:09.634254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:09.652443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.652977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.653863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.657473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.733463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.746599 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85da87d8-67a3-44e8-8f8b-c62f38fd6636 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1320 microversion: 2.1 time: 0.469051 Jul 19 19:56:09.760971 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1734/3350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:09 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:09.820225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.838420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.842873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:09.844664 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d79358e-fadb-4e18-8feb-29a83396fae6 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.215800 Jul 19 19:56:09.851972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:09.852883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:09.859423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1617/3351] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:09 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:09.868960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.869428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.870502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:09.875399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:09.898291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 HTTP/1.1 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '415b3496-ca6b-454f-9ec8-9cec20f9e9f9'} Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:09.900278 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:09.905612 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:09.908122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:09.909330 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d9fc76c-8ee1-4734-9383-449fb467bbff tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 404 len: 111 microversion: 2.20 time: 0.061658 Jul 19 19:56:09.910127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1735/3352] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:09 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:56:09.925035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2fb95b1-c777-4ecd-a2fe-4c46bd30d0d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '.version_select at 0x7f23ef315670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:09.981615 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2fb95b1-c777-4ecd-a2fe-4c46bd30d0d7 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-452594477" status: 204 len: 0 microversion: 2.20 time: 0.066034 Jul 19 19:56:09.982906 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1618/3353] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jul 19 19:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-452594477 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:10.401383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc3764-65b9-481e-b124-61ed7b7acae6", "name": "network-vif-plugged", "status": "completed", "tag": "f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944"}, {"server_uuid": "f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778", "name": "network-vif-plugged", "status": "completed", "tag": "110196a3-b467-4f9b-8f6a-c2fcf6364ad7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:10.426378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.435285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.461738 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] Creating event network-vif-plugged:f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944 for instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 on n-h2-843834-3 Jul 19 19:56:10.462253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] Creating event network-vif-plugged:110196a3-b467-4f9b-8f6a-c2fcf6364ad7 for instance f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 on n-h1-843834-3 Jul 19 19:56:10.482185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2eefc3d5-54c6-4f4e-b8c8-eeaf8f9b9901 req-6a29cfc6-f871-47dd-97fd-86d041b63f0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086687 Jul 19 19:56:10.482813 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1736/3354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:10.636992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:10.637897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:10.666893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.668089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.685488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.688167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.765664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:10.779195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:10.791516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.792234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:10.793432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:10.794028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:11.570058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.578790 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5bb65de-7bd0-42f2-89d8-7fa031410880 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.947512 Jul 19 19:56:11.588316 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1619/3355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:10 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:11.588316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.588316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:11.598545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:11.599180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:11.600190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:11.602076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:11.651084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.659586 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b54c9991-f7cf-43d2-97c0-11cb061b34cd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 200 len: 1509 microversion: 2.1 time: 0.898516 Jul 19 19:56:11.660325 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1737/3356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:10 2022] GET /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 1509 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:11.676520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:11.677432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:11.684367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:11.685391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:11.686436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:11.687303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:11.689433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.696537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:11.726514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.728446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.729886 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-75079bb7-8ce4-4d0e-a745-4ce83098d97b tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.147302 Jul 19 19:56:11.731374 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1620/3357] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:11 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:11.915682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:11.925679 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0a655f4-eea2-4d62-9631-356c076250cf tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778" status: 200 len: 1320 microversion: 2.1 time: 0.253136 Jul 19 19:56:11.926492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1738/3358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:11 2022] GET /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:12.596311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.596924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:12.613547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.613998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.614774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.615235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.752441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.753699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:12.762955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.763487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.764730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.765197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.793369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:12.880564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.891449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.893345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.895185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2bb1482-17e9-4641-a331-b9e6279c3c73 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1366 microversion: 2.47 time: 0.148664 Jul 19 19:56:12.895884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1739/3359] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:12.940384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:12.945106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:12.945996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:12.951964 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3a7e9fc-04a5-4bfb-b4c0-cd1201468094 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1323 microversion: 2.1 time: 0.358218 Jul 19 19:56:12.953170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1621/3360] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:12.957773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.958465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:12.959710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:12.960408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.321068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:13.335689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6d9b2b2-2405-4954-9d20-6d196f6bbffd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778" status: 200 len: 1508 microversion: 2.1 time: 0.395195 Jul 19 19:56:13.351135 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1740/3361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:12 2022] GET /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:13.357628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.358258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:13.374499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.374981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.378536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.379037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.432683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:13.564590 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00986fa7-d176-477e-b5b9-21f039b19e0c tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778" status: 204 len: 0 microversion: 2.1 time: 0.211810 Jul 19 19:56:13.566153 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1622/3362] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:13 2022] DELETE /compute/v2.1/servers/f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:13.576556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.577065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:13.587321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.588197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.589234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.590731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.626452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: e2432a73-f653-47ed-9a48-cf0680e9f786] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:13.790441 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d07fefd-d72d-4e59-a6ee-870b94eceea0 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786" status: 204 len: 0 microversion: 2.1 time: 0.218591 Jul 19 19:56:13.804056 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1741/3363] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:13 2022] DELETE /compute/v2.1/servers/e2432a73-f653-47ed-9a48-cf0680e9f786 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:13.914695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:13.915758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:13.932082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.932795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.934034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:13.935488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:13.937473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1307449509", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5c2d2c57-d981-46eb-85ca-737bd8619b62"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:14.019718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] validate_networks() for [('5c2d2c57-d981-46eb-85ca-737bd8619b62', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:14.046345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.061661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.063448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.065048 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa1ee220-891d-4f85-9007-6465764e6e93 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1372 microversion: 2.47 time: 0.155222 Jul 19 19:56:14.065788 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1623/3364] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:13 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:14.073167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:14.074116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:14.082925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.084199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.085068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.085543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.455300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.463309 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa2f1b65-61a8-4b85-8aaa-0593432c5121 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1519 microversion: 2.1 time: 0.395909 Jul 19 19:56:14.464166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1624/3365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:14 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1519 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:14.488681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:14.489540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:14.496399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.497155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.498229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.498841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.877173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:14.896446 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e29cdb89-d585-4338-b20b-3e3482e2f412 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1519 microversion: 2.1 time: 0.411371 Jul 19 19:56:14.897998 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1625/3366] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:14 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:14.914262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1450919706"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:14.915606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:14.935525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.936270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:14.937243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:14.937873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.216747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:15.217581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:15.218363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:15.219021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:15.219604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:15.250399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.255314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.256549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.267006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.302511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Getting quotas for project 5a3a044f20af4080bc608b86ff959be8. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:15.309351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Getting quotas for user 6598aef7c1c3442486f9b4f45d86d000 and project 5a3a044f20af4080bc608b86ff959be8. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:15.327781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Going to run 2 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:15.331511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:15.395745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0f56e4e-5973-47ab-ba4d-318b0f83fef2 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6/action" status: 202 len: 0 microversion: 2.1 time: 0.485089 Jul 19 19:56:15.403086 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1626/3367] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:56:14 2022] POST /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 19:56:15.410791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.411912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.413615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=93b71731-32bd-4f09-8cde-797d58349647,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:15.420439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.421213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.422247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.423126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.513756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-645342a1-6700-47c6-9c5f-b8f269f9deb9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.580027 Jul 19 19:56:15.519566 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1742/3368] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 1585 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 19:56:15.532053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:15.532459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dbccfff7-40b5-40c4-bb30-478883974aa1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f240095cb80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.547989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:15.550455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:15.554007 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6bc7b60d-c3e0-428c-b910-a1e1b02b8323 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1372 microversion: 2.47 time: 0.146521 Jul 19 19:56:15.557791 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1627/3369] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:15.566542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.567656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.592833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.596184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.597159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.597896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.634866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 HTTP/1.1 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '415b3496-ca6b-454f-9ec8-9cec20f9e9f9'} Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:15.637100 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.641495 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.644006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:15.647546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce854b98-da6e-4dae-bc39-a60bcf5a097b tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 404 len: 111 microversion: 2.20 time: 0.088360 Jul 19 19:56:15.651173 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1628/3370] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:15 2022] DELETE /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:15.660462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.670535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:15.673629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Searching by: {'deleted': False, 'project_id': '5a3a044f20af4080bc608b86ff959be8'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:56:15.731757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.733608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.736884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.738247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.797658 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dbccfff7-40b5-40c4-bb30-478883974aa1 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86" status: 204 len: 0 microversion: 2.1 time: 0.279163 Jul 19 19:56:15.799197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1743/3371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:15 2022] DELETE /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:15.803793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:56:15.819440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.822692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 415b3496-ca6b-454f-9ec8-9cec20f9e9f9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.840130 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2519d48f-e0ff-4357-ba53-bca099472e23 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.186791 Jul 19 19:56:15.842001 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1629/3372] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers => generated 1337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:15.854828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.855325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.856142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:15.862723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:15.868777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e5233c5-6b31-462a-a349-2a74683c6031 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f23ef3b09d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.918905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.923961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3e5233c5-6b31-462a-a349-2a74683c6031 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Image not found. Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 HTTP/1.1 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '415b3496-ca6b-454f-9ec8-9cec20f9e9f9'} Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.926762 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. Jul 19 19:56:15.932700 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e5233c5-6b31-462a-a349-2a74683c6031 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 HTTP/1.1 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86'} Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 19:56:15.933394 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 could not be found. Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:56:15.942332 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:15.946590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 415b3496-ca6b-454f-9ec8-9cec20f9e9f9 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:15.946590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35d2dcfa-14b5-424c-8b02-5a8d0049670f tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9" status: 404 len: 111 microversion: 2.20 time: 0.128322 Jul 19 19:56:15.946989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e5233c5-6b31-462a-a349-2a74683c6031 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:15.947157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1744/3373] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/415b3496-ca6b-454f-9ec8-9cec20f9e9f9 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:15.947157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dbbcecc7-b76c-466b-8cbc-fd2207a3f504 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.947157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dbbcecc7-b76c-466b-8cbc-fd2207a3f504 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:15.949407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3e5233c5-6b31-462a-a349-2a74683c6031 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86" status: 404 len: 62 microversion: 2.1 time: 0.104287 Jul 19 19:56:15.955484 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1630/3374] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:56:15.977568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:15.985021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:16.006774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:16.008015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.009709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:16.015344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.305354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dbbcecc7-b76c-466b-8cbc-fd2207a3f504 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.317780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dbbcecc7-b76c-466b-8cbc-fd2207a3f504 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1218 microversion: 2.1 time: 0.381054 Jul 19 19:56:16.332419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1745/3375] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1218 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:16.579581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:16.580222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:16.597484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:16.598409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.599630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:16.601477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:16.662624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:16.675737 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6af8f197-a38e-41d0-a785-c1835805fd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1531 microversion: 2.1 time: 0.716852 Jul 19 19:56:16.678698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1631/3376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:15 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1531 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:16.999772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.019489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.023898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.032425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14524864-a595-4417-bb0d-7b3d42b6174a tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1357 microversion: 2.47 time: 0.458135 Jul 19 19:56:17.033515 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1746/3377] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:16 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1357 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:17.052827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:17.064817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.065556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Searching by: {'deleted': False, 'project_id': 'e748b47201bc49e49662f79778770f14'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:56:17.089223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.089897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.090987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.091765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.337303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:17.338660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:17.357023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.357862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.358863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.359522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.403560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:56:17.508029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.517815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.518661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.535053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.537555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.946398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:17.954775 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f9ea942-6bed-4719-8620-051d5b7987cc tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1270 microversion: 2.1 time: 0.621857 Jul 19 19:56:17.964051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1747/3378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:17 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1270 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:17.969377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:17.970195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:17.990713 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e11dc858-f67a-4218-bb77-85e6057af4a1 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.943287 Jul 19 19:56:17.991937 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1632/3379] 10.222.0.23 () {60 vars in 1186 bytes} [Tue Jul 19 19:56:17 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:17.992679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.993428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:17.994442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:17.996325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.027395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:18.029376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:18.060660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.061173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.067178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.069716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.144680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:18.282621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:18.380444 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83931808-da35-4c30-be39-86d2f721dd02 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 204 len: 0 microversion: 2.47 time: 0.361563 Jul 19 19:56:18.386463 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1633/3380] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:18 2022] DELETE /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 19:56:18.405887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:18.407147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:18.416700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.416940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.418181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.418388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.674401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.692738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.694943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:18.709584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4918f8f0-97cd-4e4e-a84a-e1df1ea2fb68 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1363 microversion: 2.47 time: 0.313225 Jul 19 19:56:18.719310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1634/3381] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:18 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:18.726773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7e7ff80e-5af5-4002-b27e-bfb198c0bb5e req-e7b84c97-30c3-4ce2-8b46-49cabf7d10d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2432a73-f653-47ed-9a48-cf0680e9f786", "name": "network-vif-deleted", "tag": "f346f57d-b989-4991-b2c5-556d42cd8b94"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:18.736421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:18.748643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7e7ff80e-5af5-4002-b27e-bfb198c0bb5e req-e7b84c97-30c3-4ce2-8b46-49cabf7d10d7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.749019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7e7ff80e-5af5-4002-b27e-bfb198c0bb5e req-e7b84c97-30c3-4ce2-8b46-49cabf7d10d7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.781766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7e7ff80e-5af5-4002-b27e-bfb198c0bb5e req-e7b84c97-30c3-4ce2-8b46-49cabf7d10d7 service nova] Creating event network-vif-deleted:f346f57d-b989-4991-b2c5-556d42cd8b94 for instance e2432a73-f653-47ed-9a48-cf0680e9f786 on n-h1-843834-3 Jul 19 19:56:18.788884 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7e7ff80e-5af5-4002-b27e-bfb198c0bb5e req-e7b84c97-30c3-4ce2-8b46-49cabf7d10d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076885 Jul 19 19:56:18.789544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1635/3382] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:18.982836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:18.983716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:18.997765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.998441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:18.999329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:18.999794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.109255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:19.139739 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a486b478-87cb-4b6b-a8ea-8f4220d24b73 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1537 microversion: 2.1 time: 1.174187 Jul 19 19:56:19.140928 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1748/3383] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:17 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1537 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:19.329447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:19.358228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd262a57-fea2-4957-b382-6c534e958407 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1276 microversion: 2.1 time: 0.378887 Jul 19 19:56:19.359945 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1636/3384] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:18 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:19.527187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c2c15b7b-82fc-46ac-a86f-02174521eb21 req-6878010f-a43e-4c54-9106-f74dd5b25169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778", "name": "network-vif-deleted", "tag": "110196a3-b467-4f9b-8f6a-c2fcf6364ad7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:19.556902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c2c15b7b-82fc-46ac-a86f-02174521eb21 req-6878010f-a43e-4c54-9106-f74dd5b25169 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.558017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c2c15b7b-82fc-46ac-a86f-02174521eb21 req-6878010f-a43e-4c54-9106-f74dd5b25169 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.608020 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c2c15b7b-82fc-46ac-a86f-02174521eb21 req-6878010f-a43e-4c54-9106-f74dd5b25169 service nova] Creating event network-vif-deleted:110196a3-b467-4f9b-8f6a-c2fcf6364ad7 for instance f6fdf1a3-0f4e-4d86-ba19-c87fbf8c2778 on n-h1-843834-3 Jul 19 19:56:19.628388 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c2c15b7b-82fc-46ac-a86f-02174521eb21 req-6878010f-a43e-4c54-9106-f74dd5b25169 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106284 Jul 19 19:56:19.632690 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1749/3385] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:19.734154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:19.734674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:19.746146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.746628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.750930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:19.756684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:19.994424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.007971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.015969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.017554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4caf5df3-ce9b-4f30-9aa5-3066d205beb4 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1363 microversion: 2.47 time: 0.288384 Jul 19 19:56:20.018269 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1637/3386] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:19 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:20.175366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:20.185730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:20.218861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.219891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.222877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.231057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.378342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:20.380819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:20.399997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.401650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.404002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.406112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.591977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.610105 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af41d037-73e6-486c-a29d-3d1c8dc7cfd1 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1276 microversion: 2.1 time: 0.235325 Jul 19 19:56:20.610753 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1638/3387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:20 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:20.632752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:20.635931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:20.654187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:20.654838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.655612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.656611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.659336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.674403 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f714ded6-29a0-41e9-b340-3b075b0e50a5 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1537 microversion: 2.1 time: 0.513160 Jul 19 19:56:20.676248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1750/3388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:20 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1537 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:20.716059 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 HTTP/1.1 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '7b46ac79-be21-4f59-b714-0d63bcf29ce7'} Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:20.720204 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.725785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.729522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:20.731794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-159d2366-4f52-45a1-9267-0a3d02d4c7f2 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 404 len: 111 microversion: 2.20 time: 0.108684 Jul 19 19:56:20.732393 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1639/3389] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:20 2022] DELETE /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:20.743894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:20.744757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] [instance: 7b46ac79-be21-4f59-b714-0d63bcf29ce7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:20.755827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.756305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.757236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:20.757709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:20.780197 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] HTTP exception thrown: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Request method failure captured: Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 HTTP/1.1 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wqSxWJtTgrf4MLZunxxm6qb8rnDTQB3FlW-D6VVexucY7UsCxpBuw1VdoQboUIlHVKIQRhBKL1D0_oLlFAFETOioOKBUc6HqUUUT2JAjLIA9jvdYdD3ThjqC2GJX3Qwxuup6K6b7gzK4OG6FVjtdEq8N-L3-pSCcaUnUauGEzzuI34 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f78585de12146399a7ae194aae19e52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f78585de12146399a7ae194aae19e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f78585de12146399a7ae194aae19e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6f78585de12146399a7ae194aae19e52 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809235423 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 23a43026b121469baad2d3978d113bc2 Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809235423-project Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7b46ac79-be21-4f59-b714-0d63bcf29ce7'} Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.782664 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] Returning 404 to user: Instance 7b46ac79-be21-4f59-b714-0d63bcf29ce7 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f18d0ad-1b2a-4a62-a810-81b5892e1458 tempest-AttachVolumeShelveTestJSON-1809235423 tempest-AttachVolumeShelveTestJSON-1809235423-project] 10.222.0.23 "GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7" status: 404 len: 111 microversion: 2.20 time: 0.047445 Jul 19 19:56:20.790117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1751/3390] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:20 2022] GET /compute/v2.1/servers/7b46ac79-be21-4f59-b714-0d63bcf29ce7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:21.037836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:21.038719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:21.048404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.049428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.050816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.051782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.559911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:21.572540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:21.594534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:21.596034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-281d32eb-bd99-4544-a715-cc9ca91acdc3 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 200 len: 1363 microversion: 2.47 time: 0.562855 Jul 19 19:56:21.602007 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1640/3391] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:21 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 1363 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:21.629344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:21.630037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:21.644252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.645556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.648113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.648833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.697804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:21.700033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:21.728328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.730630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:21.734341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:21.737218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.187906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:22.210346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dec55ed2-23e3-4d94-b728-446d92a9dd30 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1519 microversion: 2.1 time: 0.520076 Jul 19 19:56:22.211777 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1641/3392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:21 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1519 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:22.218378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-88e5f7e6-1910-4dbd-9dae-b5914bd15cb4 req-01877812-66b2-445d-b265-bb822783a2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc3764-65b9-481e-b124-61ed7b7acae6", "name": "network-vif-plugged", "status": "completed", "tag": "f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:22.232850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88e5f7e6-1910-4dbd-9dae-b5914bd15cb4 req-01877812-66b2-445d-b265-bb822783a2bb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.236438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-88e5f7e6-1910-4dbd-9dae-b5914bd15cb4 req-01877812-66b2-445d-b265-bb822783a2bb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.253206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-88e5f7e6-1910-4dbd-9dae-b5914bd15cb4 req-01877812-66b2-445d-b265-bb822783a2bb service nova] Creating event network-vif-plugged:f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944 for instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 on n-h2-843834-3 Jul 19 19:56:22.260397 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-88e5f7e6-1910-4dbd-9dae-b5914bd15cb4 req-01877812-66b2-445d-b265-bb822783a2bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046484 Jul 19 19:56:22.267082 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1642/3393] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:22.275955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.276939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.286611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.287661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.288969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.290107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.378468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:22.430229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:22.441453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b18ac4e4-6374-4f73-8beb-52d675b952ae tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.817812 Jul 19 19:56:22.442575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1752/3394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:21 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:22.519263 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7de8c864-02ce-41a5-a78f-fc3d68e09724 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 204 len: 0 microversion: 2.1 time: 0.248873 Jul 19 19:56:22.520187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1643/3395] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:22 2022] DELETE /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:22.530790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.533382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.546031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.548065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.549289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.550122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.622296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.623067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.637595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.638136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.638966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.639414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.673856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] HTTP exception thrown: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Request method failure captured: Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 HTTP/1.1 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwxMFlb9hppaicIKs1_Cp50higk0OpwrRy9g3MS8n-ysaV9Vdmc_ohQQKL6KXpopLJ_7gt0PvGrRKl6Vkng3tuQZeq7Et7nuZYus0vmT7O4JLqQmW4lzKVZvbMN5QSRzZgvMOomG6venPaEiGnRNMFJIDchWw1CtoEo3cR3udOelIE Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e748b47201bc49e49662f79778770f14 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e748b47201bc49e49662f79778770f14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e748b47201bc49e49662f79778770f14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e748b47201bc49e49662f79778770f14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e748b47201bc49e49662f79778770f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e748b47201bc49e49662f79778770f14 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerShowV247Test-1064472682-project Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2a856799802646a5adce643f96ada1dd Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerShowV247Test-1064472682-project Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88'} Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:22.675694 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Returning 404 to user: Instance 12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40bf9b45-9a3e-4657-873c-0b01ef0ece17 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88" status: 404 len: 111 microversion: 2.47 time: 0.059554 Jul 19 19:56:22.682749 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1644/3396] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:22 2022] GET /compute/v2.1/servers/12e6ce80-88a0-4ca6-a9bc-cc2f1c71ab88 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:22.688446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.689033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.697545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.698229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.699532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.700400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.740773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:22.962109 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c28684c0-a853-4823-9995-b1067dfbdc52 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 204 len: 0 microversion: 2.47 time: 0.277740 Jul 19 19:56:22.963851 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1645/3397] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:22 2022] DELETE /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:22.974755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:22.975551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:22.982953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.983513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:22.984520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:22.985169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.191193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:23.205775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:23.207506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:23.208692 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-daec90e4-12fa-44d8-afd0-9a4202e30c1d tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 200 len: 1363 microversion: 2.47 time: 0.239779 Jul 19 19:56:23.220292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1646/3398] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:22 2022] GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:23.463402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:23.463402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:23.476982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.478872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.479897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:23.483238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:23.828641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:23.865280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-896406ee-8abb-441b-a1ae-06040519336e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1525 microversion: 2.1 time: 1.337665 Jul 19 19:56:23.870128 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1753/3399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:22 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1525 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:24.092960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:24.111159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0725e52e-eeec-46a9-8eeb-75ab0a19a854 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.653179 Jul 19 19:56:24.116411 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1647/3400] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:23 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:24.230060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:24.230683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:24.242278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.242874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.243571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.247459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.456375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:24.466610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:24.469460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:24.471365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56a3d21d-3793-4e46-bcce-e9af058b8f63 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 200 len: 1363 microversion: 2.47 time: 0.245267 Jul 19 19:56:24.472697 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1754/3401] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:24 2022] GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:24.896188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:24.897451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:24.905146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.905888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:24.906944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:24.907594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.135526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:25.136740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:25.165198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.165782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.168062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.168578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.288575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:25.732788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:25.750959 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62dd97f2-f4c8-4baa-b2de-f97ffc67eae3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1525 microversion: 2.1 time: 0.862446 Jul 19 19:56:25.754349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1648/3402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:24 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1525 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:25.770691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-dc6a31eb-7b3d-4415-b90a-3f689d11b17f req-af7e8c91-7d55-425e-b696-51e8dfdf9f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0617d2be-cf10-4056-92b4-235e0b3b2bc0", "tag": "40b0e48c-b95b-4564-8c2f-e923c8479652"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:25.797957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dc6a31eb-7b3d-4415-b90a-3f689d11b17f req-af7e8c91-7d55-425e-b696-51e8dfdf9f0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.803718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dc6a31eb-7b3d-4415-b90a-3f689d11b17f req-af7e8c91-7d55-425e-b696-51e8dfdf9f0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.833792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-dc6a31eb-7b3d-4415-b90a-3f689d11b17f req-af7e8c91-7d55-425e-b696-51e8dfdf9f0d service nova] Creating event network-changed:40b0e48c-b95b-4564-8c2f-e923c8479652 for instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 on n-h1-843834-3 Jul 19 19:56:25.853259 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-dc6a31eb-7b3d-4415-b90a-3f689d11b17f req-af7e8c91-7d55-425e-b696-51e8dfdf9f0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096804 Jul 19 19:56:25.854758 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1649/3403] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:25.864512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:25.867954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:25.876439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.877167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.877819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:25.878563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:25.909766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:26.066649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:26.083545 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5893b2b0-d31d-481f-886d-0f35cc3aed5f tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.953875 Jul 19 19:56:26.094127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1755/3404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:25 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:26.097971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:26.100294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5c94764a-85ed-41e7-a8c6-c56c45ad9e28 req-42b74827-cb71-4ab7-b48c-7f5cf6ee99e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc3764-65b9-481e-b124-61ed7b7acae6", "name": "network-vif-unplugged", "status": "completed", "tag": "f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:26.112910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:26.113438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5c94764a-85ed-41e7-a8c6-c56c45ad9e28 req-42b74827-cb71-4ab7-b48c-7f5cf6ee99e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.114413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5c94764a-85ed-41e7-a8c6-c56c45ad9e28 req-42b74827-cb71-4ab7-b48c-7f5cf6ee99e4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.137199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a856799802646a5adce643f96ada1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e748b47201bc49e49662f79778770f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:26.138821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-769880e2-5276-4bce-8fa7-440e3ccfcd40 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 200 len: 1363 microversion: 2.47 time: 0.281412 Jul 19 19:56:26.139483 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1650/3405] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:25 2022] GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:26.152436 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5c94764a-85ed-41e7-a8c6-c56c45ad9e28 req-42b74827-cb71-4ab7-b48c-7f5cf6ee99e4 service nova] Creating event network-vif-unplugged:f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944 for instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 on n-h2-843834-3 Jul 19 19:56:26.158727 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5c94764a-85ed-41e7-a8c6-c56c45ad9e28 req-42b74827-cb71-4ab7-b48c-7f5cf6ee99e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062729 Jul 19 19:56:26.162419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1756/3406] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:26.773758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:26.774763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:26.783393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.791569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:26.794936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:26.796130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.099462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:27.104837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:27.105673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:27.121077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.122002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.124011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.128994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.237967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:27.512606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:27.694945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:27.707245 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d95b8d93-0866-4e5c-8039-2a070d826736 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 200 len: 1525 microversion: 2.1 time: 0.941607 Jul 19 19:56:27.723642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1651/3407] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:26 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 1525 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:27.734506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:27.735446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] [instance: 11cb2ad8-cf9e-4211-b6ac-536342b693dc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:27.765329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.768508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.769688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.770531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.795111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] HTTP exception thrown: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Request method failure captured: Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc HTTP/1.1 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwxMFlb9hppaicIKs1_Cp50higk0OpwrRy9g3MS8n-ysaV9Vdmc_ohQQKL6KXpopLJ_7gt0PvGrRKl6Vkng3tuQZeq7Et7nuZYus0vmT7O4JLqQmW4lzKVZvbMN5QSRzZgvMOomG6venPaEiGnRNMFJIDchWw1CtoEo3cR3udOelIE Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e748b47201bc49e49662f79778770f14 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e748b47201bc49e49662f79778770f14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e748b47201bc49e49662f79778770f14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e748b47201bc49e49662f79778770f14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e748b47201bc49e49662f79778770f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e748b47201bc49e49662f79778770f14 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerShowV247Test-1064472682 Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerShowV247Test-1064472682-project Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 2a856799802646a5adce643f96ada1dd Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerShowV247Test-1064472682-project Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '11cb2ad8-cf9e-4211-b6ac-536342b693dc'} Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:27.797049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] Returning 404 to user: Instance 11cb2ad8-cf9e-4211-b6ac-536342b693dc could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-469b8adc-16ca-4f75-b2e4-66f0f5bc7a35 tempest-ServerShowV247Test-1064472682 tempest-ServerShowV247Test-1064472682-project] 10.222.0.23 "GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc" status: 404 len: 111 microversion: 2.47 time: 0.073570 Jul 19 19:56:27.804946 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1652/3408] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:27 2022] GET /compute/v2.1/servers/11cb2ad8-cf9e-4211-b6ac-536342b693dc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:56:27.821864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:27.831854 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ff1f200-794b-44cf-b304-aa0990fc8678 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.734134 Jul 19 19:56:27.844611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1757/3409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:27 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:27.904147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-07d8d3c8-4181-4f2c-a0c1-2f79a95f3062 req-27a45329-66e4-4fa8-9111-6bff5df8b06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc3764-65b9-481e-b124-61ed7b7acae6", "name": "network-vif-deleted", "tag": "f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:27.935385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07d8d3c8-4181-4f2c-a0c1-2f79a95f3062 req-27a45329-66e4-4fa8-9111-6bff5df8b06e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:27.936994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07d8d3c8-4181-4f2c-a0c1-2f79a95f3062 req-27a45329-66e4-4fa8-9111-6bff5df8b06e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:27.991949 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07d8d3c8-4181-4f2c-a0c1-2f79a95f3062 req-27a45329-66e4-4fa8-9111-6bff5df8b06e service nova] Creating event network-vif-deleted:f5cfd9c6-9aab-44c0-ac3e-bde2b5b0a944 for instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 on n-h2-843834-3 Jul 19 19:56:28.008181 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-07d8d3c8-4181-4f2c-a0c1-2f79a95f3062 req-27a45329-66e4-4fa8-9111-6bff5df8b06e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106155 Jul 19 19:56:28.015336 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1653/3410] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:28.727558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:28.728185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:28.762869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.765561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.767640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.770793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.802260 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 HTTP/1.1 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6dcc3764-65b9-481e-b124-61ed7b7acae6'} Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:28.816292 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:56:28.826302 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:56:28.832036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:28.834784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e9257e46-e5de-4029-96aa-754157d6087f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 404 len: 111 microversion: 2.1 time: 0.112638 Jul 19 19:56:28.840722 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1758/3411] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:28 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:28.854524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:28.855847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:28.870146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.870958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:28.872030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:28.873275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:29.056144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-985248176", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:29.149870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] validate_networks() for [('2f1427c7-5a01-4952-a2be-ab5593970bf4', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:56:29.829157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:29.839362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2457b02-aa15-4cec-b481-05cb8cd676f3 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.993278 Jul 19 19:56:29.843886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1654/3412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:28 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:30.063711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-99d563a4-2248-4789-b9a3-dded0dfedf1d req-73d3f0a8-126a-4a28-8e6c-62f6821c58bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b71731-32bd-4f09-8cde-797d58349647", "tag": "8b150874-4013-4788-825b-50cc0a3ec326"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:30.082163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-99d563a4-2248-4789-b9a3-dded0dfedf1d req-73d3f0a8-126a-4a28-8e6c-62f6821c58bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:30.084579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-99d563a4-2248-4789-b9a3-dded0dfedf1d req-73d3f0a8-126a-4a28-8e6c-62f6821c58bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:30.109923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-99d563a4-2248-4789-b9a3-dded0dfedf1d req-73d3f0a8-126a-4a28-8e6c-62f6821c58bc service nova] Creating event network-changed:8b150874-4013-4788-825b-50cc0a3ec326 for instance 93b71731-32bd-4f09-8cde-797d58349647 on n-h2-843834-3 Jul 19 19:56:30.123403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-99d563a4-2248-4789-b9a3-dded0dfedf1d req-73d3f0a8-126a-4a28-8e6c-62f6821c58bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063336 Jul 19 19:56:30.125133 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1655/3413] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:30.861972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:30.862674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:30.877818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:30.878464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:30.879353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:30.880188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:31.959080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:56:31.960564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:56:31.962311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:56:31.963075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:56:31.964226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:56:32.000271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.001706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.003680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.004735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.056500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:32.083426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:32.094095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Getting quotas for user 15202808da354b619062b62fcd6ef782 and project 313f01989837474e9072dd49cc2b501a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:32.146163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:56:32.148726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:56:32.227611 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dba4a439-000f-41ba-9de6-1a3775d90dcd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.174734 Jul 19 19:56:32.228620 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1759/3414] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:56:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:56:32.276296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.290824 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-111d767d-4517-4dd9-a445-c7f6765dfb02 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 1.433651 Jul 19 19:56:32.307840 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1656/3415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:30 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:32.329227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-10e8714a-ba8a-4d05-8327-20676483ea9a req-b800ee07-d4da-47e5-9515-8d2773d090e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0617d2be-cf10-4056-92b4-235e0b3b2bc0", "name": "network-vif-plugged", "status": "completed", "tag": "40b0e48c-b95b-4564-8c2f-e923c8479652"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:32.344186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-10e8714a-ba8a-4d05-8327-20676483ea9a req-b800ee07-d4da-47e5-9515-8d2773d090e0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.344691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-10e8714a-ba8a-4d05-8327-20676483ea9a req-b800ee07-d4da-47e5-9515-8d2773d090e0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.368941 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-10e8714a-ba8a-4d05-8327-20676483ea9a req-b800ee07-d4da-47e5-9515-8d2773d090e0 service nova] Creating event network-vif-plugged:40b0e48c-b95b-4564-8c2f-e923c8479652 for instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 on n-h1-843834-3 Jul 19 19:56:32.403277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-10e8714a-ba8a-4d05-8327-20676483ea9a req-b800ee07-d4da-47e5-9515-8d2773d090e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090441 Jul 19 19:56:32.407487 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1657/3416] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:32.426148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.445071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.448399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Searching by: {'deleted': False, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:56:32.468799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.470288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.479494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.482709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.511226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0f7dabf-c2ea-4334-a758-27c2a77b6c7a tempest-ExtensionsTest-647922330 tempest-ExtensionsTest-647922330-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.513015 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0f7dabf-c2ea-4334-a758-27c2a77b6c7a tempest-ExtensionsTest-647922330 tempest-ExtensionsTest-647922330-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.283183 Jul 19 19:56:32.513909 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1760/3417] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:32.520611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1943597d-1b12-4158-bd6a-8fc97855371f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.521691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1943597d-1b12-4158-bd6a-8fc97855371f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:32.556711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:56:32.608273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e531f3ce-32fa-4589-9a0e-8f58cdc21b9d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.196307 Jul 19 19:56:32.609209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1658/3418] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/servers => generated 344 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:32.614234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a318b220-e22c-4660-9d6b-717546c3afd6 tempest-ExtensionsTest-647922330 tempest-ExtensionsTest-647922330-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.616801 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a318b220-e22c-4660-9d6b-717546c3afd6 tempest-ExtensionsTest-647922330 tempest-ExtensionsTest-647922330-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005999 Jul 19 19:56:32.619040 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1659/3419] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:56:32.629969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:32.636733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.637933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Searching by: {'deleted': False, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:56:32.645509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.646254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.647576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.653074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:32.726386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:56:32.735024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1943597d-1b12-4158-bd6a-8fc97855371f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.752005 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1943597d-1b12-4158-bd6a-8fc97855371f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1224 microversion: 2.1 time: 0.236787 Jul 19 19:56:32.752894 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1761/3420] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:32.802542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:32.810518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:32.811000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.210880 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c1abaacd-8286-4cd0-81b5-8d35869d0f90 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.589580 Jul 19 19:56:33.211971 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1660/3421] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:56:32 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:33.233752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db4d5e1a-6599-4285-981c-4cb54523c595 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.246758 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db4d5e1a-6599-4285-981c-4cb54523c595 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017370 Jul 19 19:56:33.246758 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1762/3422] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:33.340427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.344493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.370332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.373345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.376384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.378349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.696260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.697013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.709281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.710278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.711463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.712100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.760734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:33.785652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:33.795436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d242789f-767b-4403-a4ea-3548c3a7aafd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1318 microversion: 2.1 time: 0.474887 Jul 19 19:56:33.799824 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1661/3423] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:33.812729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.813674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.826741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.827660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.833317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:33.833633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.834276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.903090 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2fe55dc9-f2e0-4d0d-a0e1-e5948726701e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "DELETE /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 204 len: 0 microversion: 2.1 time: 0.217047 Jul 19 19:56:33.904270 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1763/3424] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:33 2022] DELETE /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:33.915504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:33.916591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:33.924641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.925572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.926926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:33.927728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:33.943219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:33.965141 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88c910c8-2415-4aa6-ac25-e200eeabd67f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1276 microversion: 2.1 time: 0.162848 Jul 19 19:56:33.968175 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1662/3425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:34.252282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:34.267035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4c59fb3-4711-42b5-8174-97d99dfb53ee tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1608 microversion: 2.1 time: 0.357829 Jul 19 19:56:34.268471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1764/3426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:33 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1608 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:34.816823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:34.817715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:34.830152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:34.831025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:34.835584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:34.837239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.095223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:35.109772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a791f4e-ae62-490b-bd44-b97beb5e40a9 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1507 microversion: 2.1 time: 0.293952 Jul 19 19:56:35.122094 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1765/3427] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:34 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:35.131239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.131239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.141792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.142338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.153245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.153699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.154094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.154482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.154748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.154924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.155772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.156316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.237902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:35.473383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e062720-56c5-41dc-9657-b99cca0b926e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 204 len: 0 microversion: 2.32 time: 0.710223 Jul 19 19:56:35.485334 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1663/3428] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:56:34 2022] DELETE /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:56:35.494762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.496667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.525335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.527003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.531497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.532339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.550003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:35.562807 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-653dc5b7-b5bb-4537-8698-0790bdf10838 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1284 microversion: 2.1 time: 0.439415 Jul 19 19:56:35.573573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1766/3429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:35 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1284 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:35.579066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:35.580084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:35.588704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.589503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:35.590518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:35.591218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.646979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:36.659110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c313dcb-b007-476e-9798-e5a7a9a0bd2f tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1608 microversion: 2.1 time: 1.084014 Jul 19 19:56:36.661548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1767/3430] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:35 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1608 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:36.667310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:36.668452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:36.680207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.681165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.682530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.683979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.704807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:36.718818 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a301f66-ce6e-434d-abeb-22d47afe2629 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1318 microversion: 2.1 time: 1.229275 Jul 19 19:56:36.719480 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1664/3431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:35 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1318 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:36.736753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6e360c75-57d3-41d8-b535-6737d3748716 req-f949aa65-b52a-47c0-b338-cc117ba92e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b71731-32bd-4f09-8cde-797d58349647", "name": "network-vif-plugged", "status": "completed", "tag": "8b150874-4013-4788-825b-50cc0a3ec326"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:36.758716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6e360c75-57d3-41d8-b535-6737d3748716 req-f949aa65-b52a-47c0-b338-cc117ba92e89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.760365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6e360c75-57d3-41d8-b535-6737d3748716 req-f949aa65-b52a-47c0-b338-cc117ba92e89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.777830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6e360c75-57d3-41d8-b535-6737d3748716 req-f949aa65-b52a-47c0-b338-cc117ba92e89 service nova] Creating event network-vif-plugged:8b150874-4013-4788-825b-50cc0a3ec326 for instance 93b71731-32bd-4f09-8cde-797d58349647 on n-h2-843834-3 Jul 19 19:56:36.786345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6e360c75-57d3-41d8-b535-6737d3748716 req-f949aa65-b52a-47c0-b338-cc117ba92e89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062603 Jul 19 19:56:36.794015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1665/3432] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:36.800165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:36.801143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:36.813234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.814466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.815700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:36.816405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:36.992866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.006790 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-703ea47e-147f-4cef-b59a-67cb98fd2345 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1282 microversion: 2.1 time: 0.210917 Jul 19 19:56:37.008282 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1666/3433] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:36 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:37.387812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.405083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.410305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:37.411726 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6a108aa-9f9c-4a02-b494-eae436e8f660 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2958 microversion: 2.32 time: 0.748846 Jul 19 19:56:37.413824 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1768/3434] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:36 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2958 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:37.677521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.677977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.690151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.696151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.699684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.701652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.739234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:37.740703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:37.754562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.762716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:37.766213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:37.767415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.321421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:38.330490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ed000cd0-19f8-44c0-97ca-84f843e8a253 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1608 microversion: 2.1 time: 0.657130 Jul 19 19:56:38.349248 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1667/3435] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:37 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1608 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:38.357438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:38.361546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:38.377439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.381077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.382164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.382860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.408438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:38.461551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:38.475434 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55c8f4d5-f57f-49e2-a4b5-19c6a2980b5e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1318 microversion: 2.1 time: 0.742044 Jul 19 19:56:38.480487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1769/3436] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:37 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:38.487992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:38.488921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:38.495768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.496557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:38.497448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:38.497940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.279459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.287490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9e6c641-6a00-490c-96f2-e5dd8922af20 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 0.936756 Jul 19 19:56:39.288420 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1668/3437] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:38 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:39.353354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:39.354697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:39.370097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.370561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.371391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.371827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.498118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.517956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.520264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.522112 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2ce64df-5fcb-4249-bb0c-b8556c59d755 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2958 microversion: 2.32 time: 1.037991 Jul 19 19:56:39.523910 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1770/3438] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:38 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2958 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:39.541719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:39.542681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:39.550575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.551516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:39.552267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.554353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.556257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.563707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3e716336-754e-48f5-8438-adc726caa61d tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1541 microversion: 2.1 time: 0.214118 Jul 19 19:56:39.564232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1669/3439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:39 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1541 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:39.580076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4a771f5b-964b-44f3-af12-4f8992cda77a req-cbcf2923-d098-42cf-ab55-a0e504e48dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451fa00b-e484-4703-8fc5-84598e7262c1", "name": "network-vif-deleted", "tag": "7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:39.622771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4a771f5b-964b-44f3-af12-4f8992cda77a req-cbcf2923-d098-42cf-ab55-a0e504e48dbe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:39.628246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4a771f5b-964b-44f3-af12-4f8992cda77a req-cbcf2923-d098-42cf-ab55-a0e504e48dbe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:39.713946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4a771f5b-964b-44f3-af12-4f8992cda77a req-cbcf2923-d098-42cf-ab55-a0e504e48dbe service nova] Creating event network-vif-deleted:7cb1a96d-8d65-4a31-bdbc-c5b5fde213b8 for instance 451fa00b-e484-4703-8fc5-84598e7262c1 on n-h1-843834-3 Jul 19 19:56:39.759630 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4a771f5b-964b-44f3-af12-4f8992cda77a req-cbcf2923-d098-42cf-ab55-a0e504e48dbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183017 Jul 19 19:56:39.761940 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1670/3440] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:40.306600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:40.307617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:40.320340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.324480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.325633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.326247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.412746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:40.424086 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-355e68fa-bdd0-479e-a8ad-36275c9296dd tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1318 microversion: 2.1 time: 0.898508 Jul 19 19:56:40.431274 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1771/3441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:39 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:40.546200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:40.548003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:40.569084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.569401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:40.570206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:40.570649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.029600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.042526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:42.046308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.054378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.056893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.057077 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df20ccf2-ab61-49c4-8df0-7864cd6310ad tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 1.753742 Jul 19 19:56:42.061089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1671/3442] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:40 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:42.068762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab2189df-b311-4cfe-bc11-bdb4269e5da0 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2958 microversion: 2.32 time: 1.526792 Jul 19 19:56:42.082053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:42.082053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:42.087535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.087702 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1772/3443] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:40 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2958 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:42.088371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.089386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.090594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.093819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e43bf8d4-4589-4c02-ac38-c4a74d3a92b5 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f240095c310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:42.168905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e43bf8d4-4589-4c02-ac38-c4a74d3a92b5 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/dc3c7dc2-2414-45a7-82e4-360d9ac965a3" status: 200 len: 350 microversion: 2.1 time: 0.079965 Jul 19 19:56:42.169709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1773/3444] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:56:42 2022] GET /compute/v2.1/os-volumes/dc3c7dc2-2414-45a7-82e4-360d9ac965a3 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:42.175114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:42.176001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:42.196633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.198295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.200927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:42.201817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:42.386947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:42.399659 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30700bf4-5551-4540-afd7-9a6684e586d7 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1252 microversion: 2.1 time: 0.337337 Jul 19 19:56:42.422516 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1672/3445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:42 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1252 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:42.750966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:43.003499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.019737 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f7418b6-547c-4c2f-9702-aca610e04326 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1506 microversion: 2.1 time: 0.848681 Jul 19 19:56:43.022029 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1774/3446] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:42 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1506 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:43.042020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.043026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.046716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:43.051446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:43.067393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.069617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.069617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.069617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.075447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.076294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.091469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.107005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.108307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.112100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.230510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:43.436958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:43.455454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f8cd93d-4595-4bcb-ba3e-c9560e3cb909 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 204 len: 0 microversion: 2.1 time: 0.416233 Jul 19 19:56:43.458066 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1673/3447] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:43 2022] DELETE /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:43.471972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:43.475615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:43.497259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.498384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.502955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:43.506036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:43.971907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:43.986864 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d9e2af9-eea4-4c75-9c47-52ab8caf230e tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 0.912529 Jul 19 19:56:43.999261 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1775/3448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.005351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.006659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.017501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.018360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.020378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.021319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.310330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:44.341997 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4344e221-f582-4c34-90f4-19fd1454ad0b tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1252 microversion: 2.1 time: 0.340725 Jul 19 19:56:44.349308 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1776/3449] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1252 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:44.383980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.385380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.412474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.414902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.420041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.422282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.560275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:56:44.880225 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-297c463f-508f-44e3-91f0-ea536ed753a8 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 204 len: 0 microversion: 2.1 time: 0.524422 Jul 19 19:56:44.882331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1777/3450] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:56:44 2022] DELETE /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:56:44.893272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-58ad25e3-eb8f-4ac4-b637-e84fe5557d2a req-226dfd1f-6012-4486-a04f-e1ea5c7114ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "91990a06-1178-4654-8553-4a053eda5e1c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:44.917667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-58ad25e3-eb8f-4ac4-b637-e84fe5557d2a req-226dfd1f-6012-4486-a04f-e1ea5c7114ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:44.920112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-58ad25e3-eb8f-4ac4-b637-e84fe5557d2a req-226dfd1f-6012-4486-a04f-e1ea5c7114ef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:44.951539 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-58ad25e3-eb8f-4ac4-b637-e84fe5557d2a req-226dfd1f-6012-4486-a04f-e1ea5c7114ef service nova] Creating event network-vif-unplugged:91990a06-1178-4654-8553-4a053eda5e1c for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:44.964882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-58ad25e3-eb8f-4ac4-b637-e84fe5557d2a req-226dfd1f-6012-4486-a04f-e1ea5c7114ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078960 Jul 19 19:56:44.965640 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1778/3451] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:44.980086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:44.981276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:44.995286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.001298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.004173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.006903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.019166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:45.514681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:45.531301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:45.537437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:45.543566 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-afea1a17-1ba7-435e-acf3-9036d58ca006 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2937 microversion: 2.32 time: 2.083726 Jul 19 19:56:45.549606 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1674/3452] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:43 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2937 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:45.557735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:45.569599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:45.592017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.595289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:45.596302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:45.598175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.403429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.419135 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0402df76-3be1-4761-a3b9-4389ef2c449a tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1512 microversion: 2.1 time: 1.450177 Jul 19 19:56:46.426356 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1779/3453] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:44 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1512 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:46.432933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:46.442270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:46.453081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.457863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.459192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.459869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.561080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.574667 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4654f47-ad4c-42f8-b0d3-322e3f0208ae tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 1.022609 Jul 19 19:56:46.577083 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1675/3454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:45 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:46.590040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b410aa76-4629-4375-8a3d-101defa114f8 req-85002e3d-4fc2-4e74-bd7c-bb3f54fd8e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57cfa99-c8d2-43b7-910d-3c36e23f3cab", "tag": "37d66bef-1144-434f-9ab7-33c68e01446b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:46.616616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b410aa76-4629-4375-8a3d-101defa114f8 req-85002e3d-4fc2-4e74-bd7c-bb3f54fd8e03 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.617665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b410aa76-4629-4375-8a3d-101defa114f8 req-85002e3d-4fc2-4e74-bd7c-bb3f54fd8e03 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.652166 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b410aa76-4629-4375-8a3d-101defa114f8 req-85002e3d-4fc2-4e74-bd7c-bb3f54fd8e03 service nova] Creating event network-changed:37d66bef-1144-434f-9ab7-33c68e01446b for instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab on n-h1-843834-3 Jul 19 19:56:46.664617 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b410aa76-4629-4375-8a3d-101defa114f8 req-85002e3d-4fc2-4e74-bd7c-bb3f54fd8e03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083296 Jul 19 19:56:46.665845 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1676/3455] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:46.679006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23dcae5d-d444-40ab-b773-88106b947acc tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23eebb4430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:46.809776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23dcae5d-d444-40ab-b773-88106b947acc tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7cb6760a-493b-457f-a61e-ab273b30e24e" status: 200 len: 350 microversion: 2.1 time: 0.140944 Jul 19 19:56:46.810895 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1677/3456] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:56:46 2022] GET /compute/v2.1/os-volumes/7cb6760a-493b-457f-a61e-ab273b30e24e => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:46.816268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:46.817604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:46.823496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:46.840364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89fbb68d-057e-484d-b1a0-b77bcd4fabd2 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1252 microversion: 2.1 time: 0.412409 Jul 19 19:56:46.843913 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1780/3457] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:46 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1252 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:46.851814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.855997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:46.858066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:46.861778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.005398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "f3366ada-1b22-498f-9431-a3646f97f3f0"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "5142b9da-6911-44d7-93c6-0f1fd5e6437a"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "2ba4e656-104e-403b-8ef4-51a022ce309d"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "f8fc22e0-5d2e-40f8-a10b-a8008dcdc283"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-unplugged", "status": "completed", "tag": "32ecaf13-8f8f-485f-9226-fd02b3cdbdc5"}, {"server_uuid": "93b71731-32bd-4f09-8cde-797d58349647", "name": "network-vif-unplugged", "status": "completed", "tag": "8b150874-4013-4788-825b-50cc0a3ec326"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:47.028306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.031829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.059488 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:f3366ada-1b22-498f-9431-a3646f97f3f0 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:47.067658 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:5142b9da-6911-44d7-93c6-0f1fd5e6437a for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:47.068408 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:2ba4e656-104e-403b-8ef4-51a022ce309d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:47.069022 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:f8fc22e0-5d2e-40f8-a10b-a8008dcdc283 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:47.070636 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:32ecaf13-8f8f-485f-9226-fd02b3cdbdc5 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:47.071291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] Creating event network-vif-unplugged:8b150874-4013-4788-825b-50cc0a3ec326 for instance 93b71731-32bd-4f09-8cde-797d58349647 on n-h2-843834-3 Jul 19 19:56:47.088910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-65c16359-e087-4352-a9ee-b3305a0d2bdb req-6e5702d7-b66f-4077-bc94-50ba8b08b16b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.088115 Jul 19 19:56:47.092130 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1781/3458] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:47.444012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:47.445020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:47.470074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.480891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.483208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.486623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.713216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.726884 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-08a2535a-3e98-4e4b-8dbc-e8a47ec95005 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 200 len: 1470 microversion: 2.1 time: 0.286883 Jul 19 19:56:47.729277 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1782/3459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:47 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:47.742880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:47.746625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:47.750196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.780267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.780655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.782415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.788625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.789238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.798203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:47.806962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f655af88-6a6c-4c8c-84eb-f491303e314c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2916 microversion: 2.32 time: 0.992184 Jul 19 19:56:47.807623 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1678/3460] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:46 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2916 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:47.861032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:47.861767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:47.882715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.883293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:47.884124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:47.884634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.013060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:48.029379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9b49630-5512-402d-8239-6a6d9f29b7db tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1252 microversion: 2.1 time: 0.172977 Jul 19 19:56:48.030238 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1679/3461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:47 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1252 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:48.041917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-71b4ffaf-f31c-4910-9e49-dcac71b7325b req-8996afd1-f505-4ba6-8d7a-e35ff0759530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b71731-32bd-4f09-8cde-797d58349647", "name": "network-vif-deleted", "tag": "8b150874-4013-4788-825b-50cc0a3ec326"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:48.062397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-71b4ffaf-f31c-4910-9e49-dcac71b7325b req-8996afd1-f505-4ba6-8d7a-e35ff0759530 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.063455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-71b4ffaf-f31c-4910-9e49-dcac71b7325b req-8996afd1-f505-4ba6-8d7a-e35ff0759530 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.097366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-71b4ffaf-f31c-4910-9e49-dcac71b7325b req-8996afd1-f505-4ba6-8d7a-e35ff0759530 service nova] Creating event network-vif-deleted:8b150874-4013-4788-825b-50cc0a3ec326 for instance 93b71731-32bd-4f09-8cde-797d58349647 on n-h2-843834-3 Jul 19 19:56:48.109473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-71b4ffaf-f31c-4910-9e49-dcac71b7325b req-8996afd1-f505-4ba6-8d7a-e35ff0759530 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077850 Jul 19 19:56:48.115230 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1680/3462] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:48.745610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:48.746705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 93b71731-32bd-4f09-8cde-797d58349647] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:48.766067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.767788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.770212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.776377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.824110 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] HTTP exception thrown: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Request method failure captured: Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 HTTP/1.1 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wxInq9r8pcwewVSkpi69hgzRyQ9WWVwFhVZci0UUdPKvLVklTSYjD2aluGk_rBr2TyEU6OXeFzg_p8IKiVw-EDuIlA8qIA2s2Cy0DBE6DlTqmIHIOP_8i6jAn7IjeiJieDxAq4sm-NuqRVWR-MzTIYN6UoItdfT2lXn_dEYXiTm_Do Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5a3a044f20af4080bc608b86ff959be8 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5a3a044f20af4080bc608b86ff959be8 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MultipleCreateTestJSON-470001711-project Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6598aef7c1c3442486f9b4f45d86d000 Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MultipleCreateTestJSON-470001711-project Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '93b71731-32bd-4f09-8cde-797d58349647'} Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:48.829461 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. Jul 19 19:56:48.836045 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:48.837107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Returning 404 to user: Instance 93b71731-32bd-4f09-8cde-797d58349647 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:48.844226 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd18a8b7-4568-4074-b0f7-46b820ec2484 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647" status: 404 len: 111 microversion: 2.1 time: 0.103700 Jul 19 19:56:48.845709 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1681/3463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:48 2022] GET /compute/v2.1/servers/93b71731-32bd-4f09-8cde-797d58349647 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:56:48.851026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:48.864592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:48.876264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.876724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:48.877640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:48.878260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.232401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.242447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2fca618d-0db0-4865-abb0-2d8f5002407f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 1.511932 Jul 19 19:56:49.243652 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1783/3464] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:47 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:49.260312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:49.261463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:49.269483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.270209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.271352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.272075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.579271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.588737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.590243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.591545 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91edae4e-e1d1-4dae-b202-114cf08f0c28 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2869 microversion: 2.32 time: 0.744607 Jul 19 19:56:49.592112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1682/3465] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:48 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2869 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:49.614579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:49.615443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:49.631339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.631805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.632601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.633041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.753834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.774842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:49.777515 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b72dd8eb-81c0-4f30-88b9-8e9a74028418 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1513 microversion: 2.1 time: 0.519285 Jul 19 19:56:49.779454 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1784/3466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:49.794163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7ac4ef59-9898-44a7-9bd2-27c908670558 req-6558a96e-a1ce-41c6-a2d2-8081ba53f3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-deleted", "tag": "f3366ada-1b22-498f-9431-a3646f97f3f0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:49.815343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-453833bf-59d4-4569-b741-9122a9804e23 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1252 microversion: 2.1 time: 0.213437 Jul 19 19:56:49.815980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1683/3467] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1252 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:49.827478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa740822-6c33-4d6b-ad73-c8bea1d6d525 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23ef2a2430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:49.842645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7ac4ef59-9898-44a7-9bd2-27c908670558 req-6558a96e-a1ce-41c6-a2d2-8081ba53f3fe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:49.843478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7ac4ef59-9898-44a7-9bd2-27c908670558 req-6558a96e-a1ce-41c6-a2d2-8081ba53f3fe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:49.892294 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7ac4ef59-9898-44a7-9bd2-27c908670558 req-6558a96e-a1ce-41c6-a2d2-8081ba53f3fe service nova] Creating event network-vif-deleted:f3366ada-1b22-498f-9431-a3646f97f3f0 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:49.907261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7ac4ef59-9898-44a7-9bd2-27c908670558 req-6558a96e-a1ce-41c6-a2d2-8081ba53f3fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123283 Jul 19 19:56:49.913608 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1785/3468] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:49.962190 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa740822-6c33-4d6b-ad73-c8bea1d6d525 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/25130d20-5333-4a7c-9bc9-7d035df5bcdf" status: 200 len: 351 microversion: 2.1 time: 0.138385 Jul 19 19:56:49.962775 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1684/3469] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/os-volumes/25130d20-5333-4a7c-9bc9-7d035df5bcdf => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:49.974613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62b1d8d8-39b6-4fab-a31b-4ac1a53860ef tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23ef997a60>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.114756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62b1d8d8-39b6-4fab-a31b-4ac1a53860ef tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.144083 Jul 19 19:56:50.126245 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1786/3470] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 19 19:56:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:50.136722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6d050481-d354-4e05-a695-3e6ed390d30e tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23ef2a2af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.261722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.263863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.272655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.273384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.275107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.275924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.295631 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6d050481-d354-4e05-a695-3e6ed390d30e tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.162475 Jul 19 19:56:50.297427 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1685/3471] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:50.318560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-451d8a51-d4a7-48b6-9a90-983909f9567d tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23eea991f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.540268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-451d8a51-d4a7-48b6-9a90-983909f9567d tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.232801 Jul 19 19:56:50.540855 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1686/3472] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:50.552883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85485b5b-bf75-4236-9231-a587ec8a6538 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23eea99af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.689285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:50.698955 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d66a41a-4ddb-4098-8360-9338419bb6bd tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 0.441830 Jul 19 19:56:50.727905 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1787/3473] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:50.757975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.762336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.789506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.791852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.793162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.793828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.835424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85485b5b-bf75-4236-9231-a587ec8a6538 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.286330 Jul 19 19:56:50.837666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1687/3474] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:50.843583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:50.848068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:50.856311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.857378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.858422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.860095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.922421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:50.923588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:50.925683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lazy-loading 'fault' on Instance uuid 0617d2be-cf10-4056-92b4-235e0b3b2bc0 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:51.099951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598aef7c1c3442486f9b4f45d86d000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3a044f20af4080bc608b86ff959be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.108329 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c23ee367-bc96-4a69-8534-560d4ff97b58 tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 200 len: 1308 microversion: 2.1 time: 0.269108 Jul 19 19:56:51.108927 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1688/3475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:51.118973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.119599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:51.147747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.148344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.149498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.150149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.239416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.239899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.245397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lazy-loading 'fault' on Instance uuid 451fa00b-e484-4703-8fc5-84598e7262c1 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:56:51.318550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809a147ae2664f758b703237ebc6048a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdc36bc81bd4f08972675efff393bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.328892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-936a0d75-a63d-4a5f-8309-4c39dae0269e tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 200 len: 1211 microversion: 2.1 time: 0.218296 Jul 19 19:56:51.329987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1689/3476] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:51.346454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56efdd8a-b1b4-4aa0-97ad-12ec88e6da94 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23ef2a2280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.430457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.450941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.452594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:51.453949 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd22ad5d-965e-4b2f-9b75-21b2f04e3b89 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2708 microversion: 2.32 time: 0.724657 Jul 19 19:56:51.467053 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1788/3477] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:50 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2708 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:51.518967 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56efdd8a-b1b4-4aa0-97ad-12ec88e6da94 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.187593 Jul 19 19:56:51.527940 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1690/3478] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:51.531842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae978a0b-8f34-482e-8803-53bde21fe0a0 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23ef561700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.698469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae978a0b-8f34-482e-8803-53bde21fe0a0 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.170514 Jul 19 19:56:51.699175 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1789/3479] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:51.711280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c053bf04-1893-4449-b2fb-96fe29d2d737 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23eea99820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.721800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:51.722743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:51.738466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.740298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.741661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:51.742589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:51.908055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c053bf04-1893-4449-b2fb-96fe29d2d737 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.200761 Jul 19 19:56:51.916231 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1691/3480] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:51.923044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fbe6427a-90e4-4d59-b708-4e400cd975e7 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] Calling method '.version_select at 0x7f23eea8fca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.127869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fbe6427a-90e4-4d59-b708-4e400cd975e7 tempest-VolumesTestJSON-1768840130 tempest-VolumesTestJSON-1768840130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.208933 Jul 19 19:56:52.129004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1692/3481] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:52.134606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-37abc8bc-1ecd-48f1-83a2-b7a8e5b84009 req-4b8555c1-9713-41ae-af16-7a16f7707303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0617d2be-cf10-4056-92b4-235e0b3b2bc0", "name": "network-vif-deleted", "tag": "40b0e48c-b95b-4564-8c2f-e923c8479652"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:52.146904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-37abc8bc-1ecd-48f1-83a2-b7a8e5b84009 req-4b8555c1-9713-41ae-af16-7a16f7707303 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.147666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-37abc8bc-1ecd-48f1-83a2-b7a8e5b84009 req-4b8555c1-9713-41ae-af16-7a16f7707303 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.160679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-37abc8bc-1ecd-48f1-83a2-b7a8e5b84009 req-4b8555c1-9713-41ae-af16-7a16f7707303 service nova] Creating event network-vif-deleted:40b0e48c-b95b-4564-8c2f-e923c8479652 for instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 on n-h1-843834-3 Jul 19 19:56:52.167314 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-37abc8bc-1ecd-48f1-83a2-b7a8e5b84009 req-4b8555c1-9713-41ae-af16-7a16f7707303 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036815 Jul 19 19:56:52.168621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1693/3482] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:52.174663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.176441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] [instance: 0617d2be-cf10-4056-92b4-235e0b3b2bc0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:52.185435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.187145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.188274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.189163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.198263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:56:52.212302 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] HTTP exception thrown: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Request method failure captured: Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 HTTP/1.1 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wxInq9r8pcwewVSkpi69hgzRyQ9WWVwFhVZci0UUdPKvLVklTSYjD2aluGk_rBr2TyEU6OXeFzg_p8IKiVw-EDuIlA8qIA2s2Cy0DBE6DlTqmIHIOP_8i6jAn7IjeiJieDxAq4sm-NuqRVWR-MzTIYN6UoItdfT2lXn_dEYXiTm_Do Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5a3a044f20af4080bc608b86ff959be8 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a3a044f20af4080bc608b86ff959be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5a3a044f20af4080bc608b86ff959be8 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MultipleCreateTestJSON-470001711 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MultipleCreateTestJSON-470001711-project Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6598aef7c1c3442486f9b4f45d86d000 Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MultipleCreateTestJSON-470001711-project Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0617d2be-cf10-4056-92b4-235e0b3b2bc0'} Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:52.214796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. Jul 19 19:56:52.219796 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.223768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] Returning 404 to user: Instance 0617d2be-cf10-4056-92b4-235e0b3b2bc0 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:52.225408 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de413a76-60d5-4d1e-a59b-9c6ff2a36f9e tempest-MultipleCreateTestJSON-470001711 tempest-MultipleCreateTestJSON-470001711-project] 10.222.0.23 "GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0" status: 404 len: 111 microversion: 2.1 time: 0.055313 Jul 19 19:56:52.230175 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1694/3483] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:52 2022] GET /compute/v2.1/servers/0617d2be-cf10-4056-92b4-235e0b3b2bc0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:52.347940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.348662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] [instance: 451fa00b-e484-4703-8fc5-84598e7262c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:52.366197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.369133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.370054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.370505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.412279 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] HTTP exception thrown: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Request method failure captured: Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 HTTP/1.1 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwCtAN6RAu2KK8V6SjYjIeU5GkSBQJvhI9yiNjlBYEjeeqgPuab9tOyRV91_XifrXT_ZznHgt7V7_A4LTyC-4SYVAt6ksoxKO6b6Q3bwdNAOZEnflCpbtI2Tkhf7o-TdEY1U3XlRciVF52mI9lWmmloJFFi1fw55NUqrA_hOIdgUdQ Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dbdc36bc81bd4f08972675efff393bb3 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersTestBootFromVolume-568397196 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbdc36bc81bd4f08972675efff393bb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dbdc36bc81bd4f08972675efff393bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dbdc36bc81bd4f08972675efff393bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbdc36bc81bd4f08972675efff393bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersTestBootFromVolume-568397196 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dbdc36bc81bd4f08972675efff393bb3 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersTestBootFromVolume-568397196 Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersTestBootFromVolume-568397196-project Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 809a147ae2664f758b703237ebc6048a Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersTestBootFromVolume-568397196-project Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '451fa00b-e484-4703-8fc5-84598e7262c1'} Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:56:52.416667 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Returning 404 to user: Instance 451fa00b-e484-4703-8fc5-84598e7262c1 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a8aab19-5600-404a-8200-84fb3e88a1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1" status: 404 len: 111 microversion: 2.1 time: 0.075892 Jul 19 19:56:52.422636 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1695/3484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:52 2022] GET /compute/v2.1/servers/451fa00b-e484-4703-8fc5-84598e7262c1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:56:52.437967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dceb0929-5403-4955-918b-0e7a117bc1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] Calling method '.version_select at 0x7f24009913a0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.481347 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dceb0929-5403-4955-918b-0e7a117bc1b8 tempest-ServersTestBootFromVolume-568397196 tempest-ServersTestBootFromVolume-568397196-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260163271" status: 202 len: 0 microversion: 2.1 time: 0.054782 Jul 19 19:56:52.482401 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1696/3485] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 19:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260163271 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:56:52.494740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:52.495440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:52.508547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.509015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.509808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:52.519387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:52.920473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:52.938941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:52.940731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:52.952609 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9fbe441b-7c24-4017-9a37-c420247d3aa1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2708 microversion: 2.32 time: 0.463770 Jul 19 19:56:52.953445 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1697/3486] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:52 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2708 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:53.310679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:53.326390 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1702b57-eb43-4401-a901-9536725378c4 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 1.608647 Jul 19 19:56:53.352708 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1790/3487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:51 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:53.983300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:53.984106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:54.004251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.004757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.005852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.006504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.768080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ac9dec2-609f-4129-b34c-e99ed372d37b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: .version_select at 0x7f23eefbaee0>, body: {"keypair": {"name": "tempest-keypair-48588254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYL0dnxdpqT8O0bu41i8RkuThMwYyJr7L0JwV+JxEVFZPANJm0XEREL/bNj2FWiZ4PYTSXo9LXVM1HDukhXAr2ZAMQs+QezR4XVqwN1exlEv4LloQO/oyHw03pANoVRkg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:54.814050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ac9dec2-609f-4129-b34c-e99ed372d37b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:56:54.832674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2ac9dec2-609f-4129-b34c-e99ed372d37b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for user 1079bff73f42419d99533c176b6a7473 and project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:56:54.883289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ac9dec2-609f-4129-b34c-e99ed372d37b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.661122 Jul 19 19:56:54.890070 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1791/3488] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:56:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:54.895505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-deleted", "tag": "32ecaf13-8f8f-485f-9226-fd02b3cdbdc5"}, {"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-deleted", "tag": "f8fc22e0-5d2e-40f8-a10b-a8008dcdc283"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:54.923718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:54.924582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:54.949226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] Creating event network-vif-deleted:32ecaf13-8f8f-485f-9226-fd02b3cdbdc5 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:54.954330 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] Creating event network-vif-deleted:f8fc22e0-5d2e-40f8-a10b-a8008dcdc283 for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:54.973282 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-68eef77d-56d1-49bd-acd9-299582b84427 req-9912e074-2c9c-48c6-acb8-c418f21beb20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081450 Jul 19 19:56:54.974984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1792/3489] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:54.981135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:54.985135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:55.001221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:55.003967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:55.012305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:55.013164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:56.177487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:56.189415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:56.200965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:56.202621 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3d1f1b1-23b8-48d1-938a-382042729144 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2661 microversion: 2.32 time: 2.233523 Jul 19 19:56:56.203783 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1698/3490] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:53 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2661 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:56:56.467534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-19fcb1d6-d340-4e99-b772-6143aac39078 req-fc20a611-8e0a-4ea4-8b85-51f8c67916e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57cfa99-c8d2-43b7-910d-3c36e23f3cab", "name": "network-vif-plugged", "status": "completed", "tag": "37d66bef-1144-434f-9ab7-33c68e01446b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:56.485334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-19fcb1d6-d340-4e99-b772-6143aac39078 req-fc20a611-8e0a-4ea4-8b85-51f8c67916e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:56.486156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-19fcb1d6-d340-4e99-b772-6143aac39078 req-fc20a611-8e0a-4ea4-8b85-51f8c67916e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:56.509374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-19fcb1d6-d340-4e99-b772-6143aac39078 req-fc20a611-8e0a-4ea4-8b85-51f8c67916e3 service nova] Creating event network-vif-plugged:37d66bef-1144-434f-9ab7-33c68e01446b for instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab on n-h1-843834-3 Jul 19 19:56:56.525777 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-19fcb1d6-d340-4e99-b772-6143aac39078 req-fc20a611-8e0a-4ea4-8b85-51f8c67916e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062462 Jul 19 19:56:56.527133 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1699/3491] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:57.075150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-58840da3-54ec-4762-81ca-6ae55d9ea3b8 req-b730b7b5-deec-4149-90b6-9e65290e697e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-deleted", "tag": "5142b9da-6911-44d7-93c6-0f1fd5e6437a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:57.105217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-58840da3-54ec-4762-81ca-6ae55d9ea3b8 req-b730b7b5-deec-4149-90b6-9e65290e697e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.105695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-58840da3-54ec-4762-81ca-6ae55d9ea3b8 req-b730b7b5-deec-4149-90b6-9e65290e697e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.166641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-58840da3-54ec-4762-81ca-6ae55d9ea3b8 req-b730b7b5-deec-4149-90b6-9e65290e697e service nova] Creating event network-vif-deleted:5142b9da-6911-44d7-93c6-0f1fd5e6437a for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:57.180837 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-58840da3-54ec-4762-81ca-6ae55d9ea3b8 req-b730b7b5-deec-4149-90b6-9e65290e697e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110513 Jul 19 19:56:57.182543 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1700/3492] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:56:57.222726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:57.224095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:57.239699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.240673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.241549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:57.242229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:57.612913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:57.620897 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5798389e-b925-49a4-b4c6-5b41c209c579 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 2.644094 Jul 19 19:56:57.633581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1793/3493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:54 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:56:58.630264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:58.638133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:58.638882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:58.640246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:58.647548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:58.655191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-998c2a31-4f03-4cf7-a21f-5c0b78f9f3df tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 2055 microversion: 2.32 time: 1.436908 Jul 19 19:56:58.655809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1701/3494] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:57 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 2055 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:56:58.661801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.662273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:58.663144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:58.663614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.385740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7731c48c-65c2-40e9-82d6-b4ea52fba512 req-c2e5ef28-af55-4ac0-9023-fd43329fc497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569eded-0641-4bd8-baa7-43743ac48393", "name": "network-vif-deleted", "tag": "2ba4e656-104e-403b-8ef4-51a022ce309d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:56:59.401071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7731c48c-65c2-40e9-82d6-b4ea52fba512 req-c2e5ef28-af55-4ac0-9023-fd43329fc497 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.411124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7731c48c-65c2-40e9-82d6-b4ea52fba512 req-c2e5ef28-af55-4ac0-9023-fd43329fc497 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.474215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7731c48c-65c2-40e9-82d6-b4ea52fba512 req-c2e5ef28-af55-4ac0-9023-fd43329fc497 service nova] Creating event network-vif-deleted:2ba4e656-104e-403b-8ef4-51a022ce309d for instance 6569eded-0641-4bd8-baa7-43743ac48393 on n-h2-843834-3 Jul 19 19:56:59.496847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7731c48c-65c2-40e9-82d6-b4ea52fba512 req-c2e5ef28-af55-4ac0-9023-fd43329fc497 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115396 Jul 19 19:56:59.499151 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1702/3495] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:56:59.675154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:56:59.676015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:56:59.686032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.694462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.700613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.703182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:56:59.703648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:56:59.717193 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-348e38bb-40a9-4f18-b3de-6beeb6632a88 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1324 microversion: 2.1 time: 1.083288 Jul 19 19:56:59.742254 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1794/3496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:56:58 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1324 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:56:59.877840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.891157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.892853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:56:59.894080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-31cd9544-1d10-45fa-81d4-d626043f2e05 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.223693 Jul 19 19:56:59.906503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1703/3497] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:56:59 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:00.752230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:00.752948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:00.767821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.768280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.769076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.769518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.928752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:00.930337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:00.956105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.956931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:00.958977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:00.959687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.137860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.138902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.166840 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70a9afbb-3965-4872-a41e-74d8826f30a0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1520 microversion: 2.1 time: 0.420540 Jul 19 19:57:01.179430 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1795/3498] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:00 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:01.183295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.190986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:01.192786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.197040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:01.200985 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27df174e-1a1d-45cd-bf1d-585159585bf1 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.275660 Jul 19 19:57:01.204659 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1704/3499] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:00 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:01.206811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:01.213482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.215346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.216588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.218513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.256245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:57:01.397458 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0f66b1f-198b-49d1-9743-6f788737e0aa tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 204 len: 0 microversion: 2.1 time: 0.207757 Jul 19 19:57:01.398636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1796/3500] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:01 2022] DELETE /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:57:01.413737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:01.414402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:01.422864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.424365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.425596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:01.426313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:01.672469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:01.688092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e3946fd-eceb-4192-969d-81e9b1783b6f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1526 microversion: 2.1 time: 0.278745 Jul 19 19:57:01.692832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1705/3501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:01 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:02.233088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:02.234034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:02.247143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.251667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.252782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.254200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.362676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.381854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.386462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:02.390152 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a94fd201-4945-4009-9b5b-d612da3f42c6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.169106 Jul 19 19:57:02.393141 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1797/3502] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:02 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:02.711416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:02.712565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:02.728707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.729518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:02.730578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:02.731239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.410372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:03.411196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:03.424902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.425373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.430239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.431540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.616612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:03.652766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:03.665163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:03.669665 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95cdaed9-8b43-4f7a-b671-f96cee5cfced tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.263546 Jul 19 19:57:03.675372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1798/3503] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:03 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:03.712627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ce65d465-a143-4402-b882-a49555ccae9f req-92925190-8329-4608-b5bc-476fdafb73ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57cfa99-c8d2-43b7-910d-3c36e23f3cab", "name": "network-vif-deleted", "tag": "37d66bef-1144-434f-9ab7-33c68e01446b"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:03.717112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15202808da354b619062b62fcd6ef782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313f01989837474e9072dd49cc2b501a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:03.731616 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4311f7cb-4a2a-4d8a-a58b-fb334859fa0f tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 200 len: 1526 microversion: 2.1 time: 1.025155 Jul 19 19:57:03.734026 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1706/3504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:02 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 1526 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:03.745463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ce65d465-a143-4402-b882-a49555ccae9f req-92925190-8329-4608-b5bc-476fdafb73ab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:03.745916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ce65d465-a143-4402-b882-a49555ccae9f req-92925190-8329-4608-b5bc-476fdafb73ab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:03.750391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:03.761894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ce65d465-a143-4402-b882-a49555ccae9f req-92925190-8329-4608-b5bc-476fdafb73ab service nova] Creating event network-vif-deleted:37d66bef-1144-434f-9ab7-33c68e01446b for instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab on n-h1-843834-3 Jul 19 19:57:03.781317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ce65d465-a143-4402-b882-a49555ccae9f req-92925190-8329-4608-b5bc-476fdafb73ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101218 Jul 19 19:57:03.781985 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1799/3505] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:04.693867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.694905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:04.707295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.707966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.708970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.709588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.750262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.751128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: a57cfa99-c8d2-43b7-910d-3c36e23f3cab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:04.770056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.779222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.782338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.783424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.810331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab HTTP/1.1 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'a57cfa99-c8d2-43b7-910d-3c36e23f3cab'} Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.813004 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. Jul 19 19:57:04.818409 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.820509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance a57cfa99-c8d2-43b7-910d-3c36e23f3cab could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:04.821559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-038abd28-3c18-457a-997a-b8447a9613a3 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab" status: 404 len: 111 microversion: 2.1 time: 0.075640 Jul 19 19:57:04.823017 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1800/3506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:04 2022] GET /compute/v2.1/servers/a57cfa99-c8d2-43b7-910d-3c36e23f3cab => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:04.832851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dbc40ea-8abb-4b5b-b6e1-fd02382e1af0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f23ef561700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.852280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:04.877828 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8dbc40ea-8abb-4b5b-b6e1-fd02382e1af0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Image not found. Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dbc40ea-8abb-4b5b-b6e1-fd02382e1af0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 HTTP/1.1 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: exception: Image not found. Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'd20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86'} Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 to delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 could not be found. Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.879644 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dbc40ea-8abb-4b5b-b6e1-fd02382e1af0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Image not found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8dbc40ea-8abb-4b5b-b6e1-fd02382e1af0 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86" status: 404 len: 62 microversion: 2.1 time: 0.054425 Jul 19 19:57:04.885028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1801/3507] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:04 2022] DELETE /compute/v2.1/images/d20f5c4b-ef4b-43fa-bc9e-41d9b88e3a86 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:57:04.891599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.892103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:04.906417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.907620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.908525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.909263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.925237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.925915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 HTTP/1.1 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6dcc3764-65b9-481e-b124-61ed7b7acae6'} Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:04.928578 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.933383 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.935931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:04.937688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4448253e-0e82-44e8-8df7-9264fdba73b6 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 404 len: 111 microversion: 2.1 time: 0.051556 Jul 19 19:57:04.938137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:04.940473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1802/3508] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:04 2022] DELETE /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:57:04.943700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:04.943700 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1889e7ca-9159-4434-869b-dabd2e219416 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.253928 Jul 19 19:57:04.955559 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1707/3509] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:04 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:04.955680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:04.955680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 6dcc3764-65b9-481e-b124-61ed7b7acae6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:04.964457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.964913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.965715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:04.966174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:04.992881 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 HTTP/1.1 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6dcc3764-65b9-481e-b124-61ed7b7acae6'} Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:04.995601 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. Jul 19 19:57:05.000950 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:05.004380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 6dcc3764-65b9-481e-b124-61ed7b7acae6 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:05.005927 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53579346-6499-49b8-a61b-a81dc9f1d3ee tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6" status: 404 len: 111 microversion: 2.1 time: 0.060363 Jul 19 19:57:05.011716 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1803/3510] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:04 2022] GET /compute/v2.1/servers/6dcc3764-65b9-481e-b124-61ed7b7acae6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:05.015594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec20ab0c-0549-4928-a8a8-cfe59423e352 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f23ef2a2940>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:05.058223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec20ab0c-0549-4928-a8a8-cfe59423e352 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099300258" status: 202 len: 0 microversion: 2.1 time: 0.046584 Jul 19 19:57:05.061307 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1708/3511] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099300258 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:57:05.962340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:05.968444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:05.976434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.977277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:05.978321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:05.979012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.309061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:06.324440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:06.331122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:06.332729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-801ae228-9015-4fb8-8495-bd12ea6f14b7 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.374549 Jul 19 19:57:06.343878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1804/3512] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:05 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:06.697599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9dcd0a0-bdf7-4625-9e48-e204c1ea3c1d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '.version_select at 0x7f23ef29e1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:06.740646 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b9dcd0a0-bdf7-4625-9e48-e204c1ea3c1d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Image not found. Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9dcd0a0-bdf7-4625-9e48-e204c1ea3c1d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/images/cf2668e6-6203-4efd-abb4-abedf20b8e6c HTTP/1.1 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: exception: Image not found. Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'cf2668e6-6203-4efd-abb4-abedf20b8e6c'} Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cf2668e6-6203-4efd-abb4-abedf20b8e6c to delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cf2668e6-6203-4efd-abb4-abedf20b8e6c could not be found. Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.743275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9dcd0a0-bdf7-4625-9e48-e204c1ea3c1d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Image not found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9dcd0a0-bdf7-4625-9e48-e204c1ea3c1d tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/images/cf2668e6-6203-4efd-abb4-abedf20b8e6c" status: 404 len: 62 microversion: 2.1 time: 0.052455 Jul 19 19:57:06.747788 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1709/3513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:06 2022] DELETE /compute/v2.1/images/cf2668e6-6203-4efd-abb4-abedf20b8e6c => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:57:06.753538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:06.754240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:06.762938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.763385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.764189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.764630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.818813 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c HTTP/1.1 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c'} Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:06.820940 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.826648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:06.836203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdb78ad5-deb2-4f3d-abdf-502b16780f90 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 404 len: 111 microversion: 2.1 time: 0.085899 Jul 19 19:57:06.846796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:06.847872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] [instance: 51746b8f-103e-494e-bdd3-6dd50755575c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:06.851529 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1805/3514] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:57:06 2022] DELETE /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:06.855101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.855566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.856346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:06.856783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:06.882810 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] HTTP exception thrown: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Request method failure captured: Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c HTTP/1.1 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wwfNxnSVWPXFIirRiBZ1XJVncxS1b-44sqj9E-VHUqBY-Wi2Sd-vSbBUcHDmvt0xtGK4UpguVGf9xMXuH012QNx7P36RIVfwSkkDDdYO-wH_AW03S_Ib-YjyWHiovpROiKSGgAbYm7iA67DXUIzAnMlM8EpxQkj2c-OMb68o3glDac Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/313f01989837474e9072dd49cc2b501a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_313f01989837474e9072dd49cc2b501a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/313f01989837474e9072dd49cc2b501a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 313f01989837474e9072dd49cc2b501a Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 15202808da354b619062b62fcd6ef782 Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1786301850-project Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '51746b8f-103e-494e-bdd3-6dd50755575c'} Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.884641 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. Jul 19 19:57:06.889897 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:06.894016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] Returning 404 to user: Instance 51746b8f-103e-494e-bdd3-6dd50755575c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:06.897834 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-252f1604-a82b-4857-9c70-4679d1ae2263 tempest-ImagesOneServerNegativeTestJSON-1786301850 tempest-ImagesOneServerNegativeTestJSON-1786301850-project] 10.222.0.23 "GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c" status: 404 len: 111 microversion: 2.1 time: 0.056855 Jul 19 19:57:06.903197 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1710/3515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:06 2022] GET /compute/v2.1/servers/51746b8f-103e-494e-bdd3-6dd50755575c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:07.353736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:07.356330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:07.368937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:07.369483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:07.371264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:07.371889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:07.589544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:07.600203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:07.610523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:07.612548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5de5c606-378b-47b2-b0b8-99298eeb45d6 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.264148 Jul 19 19:57:07.613889 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1806/3516] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:07 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:08.482435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1299886582", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1be28aa-622f-46a7-810d-5da0d96319c1"}], "security_groups": [{"name": "tempest-securitygroup--1043613181"}], "key_name": "tempest-keypair-48588254", "user_data": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:08.651029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:08.654396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:08.696288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.698082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.699346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:08.701964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:08.987336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:09.016324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:09.018681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:09.020156 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-39e8b398-ae18-4553-94db-c2b907094d1d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.391835 Jul 19 19:57:09.023391 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1807/3517] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:08 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:09.357940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] validate_networks() for [('e1be28aa-622f-46a7-810d-5da0d96319c1', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:10.040983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:10.041604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:10.069260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:10.070689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:10.075944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:10.076906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:10.214391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:10.229635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:10.231275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:10.232558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2623e7fc-0046-4940-85cb-9c512b34ea24 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.195555 Jul 19 19:57:10.241055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1808/3518] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:10 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:11.135386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:11.137463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:11.138115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:11.138862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:11.139668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:11.169560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.170012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.170815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.171419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.217786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:11.231522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for user 1079bff73f42419d99533c176b6a7473 and project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:11.253136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:11.253880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:11.261094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:11.263440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:11.269308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.270036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.276589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:11.277879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:11.373370 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-301c0c72-ae2a-497a-be22-ed1deba90388 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.894035 Jul 19 19:57:11.375677 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1711/3519] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:11.389215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12255b49-08e7-4b3a-a24f-59e7e4c78906 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:11.391244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12255b49-08e7-4b3a-a24f-59e7e4c78906 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:11.489826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.509365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.527014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.538883 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81a3d12a-9708-4fa6-a1b7-536c1ef5cb79 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.284145 Jul 19 19:57:11.543366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1809/3520] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:11 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:11.596122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12255b49-08e7-4b3a-a24f-59e7e4c78906 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:11.609524 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12255b49-08e7-4b3a-a24f-59e7e4c78906 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1236 microversion: 2.1 time: 0.226794 Jul 19 19:57:11.611916 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1712/3521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:11 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1236 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:12.558565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:12.559221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:12.581749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.582210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.583063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.583561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.628327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:12.628935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:12.647927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.648383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.649183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:12.649620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:12.961498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.971838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.984073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc208c5e-89e4-461a-91a8-b9364a1383c9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1240 microversion: 2.1 time: 0.358068 Jul 19 19:57:12.991782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.992354 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1713/3522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:12 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1240 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:12.994118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:12.995677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc4a89ee-6ec5-46b4-80ca-37a661f8d920 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.441409 Jul 19 19:57:13.000625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1810/3523] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:12 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:14.008301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:14.008989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:14.014764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c49098d7-c8e4-4b47-b8fd-29826f526fee tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-245082416", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:14.017950 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c49098d7-c8e4-4b47-b8fd-29826f526fee tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] HTTP exception thrown: min_count must be <= max_count Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c49098d7-c8e4-4b47-b8fd-29826f526fee tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Request method failure captured: Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 183 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wyZT2Wn_xNpxkV87ezYY1Bvj9AE__2LWK0TzxgJP7mORRpdNp5uDk2J-gDla7rA07SVXhWGBVP1xmnmphkB8e-wGFVPbYIxJBMLsMEFDmFA6nmnjYWIV-wzHDVUAXZtEQsqskNO6J9zi3y0b4EGbCHkpLWBdV6HyyzanCjRKVJ_yvo Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ad623985367487c8a68a9b82e89b915"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3ea615bcf1a408795d91f2be56b062e Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-245082416", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: exception: min_count must be <= max_count Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-245082416', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 19 19:57:14.019967 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.031870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c49098d7-c8e4-4b47-b8fd-29826f526fee tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Returning 400 to user: min_count must be <= max_count {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:14.033167 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c49098d7-c8e4-4b47-b8fd-29826f526fee tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.214248 Jul 19 19:57:14.034243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.034997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.038741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.041516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.043833 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1714/3524] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:13 2022] POST /compute/v2.1/servers => generated 74 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:57:14.050495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:14.052078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:14.083302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:14.090756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.093089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.095215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:14.095684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:14.358174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.370147 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5e387c06-80ed-43fc-b7ba-14f61b0bba7f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1294 microversion: 2.1 time: 0.367893 Jul 19 19:57:14.373842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.385463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.387657 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1811/3525] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:14 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1294 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:14.393564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9bde3e8-750b-4444-98a1-a18c392691a9 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1432124672", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "max_count": 0}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:14.393972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9bde3e8-750b-4444-98a1-a18c392691a9 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Request method failure captured: Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 168 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyZT2Wn_xNpxkV87ezYY1Bvj9AE__2LWK0TzxgJP7mORRpdNp5uDk2J-gDla7rA07SVXhWGBVP1xmnmphkB8e-wGFVPbYIxJBMLsMEFDmFA6nmnjYWIV-wzHDVUAXZtEQsqskNO6J9zi3y0b4EGbCHkpLWBdV6HyyzanCjRKVJ_yvo Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ad623985367487c8a68a9b82e89b915"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3ea615bcf1a408795d91f2be56b062e Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1432124672", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "max_count": 0}} Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1432124672', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'max_count': 0}}} Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 0 Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:14.397871 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.402797 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.406210 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3ec44c1-c8db-428d-9299-78698642294e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.359268 Jul 19 19:57:14.407112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1715/3526] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:14 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:14.421889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9bde3e8-750b-4444-98a1-a18c392691a9 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:14.423252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9bde3e8-750b-4444-98a1-a18c392691a9 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034242 Jul 19 19:57:14.424080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1812/3527] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:14.493389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-122105e1-9fc0-4992-86f1-f8a186977cbe tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-646050673", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "max_count": 2.5}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-122105e1-9fc0-4992-86f1-f8a186977cbe tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Request method failure captured: Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 169 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wyZT2Wn_xNpxkV87ezYY1Bvj9AE__2LWK0TzxgJP7mORRpdNp5uDk2J-gDla7rA07SVXhWGBVP1xmnmphkB8e-wGFVPbYIxJBMLsMEFDmFA6nmnjYWIV-wzHDVUAXZtEQsqskNO6J9zi3y0b4EGbCHkpLWBdV6HyyzanCjRKVJ_yvo Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ad623985367487c8a68a9b82e89b915"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3ea615bcf1a408795d91f2be56b062e Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-646050673", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "max_count": 2.5}} Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-646050673', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'max_count': 2.5}}} Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:14.496530 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.501299 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.504473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-122105e1-9fc0-4992-86f1-f8a186977cbe tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:14.506259 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-122105e1-9fc0-4992-86f1-f8a186977cbe tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019510 Jul 19 19:57:14.508677 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1716/3528] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:14.594795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d24633b-871a-474f-85a1-a352300a8ba4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1334976159", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 0}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d24633b-871a-474f-85a1-a352300a8ba4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Request method failure captured: Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 168 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyZT2Wn_xNpxkV87ezYY1Bvj9AE__2LWK0TzxgJP7mORRpdNp5uDk2J-gDla7rA07SVXhWGBVP1xmnmphkB8e-wGFVPbYIxJBMLsMEFDmFA6nmnjYWIV-wzHDVUAXZtEQsqskNO6J9zi3y0b4EGbCHkpLWBdV6HyyzanCjRKVJ_yvo Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ad623985367487c8a68a9b82e89b915"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3ea615bcf1a408795d91f2be56b062e Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1334976159", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 0}} Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1334976159', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'min_count': 0}}} Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 0 Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:14.597711 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d24633b-871a-474f-85a1-a352300a8ba4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d24633b-871a-474f-85a1-a352300a8ba4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009884 Jul 19 19:57:14.616899 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1813/3529] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:14.858438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32f807b8-2f50-4400-8228-4d797c9830c4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1322600844", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 2.5}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32f807b8-2f50-4400-8228-4d797c9830c4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Request method failure captured: Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 170 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wyZT2Wn_xNpxkV87ezYY1Bvj9AE__2LWK0TzxgJP7mORRpdNp5uDk2J-gDla7rA07SVXhWGBVP1xmnmphkB8e-wGFVPbYIxJBMLsMEFDmFA6nmnjYWIV-wzHDVUAXZtEQsqskNO6J9zi3y0b4EGbCHkpLWBdV6HyyzanCjRKVJ_yvo Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ad623985367487c8a68a9b82e89b915"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ad623985367487c8a68a9b82e89b915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 3ad623985367487c8a68a9b82e89b915 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1481275007 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3ea615bcf1a408795d91f2be56b062e Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1481275007-project Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1322600844", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 2.5}} Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1322600844', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'min_count': 2.5}}} Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:14.861241 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:14.867724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32f807b8-2f50-4400-8228-4d797c9830c4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:14.869716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-32f807b8-2f50-4400-8228-4d797c9830c4 tempest-MultipleCreateNegativeTestJSON-1481275007 tempest-MultipleCreateNegativeTestJSON-1481275007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011286 Jul 19 19:57:14.871198 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1717/3530] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:15.406603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:15.407288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:15.428169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:15.428890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:15.432198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.432659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.433492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.433935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.452814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.453188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.455396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:15.455843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:15.766218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.775975 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8c383181-009c-461f-8f18-5835951e8102 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1294 microversion: 2.1 time: 0.375294 Jul 19 19:57:15.783635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1814/3531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:15 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1294 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:15.852914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.876529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.885731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:15.891576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85849ed1-45cd-46df-9dfb-ddb5a7beb17d tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.469317 Jul 19 19:57:15.893385 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1718/3532] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:15 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:16.793600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.794247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:16.811628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.811968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.813039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.823182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.916286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:16.917782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:16.976958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.977502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:16.978377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:16.987651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:17.213458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:17.240632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:17.242361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:17.243897 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4adea399-9913-419e-9f96-e20530755929 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.334145 Jul 19 19:57:17.244997 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1719/3533] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:17.818250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:17.835744 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15c050e1-97d1-49fd-a139-b8af6057f9e7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.040643 Jul 19 19:57:17.842368 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1815/3534] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:16 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:18.308197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:18.308992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:18.347471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.349072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.351201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.354412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.669464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.681687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.687234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:18.688835 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dae8e69b-6bbc-4511-b3d6-e9a7c6c32dbf tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.420524 Jul 19 19:57:18.697051 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1720/3535] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:18 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:18.859181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:18.860404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:18.873061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.883535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:18.885096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:18.890121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.723202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:19.728928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:19.734745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:19.753871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e0527f0-0ca4-4acc-a06f-0d135a9e03a3 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 0.898688 Jul 19 19:57:19.767482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.767996 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1816/3536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:18 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:19.768671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:19.771964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:19.779944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.527202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:20.542150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:20.544004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:20.545237 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01c30f8e-350f-405a-a44b-8d96442537ba tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.828706 Jul 19 19:57:20.559181 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1721/3537] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:19 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:20.672392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7be2f8e7-1f7b-40af-8654-657b8c1dd3ca req-29ba329a-4e6c-4f60-b201-9f1afec20dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3", "tag": "42a35503-ea87-4fd9-8050-dbd67e2157e6"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:20.696169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7be2f8e7-1f7b-40af-8654-657b8c1dd3ca req-29ba329a-4e6c-4f60-b201-9f1afec20dfd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.704173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7be2f8e7-1f7b-40af-8654-657b8c1dd3ca req-29ba329a-4e6c-4f60-b201-9f1afec20dfd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.745240 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7be2f8e7-1f7b-40af-8654-657b8c1dd3ca req-29ba329a-4e6c-4f60-b201-9f1afec20dfd service nova] Creating event network-changed:42a35503-ea87-4fd9-8050-dbd67e2157e6 for instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 on n-h1-843834-3 Jul 19 19:57:20.753300 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7be2f8e7-1f7b-40af-8654-657b8c1dd3ca req-29ba329a-4e6c-4f60-b201-9f1afec20dfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093202 Jul 19 19:57:20.754183 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1817/3538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:20.785007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:20.787087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:20.798480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.801444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.812907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:20.813770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:20.867775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:21.192078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:21.565992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:21.567115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:21.579127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:21.583624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:21.584796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:21.585468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:21.607243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:21.930001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:21.942503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:21.951336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:21.953527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84c653da-f121-49ff-9632-16c02bf7be09 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.391895 Jul 19 19:57:21.954269 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1818/3539] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:21 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:57:22.295744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:22.328520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4467bad-d45c-4fed-8ec9-f853f5dbb126 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.538114 Jul 19 19:57:22.332480 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1722/3540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:20 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:22.974017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:22.974646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:22.988693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.989300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:22.990125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:22.990564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.279621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.300916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.305085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.308252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c3ebe95-90b4-4ea5-b594-ed5537b31128 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1604 microversion: 2.32 time: 0.339118 Jul 19 19:57:23.314343 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1819/3541] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:22 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:23.349072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:23.350678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:23.363685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.365090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.368907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:23.369568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:23.962512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:23.976015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b1130fde-220f-46c1-bbab-4aa88321b319 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 0.628268 Jul 19 19:57:23.977003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1723/3542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:23 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:24.335636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:24.336349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:24.348885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:24.350107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:24.352014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:24.355682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:24.470251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:24.473280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:24.474829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lazy-loading 'fault' on Instance uuid 6569eded-0641-4bd8-baa7-43743ac48393 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:57:24.682175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:24.700248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:24.704949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97fc2886fd0c44af87fecd3a9c2000cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f519e5e8619449ab545ebb05fd23722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:24.706423 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a044f2eb-0d84-46a5-9b4a-1c6f8e97fe9c tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 200 len: 1609 microversion: 2.32 time: 0.376269 Jul 19 19:57:24.709350 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1820/3543] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:24 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 1609 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:57:24.994159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:24.995011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:25.008845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.009399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.010349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.011083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.646259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:25.657134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7c67759-e7f2-4ccc-b292-39fe4542031d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 0.666606 Jul 19 19:57:25.660525 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1724/3544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:24 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:25.728591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:25.729450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:25.736150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.741272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.744224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:25.744758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:25.763916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ab7f3cf-0c17-4bdd-9af1-a329804cba69 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23eeff2ca0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeAFevilwVY5ExNik3QhKM1ViJKQ+wHcwiKe0YFnZcoEyHD+z6BisQ1V7CWDe85/q5t2Ik/RwSgsUymqrFIf4G0QcRW/BzgqDjMSffkTNbmE6zQCNreWG/fMp3zBWkJlw=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:25.778137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4ab7f3cf-0c17-4bdd-9af1-a329804cba69 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 19:57:25.779498 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] HTTP exception thrown: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Request method failure captured: Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 HTTP/1.1 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wr6UGL9WdhQsrzbdJUv0-fXwP18QqkGjBCFi0nKJby97dDVe0eaF36NVlBo0FDvibzC_1N5tiY3nAlxcyWFK0dZlH5sB8aCORJfABFBItv6fB1g_8IcFcyUebXR6r8ZpTNx6OXYjiZzrhXAN-dyU9XJ4WE6ZJ8RxP-psCjDOag-D-M Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 97fc2886fd0c44af87fecd3a9c2000cd Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6569eded-0641-4bd8-baa7-43743ac48393'} Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.784604 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Returning 404 to user: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:25.791022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f69e96ae-d2f6-4f7a-95f9-4ddf1c5d7c43 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 404 len: 111 microversion: 2.32 time: 0.062168 Jul 19 19:57:25.792428 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1725/3545] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:25 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ab7f3cf-0c17-4bdd-9af1-a329804cba69 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 257 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeAFevilwVY5ExNik3QhKM1ViJKQ+wHcwiKe0YFnZcoEyHD+z6BisQ1V7CWDe85/q5t2Ik/RwSgsUymqrFIf4G0QcRW/BzgqDjMSffkTNbmE6zQCNreWG/fMp3zBWkJlw=="}} Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeAFevilwVY5ExNik3QhKM1ViJKQ+wHcwiKe0YFnZcoEyHD+z6BisQ1V7CWDe85/q5t2Ik/RwSgsUymqrFIf4G0QcRW/BzgqDjMSffkTNbmE6zQCNreWG/fMp3zBWkJlw=='}}} Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:25.793702 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 19:57:25.799312 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.801147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-178e8816-4406-4b58-8d58-27001efe520e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '.version_select at 0x7f23eea3f9d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:25.808020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ab7f3cf-0c17-4bdd-9af1-a329804cba69 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:25.808020 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ab7f3cf-0c17-4bdd-9af1-a329804cba69 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.259397 Jul 19 19:57:25.808865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1821/3546] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:25.814591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23eefba4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1750283842", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:25.832237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:25.838726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for user 6aeb9d43a3274259ac28ac6223eb61e2 and project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:25.845359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-178e8816-4406-4b58-8d58-27001efe520e tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632026081" status: 204 len: 0 microversion: 2.32 time: 0.048769 Jul 19 19:57:25.846080 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1726/3547] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jul 19 19:57:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632026081 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 19:57:25.860993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 2167 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1750283842", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:25.880220 n-d-843834-3 devstack@n-api.service[131229]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1750283842', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:25.882900 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:25.893476 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:25.900730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:25.901994 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb33deab-9598-45d1-8079-6c143a87be2a tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.091920 Jul 19 19:57:25.903345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1822/3548] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Jul 19 19:57:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:57:25.915466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5300870-7fc7-4068-9454-ce5ea2df5cde tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23ef2a24c0>, body: {"keypair": {"name": "tempest-keypair-1729424690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMsoHMU8Tb87+Srzety1qj9sRoVybNhb821KO97I3e827FJ9jZFUC3q1uQb0/I3Yg6jY66KLJaHu/7cPtl8cCd8oH1RFIlYd7Cfipse57CpNf0smcACMa/FCOPtUdztww=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:25.931853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c5300870-7fc7-4068-9454-ce5ea2df5cde tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:25.938060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c5300870-7fc7-4068-9454-ce5ea2df5cde tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for user 6aeb9d43a3274259ac28ac6223eb61e2 and project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:25.971070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5300870-7fc7-4068-9454-ce5ea2df5cde tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059741 Jul 19 19:57:25.972728 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1727/3549] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:57:25.985874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23eefcd9d0>, body: {"keypair": {"name": "tempest-keypair-1729424690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1vQWcLLCNTAxDlDqtENmKR2QgrTVhVOnQY7QQMZnQbzumnlUqzzZaFfzBJUrMozAG8rgbiQuoXsQiLxBLKrcNF+g5ebKzO6JNOfUa5MxRQ7qW1fTIfh9JINMynvvOrZA=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:26.001451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:26.008314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for user 6aeb9d43a3274259ac28ac6223eb61e2 and project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:26.039908 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Key pair 'tempest-keypair-1729424690' already exists. Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 273 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: {"keypair": {"name": "tempest-keypair-1729424690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1vQWcLLCNTAxDlDqtENmKR2QgrTVhVOnQY7QQMZnQbzumnlUqzzZaFfzBJUrMozAG8rgbiQuoXsQiLxBLKrcNF+g5ebKzO6JNOfUa5MxRQ7qW1fTIfh9JINMynvvOrZA=="}} Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: exception: Key pair 'tempest-keypair-1729424690' already exists. Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1729424690', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1vQWcLLCNTAxDlDqtENmKR2QgrTVhVOnQY7QQMZnQbzumnlUqzzZaFfzBJUrMozAG8rgbiQuoXsQiLxBLKrcNF+g5ebKzO6JNOfUa5MxRQ7qW1fTIfh9JINMynvvOrZA=='}}} Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '6aeb9d43a3274259ac28ac6223eb61e2-tempest-keypair-1729424690' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 19:57:26.044171 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result.read() Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 19:57:26.049431 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '6aeb9d43a3274259ac28ac6223eb61e2-tempest-keypair-1729424690' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 19, 57, 26, 32256), 'updated_at': None, 'name': 'tempest-keypair-1729424690', 'user_id': '6aeb9d43a3274259ac28ac6223eb61e2', 'fingerprint': '09:a8:cb:3a:d3:81:b0:d6:91:9b:13:e4:a5:07:31:7f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1vQWcLLCNTAxDlDqtENmKR2QgrTVhVOnQY7QQMZnQbzumnlUqzzZaFfzBJUrMozAG8rgbiQuoXsQiLxBLKrcNF+g5ebKzO6JNOfUa5MxRQ7qW1fTIfh9JINMynvvOrZA==', 'type': 'ssh'}] Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi keypair.create() Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._create() Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1729424690' already exists. Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 19 19:57:26.054366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1729424690' already exists. Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1729424690' already exists. Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 409 to user: Key pair 'tempest-keypair-1729424690' already exists. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ea63fc99-a888-4e10-9456-37fdbcb31c9c tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.064338 Jul 19 19:57:26.059211 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1823/3550] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:25 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:57:26.066588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f04978b4-e1f9-41e5-af4c-6caedf907e4f tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Calling method '.version_select at 0x7f2400991430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:26.090389 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f04978b4-e1f9-41e5-af4c-6caedf907e4f tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729424690" status: 202 len: 0 microversion: 2.1 time: 0.028474 Jul 19 19:57:26.097079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1728/3551] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 19:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729424690 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:57:26.110664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c04e44e5-be69-4e27-80e8-2fdc4fc75e36 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23ef85d5e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpha4IGzJU1aqV7ivOpNx+8kHTGRGvyN0j65isLlKU5jQu/JYi7gc0HuABG3Rb7JshXKwRDbyotAECsXt0f/sY0Th5F8b/PndbaOJLCKuCaC9jvhs5BiNQDnJA0jxsvcQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c04e44e5-be69-4e27-80e8-2fdc4fc75e36 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 247 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpha4IGzJU1aqV7ivOpNx+8kHTGRGvyN0j65isLlKU5jQu/JYi7gc0HuABG3Rb7JshXKwRDbyotAECsXt0f/sY0Th5F8b/PndbaOJLCKuCaC9jvhs5BiNQDnJA0jxsvcQ=="}} Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpha4IGzJU1aqV7ivOpNx+8kHTGRGvyN0j65isLlKU5jQu/JYi7gc0HuABG3Rb7JshXKwRDbyotAECsXt0f/sY0Th5F8b/PndbaOJLCKuCaC9jvhs5BiNQDnJA0jxsvcQ=='}}} Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi '' Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:26.113224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 19:57:26.118224 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.125939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c04e44e5-be69-4e27-80e8-2fdc4fc75e36 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.125939 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c04e44e5-be69-4e27-80e8-2fdc4fc75e36 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019603 Jul 19 19:57:26.125939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1824/3552] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:26 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:26.140422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23ef29e940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1347179478", "public_key": " "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:26.156287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:26.162447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for user 6aeb9d43a3274259ac28ac6223eb61e2 and project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:26.181056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 95 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1347179478", "public_key": " "}} Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1347179478', 'public_key': ' '}}} Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.184019 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.188715 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2c071e76-a64c-4807-aaf4-052eec9543ac tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.049101 Jul 19 19:57:26.193333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1729/3553] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Jul 19 19:57:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:57:26.201377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-645fe873-3645-4ca7-a67c-e4e36b9e5752 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23eefba310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCaEuhudjXun9Btss8zMmCLSlQi6nhFnVm/zKpx16HqTjpOgUYeSwwJPRfKly5NXDNKBZe9YXKk82IBPgooxrUZSGgZ2pYn2GXvg/dF1nRimUqXbc6tBoIQAsU+qNkTRw=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-645fe873-3645-4ca7-a67c-e4e36b9e5752 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 507 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCaEuhudjXun9Btss8zMmCLSlQi6nhFnVm/zKpx16HqTjpOgUYeSwwJPRfKly5NXDNKBZe9YXKk82IBPgooxrUZSGgZ2pYn2GXvg/dF1nRimUqXbc6tBoIQAsU+qNkTRw=="}} Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCaEuhudjXun9Btss8zMmCLSlQi6nhFnVm/zKpx16HqTjpOgUYeSwwJPRfKly5NXDNKBZe9YXKk82IBPgooxrUZSGgZ2pYn2GXvg/dF1nRimUqXbc6tBoIQAsU+qNkTRw=='}}} Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 19 19:57:26.205009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 19:57:26.211300 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.217394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-645fe873-3645-4ca7-a67c-e4e36b9e5752 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.218780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-645fe873-3645-4ca7-a67c-e4e36b9e5752 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023389 Jul 19 19:57:26.219673 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1825/3554] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:26.230584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Action: 'create', calling method: .version_select at 0x7f23ef2e1160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-786542598", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:26.248644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:26.256179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Getting quotas for user 6aeb9d43a3274259ac28ac6223eb61e2 and project 82eb3cee42074b378948871818b8ec70. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:26.276305 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 117 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-786542598", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-786542598', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 19:57:26.279305 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 19:57:26.284061 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.288865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.289553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11dc8ddc-eebe-4dec-a52c-c88b36a38e8e tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.063764 Jul 19 19:57:26.294339 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1730/3555] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 19:57:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 19:57:26.301244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4e6d67f-2062-4019-8d5d-dd112d425af6 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Calling method '.version_select at 0x7f23eefbf700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:26.316944 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e4e6d67f-2062-4019-8d5d-dd112d425af6 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4e6d67f-2062-4019-8d5d-dd112d425af6 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Request method failure captured: Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1182397717 HTTP/1.1 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wylIAXqPbsbi0PXNS4mjeSl7ZUmr4M4liulScoMdfZD_xXvu7nrCj_jzq1GFKILzPiWHUPZsyzqWrfHXpuX4Ij9jzPiz4NMi98gO0KBf2n2QZp1G774Wv-Hdho3_eswq4uHr8QIfOvBeMcMHtqrjo334VZsf2xbBg0KhXBsUDASGOc Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82eb3cee42074b378948871818b8ec70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82eb3cee42074b378948871818b8ec70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82eb3cee42074b378948871818b8ec70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 82eb3cee42074b378948871818b8ec70 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1880962271 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1880962271-project Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: exception: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'tempest-keypair-non-existent-1182397717'} Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.321019 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 Jul 19 19:57:26.327374 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:26.330946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4e6d67f-2062-4019-8d5d-dd112d425af6 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1182397717 not found for user 6aeb9d43a3274259ac28ac6223eb61e2 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:26.331317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4e6d67f-2062-4019-8d5d-dd112d425af6 tempest-KeyPairsNegativeTestJSON-1880962271 tempest-KeyPairsNegativeTestJSON-1880962271-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1182397717" status: 404 len: 145 microversion: 2.1 time: 0.034351 Jul 19 19:57:26.332419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1826/3556] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 19:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1182397717 => generated 145 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:57:26.677891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:26.679210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:26.688118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:26.688914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:26.689774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:26.691385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:27.967569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:27.976976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4066dd00-f850-4c94-b4a7-193c7e98ca61 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.303582 Jul 19 19:57:27.987301 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1731/3557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:26 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:29.008840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:29.011497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:29.026732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.028415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:29.030462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:29.034721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:30.084345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:30.094579 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a4e75924-c3cd-4e81-b9ec-06c11d09a7cf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.094237 Jul 19 19:57:30.108038 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1827/3558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:28 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:30.639877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e7bf80c4-a18a-48b2-bc8f-c11502b1a635 req-4c41c20d-dbc3-4289-923f-76d4b61ecaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3", "name": "network-vif-plugged", "status": "completed", "tag": "42a35503-ea87-4fd9-8050-dbd67e2157e6"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:30.666680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e7bf80c4-a18a-48b2-bc8f-c11502b1a635 req-4c41c20d-dbc3-4289-923f-76d4b61ecaab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:30.667356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e7bf80c4-a18a-48b2-bc8f-c11502b1a635 req-4c41c20d-dbc3-4289-923f-76d4b61ecaab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:30.730004 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e7bf80c4-a18a-48b2-bc8f-c11502b1a635 req-4c41c20d-dbc3-4289-923f-76d4b61ecaab service nova] Creating event network-vif-plugged:42a35503-ea87-4fd9-8050-dbd67e2157e6 for instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 on n-h1-843834-3 Jul 19 19:57:30.741458 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e7bf80c4-a18a-48b2-bc8f-c11502b1a635 req-4c41c20d-dbc3-4289-923f-76d4b61ecaab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105555 Jul 19 19:57:30.748347 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1732/3559] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:31.114513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:31.122465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:31.142704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:31.143894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:31.145148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:31.145919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:31.178816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:32.239301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:32.249203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e95f88f-93e8-446c-9221-8266dfc219a8 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.139261 Jul 19 19:57:32.249826 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1828/3560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:31 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:33.268630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:33.269900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:33.282937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:33.292803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:33.298980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:33.299754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:34.350377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:34.365921 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7a088c19-ed68-4ae3-9049-2d34df7f73e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1362 microversion: 2.1 time: 1.103927 Jul 19 19:57:34.375306 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1733/3561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:33 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1362 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:34.497310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-952852289", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "39d101bb-31e9-4024-8e84-d0afe4b2839f"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:34.523567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:34.621546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] validate_networks() for [('39d101bb-31e9-4024-8e84-d0afe4b2839f', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:35.387633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:35.388433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:35.398441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:35.399601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:35.400592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:35.401409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:36.019102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:36.267021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:36.726795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:36.777935 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ec7aa1b-ec45-4940-904b-d11a38734019 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1548 microversion: 2.1 time: 1.395067 Jul 19 19:57:36.797039 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1734/3562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:35 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1548 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:36.839574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:36.840522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:36.859331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:36.860078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:36.861197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:36.861808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:37.018260 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e26f25cd-e44c-4ce9-be9f-da38c990c1fe tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205588 Jul 19 19:57:37.019418 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1735/3563] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 19:57:36 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:39.291422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:39.292559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:39.293268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:39.293906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:39.295172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:39.309160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:39.309993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:39.311112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:39.311831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:39.340354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Getting quotas for project 71c2f4b9241c4697bf0517ccc2ad386a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:39.357269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Getting quotas for user a18d3a62809643e7bec7a14b27c0b11d and project 71c2f4b9241c4697bf0517ccc2ad386a. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:39.388380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:39.391661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:39.462195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e9ebcaae-8dff-4d1f-9644-8631829936e2 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.883204 Jul 19 19:57:39.463688 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1829/3564] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 5886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:57:39.475225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f888de98-ec43-4df2-8e8e-d23aad803a11 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:39.475838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f888de98-ec43-4df2-8e8e-d23aad803a11 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:39.705788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f888de98-ec43-4df2-8e8e-d23aad803a11 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:39.714485 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f888de98-ec43-4df2-8e8e-d23aad803a11 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1224 microversion: 2.1 time: 0.244221 Jul 19 19:57:39.718094 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1736/3565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:39 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1224 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:40.738275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:40.739156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:40.760912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.761372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.762620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:40.764068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:40.978132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:40.988590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-044efffe-4b14-4049-94c7-21ab18386b46 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1220 microversion: 2.1 time: 0.257067 Jul 19 19:57:40.990100 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1830/3566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:40 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1220 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:41.035806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:41.036985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:41.046013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.046820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.048233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.048855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.093866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] HTTP exception thrown: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Request method failure captured: Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 HTTP/1.1 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wr6UGL9WdhQsrzbdJUv0-fXwP18QqkGjBCFi0nKJby97dDVe0eaF36NVlBo0FDvibzC_1N5tiY3nAlxcyWFK0dZlH5sB8aCORJfABFBItv6fB1g_8IcFcyUebXR6r8ZpTNx6OXYjiZzrhXAN-dyU9XJ4WE6ZJ8RxP-psCjDOag-D-M Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 97fc2886fd0c44af87fecd3a9c2000cd Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6569eded-0641-4bd8-baa7-43743ac48393'} Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:41.095709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Returning 404 to user: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:41.100415 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ac48495-1b2e-48f9-93d0-984a370f0462 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 404 len: 111 microversion: 2.32 time: 0.065936 Jul 19 19:57:41.107118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:41.107756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] [instance: 6569eded-0641-4bd8-baa7-43743ac48393] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:41.108878 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1737/3567] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:57:41 2022] DELETE /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:41.121142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.121598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.122602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:41.124364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:41.200816 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] HTTP exception thrown: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Request method failure captured: Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 HTTP/1.1 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wr6UGL9WdhQsrzbdJUv0-fXwP18QqkGjBCFi0nKJby97dDVe0eaF36NVlBo0FDvibzC_1N5tiY3nAlxcyWFK0dZlH5sB8aCORJfABFBItv6fB1g_8IcFcyUebXR6r8ZpTNx6OXYjiZzrhXAN-dyU9XJ4WE6ZJ8RxP-psCjDOag-D-M Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f519e5e8619449ab545ebb05fd23722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6f519e5e8619449ab545ebb05fd23722 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1791651300 Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 97fc2886fd0c44af87fecd3a9c2000cd Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TaggedBootDevicesTest-1791651300-project Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6569eded-0641-4bd8-baa7-43743ac48393'} Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:57:41.202480 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. Jul 19 19:57:41.210843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:57:41.220203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] Returning 404 to user: Instance 6569eded-0641-4bd8-baa7-43743ac48393 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:57:41.221245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df9931b6-396a-4478-9e1d-833bc8a2d243 tempest-TaggedBootDevicesTest-1791651300 tempest-TaggedBootDevicesTest-1791651300-project] 10.222.0.23 "GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393" status: 404 len: 111 microversion: 2.32 time: 0.119087 Jul 19 19:57:41.228378 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1831/3568] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:57:41 2022] GET /compute/v2.1/servers/6569eded-0641-4bd8-baa7-43743ac48393 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:57:42.006408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:42.007409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:42.021322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:42.022056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.023114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:42.023743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:42.832386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-181563879", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "4453dedd-e758-49c6-8f83-4244f6a1c807"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:42.944578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:42.954709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] validate_networks() for [('4453dedd-e758-49c6-8f83-4244f6a1c807', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:57:43.007961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91b3ec3f-1612-4bf7-8ac3-08e0d58a786f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1282 microversion: 2.1 time: 0.997839 Jul 19 19:57:43.030276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1738/3569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:42 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1282 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:44.041833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:44.049026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:44.084257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:44.084982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.086321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:44.087064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:44.434511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:44.471880 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-892fb819-d137-4219-bb59-dd68c69e48ac tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1282 microversion: 2.1 time: 0.436930 Jul 19 19:57:44.499631 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1739/3570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:44 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1282 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:45.505623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:45.506284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:45.523568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:45.525998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.526543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.535271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.536402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.874514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:57:45.875856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:57:45.877220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:57:45.878869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:57:45.880613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:57:45.941272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.948221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:45.951889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:45.952743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:46.039673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:46.049194 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e048290-f1b7-42ae-87d2-176e3d50c094 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1282 microversion: 2.1 time: 0.547654 Jul 19 19:57:46.060315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1740/3571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:45 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1282 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:46.079299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Getting quotas for project c1982da1ea7c4ed8ae20c4ae780a9058. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:57:46.089901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-392105e3-6cf5-45ba-bbe6-437a45077b63 req-412970e8-da0d-4cbd-a212-ee558792a4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3", "tag": "42a35503-ea87-4fd9-8050-dbd67e2157e6"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:46.122559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Getting quotas for user 663af4bf80bd4cb8a62c989e001c2b16 and project c1982da1ea7c4ed8ae20c4ae780a9058. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:57:46.132797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-392105e3-6cf5-45ba-bbe6-437a45077b63 req-412970e8-da0d-4cbd-a212-ee558792a4d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:46.136193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-392105e3-6cf5-45ba-bbe6-437a45077b63 req-412970e8-da0d-4cbd-a212-ee558792a4d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:46.163878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:57:46.166193 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-392105e3-6cf5-45ba-bbe6-437a45077b63 req-412970e8-da0d-4cbd-a212-ee558792a4d4 service nova] Creating event network-changed:42a35503-ea87-4fd9-8050-dbd67e2157e6 for instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 on n-h1-843834-3 Jul 19 19:57:46.167945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:57:46.180798 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-392105e3-6cf5-45ba-bbe6-437a45077b63 req-412970e8-da0d-4cbd-a212-ee558792a4d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116158 Jul 19 19:57:46.181884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1741/3572] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:46.235379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bd59847-b9b9-4ef7-a72a-28bd72ce009f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.806425 Jul 19 19:57:46.236782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1832/3573] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:57:46.247924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e3a2978-d45b-430e-b70a-74e4e9169a26 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:46.249143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e3a2978-d45b-430e-b70a-74e4e9169a26 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:46.828173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e3a2978-d45b-430e-b70a-74e4e9169a26 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:46.839878 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e3a2978-d45b-430e-b70a-74e4e9169a26 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1216 microversion: 2.1 time: 0.596058 Jul 19 19:57:46.841445 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1742/3574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:46 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1216 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:47.089252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:47.090024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:47.105257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.106438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.111514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.113037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.402332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:47.420560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33843fdb-7026-4c4c-9f70-f9ecd2008362 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1282 microversion: 2.1 time: 0.335105 Jul 19 19:57:47.423274 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1833/3575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:47 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:47.859096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:47.860044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:47.886658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.887170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:47.900098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:47.900988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:48.186827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:48.210865 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef6e2235-c099-4399-be73-73962a997586 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1220 microversion: 2.1 time: 0.355964 Jul 19 19:57:48.217845 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1743/3576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:47 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1220 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:48.442157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:48.443468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:48.461850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:48.471836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:48.480127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:48.488073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:49.231062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:49.231711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:49.249444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:49.250229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:49.253802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:49.257291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:49.470686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:49.485052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2997daf4-99c6-473e-a77c-aab96d60d0f3 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 1.047096 Jul 19 19:57:49.493203 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1834/3577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:48 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:49.667478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:49.677542 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d7415f5-19dc-4596-bcf0-d80b6daab5d0 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1276 microversion: 2.1 time: 0.450603 Jul 19 19:57:49.691391 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1744/3578] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:49 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1276 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:50.509219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:50.510073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:50.532260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.534293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.538188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.539477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.697037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:50.698757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:50.726295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.732130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:50.737939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:50.738391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:51.093000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:51.098158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=80 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:51.198093 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-058bb140-0fcd-415b-8f35-fcfcdddd2876 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1274 microversion: 2.1 time: 0.505639 Jul 19 19:57:51.203575 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1745/3579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:50 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1274 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:51.329143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:51.341153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04f13e6c-2f61-492d-a515-19063baec58f tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.840553 Jul 19 19:57:51.343134 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1835/3580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:50 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:52.231915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:52.234660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:52.296135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.302223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.311285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.317870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.367544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:52.374620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:52.459073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.463807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:52.465470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:52.466291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:53.488333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:53.504566 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42e72c3b-e3ac-4c3c-a79c-27af575c13e6 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 1.285777 Jul 19 19:57:53.513369 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1746/3581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:52 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:53.674806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:53.689960 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9661f86c-58a4-4729-8480-166bfb61bace tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 1.333647 Jul 19 19:57:53.692104 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1836/3582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:52 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:54.530543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:54.532079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:54.546097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.567586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.575832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.577514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.716529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:54.717513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:54.751887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.756643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:54.759190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:54.759660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.691887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:55.704439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cecd7ca4-0bd0-40e5-b9a3-e1664c54e2e5 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 1.178380 Jul 19 19:57:55.706568 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1747/3583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:54 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:55.733970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-efa9dc9f-b579-411d-8d07-3088d0e0359b req-4067bf62-5dd4-4109-b1ee-c97af3776637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b818d6d-f7ec-443c-bb38-583bd6b29047", "tag": "352edda8-616f-4bc1-8a1e-55ae229f9628"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:55.786001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-efa9dc9f-b579-411d-8d07-3088d0e0359b req-4067bf62-5dd4-4109-b1ee-c97af3776637 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:55.790020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-efa9dc9f-b579-411d-8d07-3088d0e0359b req-4067bf62-5dd4-4109-b1ee-c97af3776637 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:55.833652 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-efa9dc9f-b579-411d-8d07-3088d0e0359b req-4067bf62-5dd4-4109-b1ee-c97af3776637 service nova] Creating event network-changed:352edda8-616f-4bc1-8a1e-55ae229f9628 for instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 on n-h2-843834-3 Jul 19 19:57:55.865012 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-efa9dc9f-b579-411d-8d07-3088d0e0359b req-4067bf62-5dd4-4109-b1ee-c97af3776637 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156341 Jul 19 19:57:55.865761 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1748/3584] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:56.026334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:56.148126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:56.299305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8df84903-43c9-46d1-ba09-6b24d9c0d533 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea3f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2021882412", "description": "tempest-description-1270492385"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:56.615675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:56.623805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e1c57eb-a8e4-4104-b124-994b14699126 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 1.915399 Jul 19 19:57:56.649494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1837/3585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:54 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:56.728734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:56.729340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:56.746700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.756315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.757362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:56.757816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:56.833141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:57:57.045649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8df84903-43c9-46d1-ba09-6b24d9c0d533 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.130596 Jul 19 19:57:57.046980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1749/3586] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:57:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:57:57.058670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68298845-0d20-4cca-a269-d3a938fb1948 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea74ca0>, body: {"security_group_rule": {"parent_group_id": "9d1ee040-2a32-42d7-8bc9-56fa7001c062", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:57.919964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:57.996052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f37e8b1b-fe0d-4268-bd98-35c3ff483d2f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 1.269094 Jul 19 19:57:57.997856 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1838/3587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:56 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:57:58.023932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:58.039962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:58.054245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.055694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.058186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:58.065070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:58.886745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:57:58.926462 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77c49639-be2e-4d4f-8545-75c870e17715 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.923283 Jul 19 19:57:58.935729 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1839/3588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:57 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:57:58.958966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-119a4cdc-6f10-480b-944a-24028e8df518 req-f2f194a9-d912-4b41-83df-91f41508e1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab0984a-f688-4ce1-8d23-b7057fb91cca", "tag": "42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:57:59.006167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-119a4cdc-6f10-480b-944a-24028e8df518 req-f2f194a9-d912-4b41-83df-91f41508e1a3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:59.009311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-119a4cdc-6f10-480b-944a-24028e8df518 req-f2f194a9-d912-4b41-83df-91f41508e1a3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.059190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-119a4cdc-6f10-480b-944a-24028e8df518 req-f2f194a9-d912-4b41-83df-91f41508e1a3 service nova] Creating event network-changed:42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e for instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca on n-h1-843834-3 Jul 19 19:57:59.080014 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-119a4cdc-6f10-480b-944a-24028e8df518 req-f2f194a9-d912-4b41-83df-91f41508e1a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137244 Jul 19 19:57:59.086878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1840/3589] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:59.118368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:57:59.121854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:57:59.151383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:59.152127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.153466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:57:59.154214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:57:59.631048 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68298845-0d20-4cca-a269-d3a938fb1948 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.576128 Jul 19 19:57:59.639171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1750/3590] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:57:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:57:59.645012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db7301d9-8612-4ca0-a439-b8d8eab42713 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea3f820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-342954195", "description": "tempest-description-1604488653"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:00.835617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:00.849142 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3559cd36-82e4-496d-a5b8-de71e83a50f3 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 1.757090 Jul 19 19:58:00.856266 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1841/3591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:57:59 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:00.862842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:00.871130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:00.885545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.886327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:00.888623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:00.890456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.642481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-db7301d9-8612-4ca0-a439-b8d8eab42713 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.002530 Jul 19 19:58:01.643566 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1751/3592] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:57:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:01.657158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-46b845a0-a629-45ac-8cbc-c50709d29883 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eeb3ab80>, body: {"security_group_rule": {"parent_group_id": "cbaa31c2-b18d-4ab6-90e9-8c2fe43fcce0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:01.826151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:01.836008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=70 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:01.840735 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60d9413f-044a-4383-99bb-7545f3d2b85e tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.982367 Jul 19 19:58:01.857598 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1842/3593] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:00 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:01.954478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.391454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:02.403383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d1a4c382-00c5-44ae-b52c-9049d15e6e1e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.525867 Jul 19 19:58:02.408897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1843/3594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:01 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:02.529480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-46b845a0-a629-45ac-8cbc-c50709d29883 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.877785 Jul 19 19:58:02.531702 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1752/3595] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:58:01 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:02.546267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6265f136-bcd3-478b-80f3-4dc6f7db38f7 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eefbf8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2043902480", "description": "tempest-description-1709425123"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:02.870031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:02.872075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:02.895138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.896109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:02.899288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:02.901972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.443673 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6265f136-bcd3-478b-80f3-4dc6f7db38f7 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.904220 Jul 19 19:58:03.444636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1844/3596] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:58:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:03.450031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:03.450970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:03.467539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.468216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.469178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:03.469762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:03.609710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:03.622162 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3bed031c-64a2-441f-bb5f-c18f46309262 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.759204 Jul 19 19:58:03.626452 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1753/3597] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:02 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:03.641293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e9d4ccd-5da0-4041-92f3-6890d78bf069 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea488b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1241162153", "description": "tempest-description-155637662"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:04.092519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:04.113543 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-25dc2afb-0b29-407b-89e4-e50b5bb79373 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.667573 Jul 19 19:58:04.123503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1845/3598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:03 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:04.443074 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e9d4ccd-5da0-4041-92f3-6890d78bf069 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.815043 Jul 19 19:58:04.446307 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1754/3599] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:58:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:04.458210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6928808-d666-44bb-bf43-467ac8011797 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eefba040>, body: {"security_group_rule": {"parent_group_id": "a89ed8a2-b4a0-4edf-b14b-7cf7260b59b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "70df4d0a-3697-4c86-893d-13ca011b9829"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:04.645917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:04.646875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:04.659817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.660403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:04.661218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:04.661722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.109599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:05.118564 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf3a3245-7070-43e4-9b91-4efd76c59ff5 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.478725 Jul 19 19:58:05.124142 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1755/3600] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:04 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:05.139898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:05.140944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:05.153094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.153724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.155344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.157428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.619885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6928808-d666-44bb-bf43-467ac8011797 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.166032 Jul 19 19:58:05.620879 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1846/3601] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:58:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:05.630717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a730fabe-8088-4c33-a1f1-7c4c779dad8e req-620ee9d3-4714-48fd-85e3-cc50f555f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b818d6d-f7ec-443c-bb38-583bd6b29047", "name": "network-vif-plugged", "status": "completed", "tag": "352edda8-616f-4bc1-8a1e-55ae229f9628"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:05.635634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:05.655202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a730fabe-8088-4c33-a1f1-7c4c779dad8e req-620ee9d3-4714-48fd-85e3-cc50f555f625 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:05.658588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a730fabe-8088-4c33-a1f1-7c4c779dad8e req-620ee9d3-4714-48fd-85e3-cc50f555f625 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:05.697007 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a730fabe-8088-4c33-a1f1-7c4c779dad8e req-620ee9d3-4714-48fd-85e3-cc50f555f625 service nova] Creating event network-vif-plugged:352edda8-616f-4bc1-8a1e-55ae229f9628 for instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 on n-h2-843834-3 Jul 19 19:58:05.710991 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a730fabe-8088-4c33-a1f1-7c4c779dad8e req-620ee9d3-4714-48fd-85e3-cc50f555f625 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087279 Jul 19 19:58:05.713517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1847/3602] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:05.725694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac0d1bbc-be67-400b-8858-7256d034d705 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eecc0b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-189915739", "description": "tempest-description-1144045495"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:06.057134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.071562 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-acd6d794-ad8d-4048-9202-fe2962556e0f tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.932877 Jul 19 19:58:06.075531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1756/3603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:05 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:06.142628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:06.143277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:06.154668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.155469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.161855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:06.162556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:06.457992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:06.470708 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1becbd10-f32e-458c-a68c-2afe0b1c688a tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1324 microversion: 2.1 time: 0.330916 Jul 19 19:58:06.472129 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1757/3604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:06 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:06.539834 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac0d1bbc-be67-400b-8858-7256d034d705 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.824694 Jul 19 19:58:06.540800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1848/3605] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:58:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:06.552493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-53437535-7d65-491f-88e5-f727efc28bd3 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea6ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1141412049", "description": "tempest-description-406720518"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:06.878646 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-53437535-7d65-491f-88e5-f727efc28bd3 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.330303 Jul 19 19:58:06.879750 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1758/3606] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:58:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:06.897514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c850c84-9faf-4d85-8cc6-81dad6a52ead tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eec04c10>, body: {"security_group_rule": {"parent_group_id": "ccb835da-877e-4d3d-bf49-ef2ff6c275ae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5637ac1f-5483-4f39-a7d0-8f219eee98f4"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:07.094429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.096500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.106440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.107348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.108544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.109344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.627851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.663171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25db1ad7-3566-4dcd-9d73-6101d39b0d65 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.568914 Jul 19 19:58:07.663937 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1759/3607] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:07.676474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.677210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:07.685621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.686417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.688329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:07.689018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:07.743634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c850c84-9faf-4d85-8cc6-81dad6a52ead tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.854163 Jul 19 19:58:07.744284 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1849/3608] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:58:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:07.755851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9fcaf34-e1b6-4776-ab56-757736215431 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eec04ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:07.985790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:07.995477 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-31ed4197-3cbf-4671-adeb-22fe52c0eef8 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1520 microversion: 2.1 time: 0.329172 Jul 19 19:58:08.017844 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1760/3609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:07 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:08.030025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.030679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.048312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.053293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.054295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.054948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.133073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] HTTP exception thrown: Action 999 not found Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Request method failure captured: Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047/os-instance-actions/999 HTTP/1.1 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wytt-LMvDgKl4SbZde5ksDQ4hdmZOdRHU9VIvJVP3SqRVNycU_Bfsv5FC0LYtArCZgzUzfj09CwBfI-PInTNht5oRRfn9UgJYyeTf1uEPLCI9AKvEBbKABLtk8cLHNrfSXs5aOj8GxLoQtsN5wILFXWeMTHurmryh8E9kjqAJXvMzc Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a18d3a62809643e7bec7a14b27c0b11d Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: exception: Action 999 not found Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '1b818d6d-f7ec-443c-bb38-583bd6b29047', 'id': '999'} Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 19 19:58:08.138688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.143567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Returning 404 to user: Action 999 not found {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:08.146945 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-82418196-a793-41d9-8bdc-eb12a49d0b05 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.127728 Jul 19 19:58:08.148123 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1761/3610] 10.222.0.23 () {58 vars in 1307 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047/os-instance-actions/999 => generated 66 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 19:58:08.171091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '.version_select at 0x7f23eea48ca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.172245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.186553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] HTTP exception thrown: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Request method failure captured: Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a/os-instance-actions HTTP/1.1 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wytt-LMvDgKl4SbZde5ksDQ4hdmZOdRHU9VIvJVP3SqRVNycU_Bfsv5FC0LYtArCZgzUzfj09CwBfI-PInTNht5oRRfn9UgJYyeTf1uEPLCI9AKvEBbKABLtk8cLHNrfSXs5aOj8GxLoQtsN5wILFXWeMTHurmryh8E9kjqAJXvMzc Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a18d3a62809643e7bec7a14b27c0b11d Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a'} Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:08.189333 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. Jul 19 19:58:08.192413 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:08.194057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Returning 404 to user: Instance 10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:08.195720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df13c726-a969-4566-b354-93e0d963aa50 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.041827 Jul 19 19:58:08.196951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1762/3611] 10.222.0.23 () {58 vars in 1295 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/10e55efd-bfd2-4a6b-b7cd-98b7bb72aa1a/os-instance-actions => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:58:08.210845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.212097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.223412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.224329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.225727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.227722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.268613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:58:08.425562 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8f359f3-bd18-458b-a37b-3559d28ab953 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 204 len: 0 microversion: 2.1 time: 0.220430 Jul 19 19:58:08.427097 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1763/3612] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:58:08 2022] DELETE /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:58:08.443868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.446442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.462302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.462878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.463690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.464126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.754851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9fcaf34-e1b6-4776-ab56-757736215431 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5637ac1f-5483-4f39-a7d0-8f219eee98f4" status: 202 len: 0 microversion: 2.1 time: 1.003388 Jul 19 19:58:08.756210 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1850/3613] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:07 2022] DELETE /compute/v2.1/os-security-groups/5637ac1f-5483-4f39-a7d0-8f219eee98f4 => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:58:08.763462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.764741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:08.786731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.788993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.793095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:08.793559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:08.802954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:08.816112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8626bd92-da00-4134-8b9a-6488d01d5ca7 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1526 microversion: 2.1 time: 0.383613 Jul 19 19:58:08.816756 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1764/3614] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1526 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:08.821452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f07b6bd-23dd-4349-8d14-bb879aeb604c tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eea16ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:08.935855 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f07b6bd-23dd-4349-8d14-bb879aeb604c tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/ccb835da-877e-4d3d-bf49-ef2ff6c275ae" status: 200 len: 247 microversion: 2.1 time: 0.117873 Jul 19 19:58:08.937722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1765/3615] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/os-security-groups/ccb835da-877e-4d3d-bf49-ef2ff6c275ae => generated 247 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:08.962108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0da8d2e-7fc9-4039-909a-4d1442e9c488 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea14e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-385369211", "description": "tempest-description-1594768929"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:09.046626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:09.067264 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f63ffa52-3baa-460a-a396-3946cf763f05 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.309707 Jul 19 19:58:09.078887 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1851/3616] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:08 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:09.192800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0da8d2e-7fc9-4039-909a-4d1442e9c488 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.242884 Jul 19 19:58:09.195174 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1766/3617] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Jul 19 19:58:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:09.219028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ffe4a03-8c7a-4c77-92ae-5d7262072abc tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eecc0a60>, body: {"security_group_rule": {"parent_group_id": "6dda85ed-14d7-4591-81ed-fa1be590fa3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:09.504375 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ffe4a03-8c7a-4c77-92ae-5d7262072abc tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.298768 Jul 19 19:58:09.505816 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1852/3618] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:58:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:09.518168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a09aae44-6ca5-4082-b58f-d42e829ef64c tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Action: 'create', calling method: .version_select at 0x7f23eea6c3a0>, body: {"security_group_rule": {"parent_group_id": "6dda85ed-14d7-4591-81ed-fa1be590fa3c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:09.847014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.852351 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a09aae44-6ca5-4082-b58f-d42e829ef64c tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.339625 Jul 19 19:58:09.852640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:09.858879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1767/3619] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Jul 19 19:58:09 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:09.864581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d1026035-1055-46cd-8645-56744f96e584 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23ef29e700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:09.874172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.875359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:09.879349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:09.881676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.253030 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d1026035-1055-46cd-8645-56744f96e584 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/6dda85ed-14d7-4591-81ed-fa1be590fa3c" status: 200 len: 664 microversion: 2.1 time: 0.392722 Jul 19 19:58:10.253891 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1768/3620] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/os-security-groups/6dda85ed-14d7-4591-81ed-fa1be590fa3c => generated 664 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:10.263531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.264583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:10.273390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.278534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.279713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:10.280474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:10.702932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.718207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7a413cd-277c-4b4b-92f0-7d75cc481b20 tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1526 microversion: 2.1 time: 0.881983 Jul 19 19:58:10.718904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1853/3621] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:09 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1526 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:10.733584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9793812f-2690-4380-9074-ff38523205ac tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eecc0430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:10.983576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:10.993741 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a6d235a-8b8c-4157-a83e-170c06d6d969 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.738480 Jul 19 19:58:10.995374 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1769/3622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:10 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:11.587746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-82f5ce40-0147-45b9-a95e-1dd038a046ef req-b3bc7327-0743-47ea-b03c-7c7974260f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab0984a-f688-4ce1-8d23-b7057fb91cca", "name": "network-vif-plugged", "status": "completed", "tag": "42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:11.602345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-82f5ce40-0147-45b9-a95e-1dd038a046ef req-b3bc7327-0743-47ea-b03c-7c7974260f2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.606800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-82f5ce40-0147-45b9-a95e-1dd038a046ef req-b3bc7327-0743-47ea-b03c-7c7974260f2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.651371 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-82f5ce40-0147-45b9-a95e-1dd038a046ef req-b3bc7327-0743-47ea-b03c-7c7974260f2d service nova] Creating event network-vif-plugged:42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e for instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca on n-h1-843834-3 Jul 19 19:58:11.666690 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-82f5ce40-0147-45b9-a95e-1dd038a046ef req-b3bc7327-0743-47ea-b03c-7c7974260f2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082777 Jul 19 19:58:11.667613 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1770/3623] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 19 19:58:11.736592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:11.737563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:11.755792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.762463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.763830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:11.764564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:11.816647 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9793812f-2690-4380-9074-ff38523205ac tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/cfd59410-0f65-49e8-9399-46d0c5ff69ea" status: 202 len: 0 microversion: 2.1 time: 1.086433 Jul 19 19:58:11.818089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1854/3624] 10.222.0.23 () {58 vars in 1286 bytes} [Tue Jul 19 19:58:10 2022] DELETE /compute/v2.1/os-security-group-rules/cfd59410-0f65-49e8-9399-46d0c5ff69ea => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:11.855078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a060a164-8087-401a-86b8-c19ba600f24e tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eefa3280>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:12.519557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18d3a62809643e7bec7a14b27c0b11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c2f4b9241c4697bf0517ccc2ad386a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:12.532339 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e90dcc3-ac2a-4772-8edb-d9e01e3bb6fc tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 200 len: 1484 microversion: 2.1 time: 0.800013 Jul 19 19:58:12.532970 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1771/3625] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:11 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 1484 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:12.555050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:12.555678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:12.564107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.564800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:12.565763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:12.566387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.119055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:13.141195 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5a13f25-351a-426c-b8e2-0824cbbe5172 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.595445 Jul 19 19:58:13.145654 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1772/3626] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:12 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:13.196726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f7c19df0-9542-4789-bf51-7fff521e6f4a req-a3055715-b9ad-4511-a188-aefcb5668e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b818d6d-f7ec-443c-bb38-583bd6b29047", "name": "network-vif-deleted", "tag": "352edda8-616f-4bc1-8a1e-55ae229f9628"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:13.218391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7c19df0-9542-4789-bf51-7fff521e6f4a req-a3055715-b9ad-4511-a188-aefcb5668e3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.219319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7c19df0-9542-4789-bf51-7fff521e6f4a req-a3055715-b9ad-4511-a188-aefcb5668e3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.226323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:13.238296 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f7c19df0-9542-4789-bf51-7fff521e6f4a req-a3055715-b9ad-4511-a188-aefcb5668e3e service nova] Creating event network-vif-deleted:352edda8-616f-4bc1-8a1e-55ae229f9628 for instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 on n-h2-843834-3 Jul 19 19:58:13.244866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f7c19df0-9542-4789-bf51-7fff521e6f4a req-a3055715-b9ad-4511-a188-aefcb5668e3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074243 Jul 19 19:58:13.246266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1773/3627] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:13.552637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:13.553858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] [instance: 1b818d6d-f7ec-443c-bb38-583bd6b29047] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:13.561141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.561770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.562698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:13.563325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:13.584101 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] HTTP exception thrown: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Request method failure captured: Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 HTTP/1.1 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wytt-LMvDgKl4SbZde5ksDQ4hdmZOdRHU9VIvJVP3SqRVNycU_Bfsv5FC0LYtArCZgzUzfj09CwBfI-PInTNht5oRRfn9UgJYyeTf1uEPLCI9AKvEBbKABLtk8cLHNrfSXs5aOj8GxLoQtsN5wILFXWeMTHurmryh8E9kjqAJXvMzc Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71c2f4b9241c4697bf0517ccc2ad386a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 71c2f4b9241c4697bf0517ccc2ad386a Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-748322007 Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a18d3a62809643e7bec7a14b27c0b11d Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-748322007-project Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1b818d6d-f7ec-443c-bb38-583bd6b29047'} Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:13.586304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. Jul 19 19:58:13.590211 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:13.591602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] Returning 404 to user: Instance 1b818d6d-f7ec-443c-bb38-583bd6b29047 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:13.592679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b93ad7e-7f21-4747-9593-40b386c31e0d tempest-InstanceActionsNegativeTestJSON-748322007 tempest-InstanceActionsNegativeTestJSON-748322007-project] 10.222.0.23 "GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047" status: 404 len: 111 microversion: 2.1 time: 0.046627 Jul 19 19:58:13.593256 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1774/3628] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:13 2022] GET /compute/v2.1/servers/1b818d6d-f7ec-443c-bb38-583bd6b29047 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:58:13.811160 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a060a164-8087-401a-86b8-c19ba600f24e tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6dda85ed-14d7-4591-81ed-fa1be590fa3c" status: 202 len: 0 microversion: 2.1 time: 1.983460 Jul 19 19:58:13.814862 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1855/3629] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:11 2022] DELETE /compute/v2.1/os-security-groups/6dda85ed-14d7-4591-81ed-fa1be590fa3c => generated 0 bytes in 1989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:58:13.821777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23ef2e15e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:14.016033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG neutronclient.v2_0.client [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist", "detail": ""}} {{(pid=131230) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 19:58:14.016656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Neutron security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 not found {{(pid=131230) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 19:58:14.017184 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] HTTP exception thrown: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.017184 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Request method failure captured: Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-security-groups/5637ac1f-5483-4f39-a7d0-8f219eee98f4 HTTP/1.1 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wzD54aeVAot0l7jwJYg-Z6OPt5yhT0SQNZoweO_SQcmkG7Lz2CSSvSqRu54HLKYFdAjg9CO2_SIxFpo7ixCLfQHtBPIaSwXth6JaoEDDuJ7JnEwVpkm93eJ_5KXSrGFwRJPV36jRLqt1ROubuG1Yhh_nVdwB3oIOjlLIDfhm2p8_No Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 953ab8eb204a4896a507b7af54e2ddc9 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1631219764 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/953ab8eb204a4896a507b7af54e2ddc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/953ab8eb204a4896a507b7af54e2ddc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_953ab8eb204a4896a507b7af54e2ddc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/953ab8eb204a4896a507b7af54e2ddc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1631219764 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 953ab8eb204a4896a507b7af54e2ddc9 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1631219764 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-SecurityGroupRulesTestJSON-1631219764-project Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3d4ca84da9e4508a25045492b956d12 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1631219764-project Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: exception: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '5637ac1f-5483-4f39-a7d0-8f219eee98f4'} Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 19:58:14.019906 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Returning 404 to user: Security group 5637ac1f-5483-4f39-a7d0-8f219eee98f4 does not exist Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: Neutron server returns request_ids: ['req-84a82568-4c04-42d6-afc3-19fad3c2f812'] {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-adbb1b67-cb25-4de7-85c8-4c68ef343e62 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5637ac1f-5483-4f39-a7d0-8f219eee98f4" status: 404 len: 194 microversion: 2.1 time: 0.205086 Jul 19 19:58:14.026749 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1775/3630] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:13 2022] DELETE /compute/v2.1/os-security-groups/5637ac1f-5483-4f39-a7d0-8f219eee98f4 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:14.032053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-926b7b2f-57be-41ee-bde3-ad3caac22a98 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23efcffe50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:14.163326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:14.164497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:14.180076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.180911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:14.181901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:14.182474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:15.063835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:15.080965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fff147a-a822-4901-98e0-ca09d71511da tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1316 microversion: 2.1 time: 0.919893 Jul 19 19:58:15.092772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1776/3631] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:14 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1316 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:15.112917 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-926b7b2f-57be-41ee-bde3-ad3caac22a98 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ccb835da-877e-4d3d-bf49-ef2ff6c275ae" status: 202 len: 0 microversion: 2.1 time: 1.086024 Jul 19 19:58:15.113581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1856/3632] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:14 2022] DELETE /compute/v2.1/os-security-groups/ccb835da-877e-4d3d-bf49-ef2ff6c275ae => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:15.131713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ba4d55f-4280-4df5-a8a0-e290589345b2 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eea6ca60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:15.593694 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ba4d55f-4280-4df5-a8a0-e290589345b2 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/70df4d0a-3697-4c86-893d-13ca011b9829" status: 202 len: 0 microversion: 2.1 time: 0.475380 Jul 19 19:58:15.597550 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1777/3633] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:15 2022] DELETE /compute/v2.1/os-security-groups/70df4d0a-3697-4c86-893d-13ca011b9829 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:15.609964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c232f870-466f-4592-8a6f-8f9872345c57 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eec95ee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:15.898780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c232f870-466f-4592-8a6f-8f9872345c57 tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a89ed8a2-b4a0-4edf-b14b-7cf7260b59b0" status: 202 len: 0 microversion: 2.1 time: 0.298030 Jul 19 19:58:15.899562 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1857/3634] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:15 2022] DELETE /compute/v2.1/os-security-groups/a89ed8a2-b4a0-4edf-b14b-7cf7260b59b0 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:15.908906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f016107-2489-49cf-a357-86b082040d2d tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eea13ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.101644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.102406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.116349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.116951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.117635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.124010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.274942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f016107-2489-49cf-a357-86b082040d2d tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/cbaa31c2-b18d-4ab6-90e9-8c2fe43fcce0" status: 202 len: 0 microversion: 2.1 time: 0.370764 Jul 19 19:58:16.275653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1778/3635] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:15 2022] DELETE /compute/v2.1/os-security-groups/cbaa31c2-b18d-4ab6-90e9-8c2fe43fcce0 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:58:16.285438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec67328f-cde9-4ef1-ae5e-ce22aa800c5d tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] Calling method '.version_select at 0x7f23eea0b670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.372928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:16.400815 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f36937d-b25c-4a7e-b715-2241b6dbb01c tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1505 microversion: 2.1 time: 0.298742 Jul 19 19:58:16.401835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1858/3636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:16.423411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.424380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.438094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.441149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.442351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.443802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.551162 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3e8d809-6034-4c22-b9e7-545b765e0b01 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips" status: 200 len: 109 microversion: 2.1 time: 0.132328 Jul 19 19:58:16.555428 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1859/3637] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips => generated 109 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:16.564088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.564848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.571659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.573068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.574107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.575020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.621867 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0fbbf6f5-03da-4b28-8a59-ec463a82d3e1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/ips" status: 200 len: 145 microversion: 2.1 time: 0.065266 Jul 19 19:58:16.632322 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1860/3638] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/ips => generated 145 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:16.640101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.641363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.649667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.650373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.652400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.653271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.699890 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9bdb0be0-c4a0-470d-99d1-9201177fc19a tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips" status: 200 len: 109 microversion: 2.1 time: 0.065523 Jul 19 19:58:16.706548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1861/3639] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips => generated 109 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:16.718848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.719854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.728839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.729532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.730647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.731289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.796893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec67328f-cde9-4ef1-ae5e-ce22aa800c5d tempest-SecurityGroupRulesTestJSON-1631219764 tempest-SecurityGroupRulesTestJSON-1631219764-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9d1ee040-2a32-42d7-8bc9-56fa7001c062" status: 202 len: 0 microversion: 2.1 time: 0.516782 Jul 19 19:58:16.798050 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1779/3640] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 19:58:16 2022] DELETE /compute/v2.1/os-security-groups/9d1ee040-2a32-42d7-8bc9-56fa7001c062 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:58:16.806075 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d044617e-9527-4b84-9c7e-a8551f000c6e tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips/tempest-ServerAddressesTestJSON-2104752410-network" status: 200 len: 94 microversion: 2.1 time: 0.095976 Jul 19 19:58:16.817540 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1862/3641] 10.222.0.23 () {58 vars in 1400 bytes} [Tue Jul 19 19:58:16 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca/ips/tempest-ServerAddressesTestJSON-2104752410-network => generated 94 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:58:16.828336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:16.829139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:16.838827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:16.840614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.841068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.841909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:16.842540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:16.890659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:58:17.130498 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5656c2b7-8a8e-48e7-8af0-f1c8c9595329 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 204 len: 0 microversion: 2.1 time: 0.312505 Jul 19 19:58:17.131173 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1780/3642] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:58:16 2022] DELETE /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:58:17.140264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:17.140898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:17.163795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.164275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.165099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:17.165568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:17.625229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:17.642570 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e6d11f1-aed7-43ba-8161-ba3a9226f31b tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1511 microversion: 2.1 time: 0.505845 Jul 19 19:58:17.645721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1863/3643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:17 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1511 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:18.666662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:18.667420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:18.696968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.704914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:18.707357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:18.708102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.073527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:20.090667 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b0945c0-3702-47a1-86e5-e04d367c6a08 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1511 microversion: 2.1 time: 1.428063 Jul 19 19:58:20.094049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1781/3644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:18 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1511 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:20.736660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64f95568-98c0-43d2-8b98-c05c361e0557"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:20.740068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:20.762663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.763795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:20.764770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:20.765378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.112479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:21.113345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:21.155380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.156125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.171552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.172084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.365791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:21.376532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a021b3f1-4ff6-4b03-b37b-66b7a2bf2c64 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1469 microversion: 2.1 time: 0.268285 Jul 19 19:58:21.391809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1782/3645] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:21 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:21.436529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3a1c6dd4-d07b-453a-b600-cf9321238097 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710392 Jul 19 19:58:21.437111 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1864/3646] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 19:58:20 2022] POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:21.808789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b102614c-7174-4a10-89bc-da53057e293a req-ca96ea01-c37d-4c4f-8891-1745d30cbc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab0984a-f688-4ce1-8d23-b7057fb91cca", "name": "network-vif-deleted", "tag": "42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:21.827482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b102614c-7174-4a10-89bc-da53057e293a req-ca96ea01-c37d-4c4f-8891-1745d30cbc28 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:21.841949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b102614c-7174-4a10-89bc-da53057e293a req-ca96ea01-c37d-4c4f-8891-1745d30cbc28 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:21.896008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b102614c-7174-4a10-89bc-da53057e293a req-ca96ea01-c37d-4c4f-8891-1745d30cbc28 service nova] Creating event network-vif-deleted:42ed5692-7b26-40d8-a2c8-4bff8a4c9d8e for instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca on n-h1-843834-3 Jul 19 19:58:21.904708 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b102614c-7174-4a10-89bc-da53057e293a req-ca96ea01-c37d-4c4f-8891-1745d30cbc28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101001 Jul 19 19:58:21.910033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1783/3647] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:22.409630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:22.410372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:22.439574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:22.440045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:22.440839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:22.441302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:22.556843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:22.558811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:22.559463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lazy-loading 'fault' on Instance uuid 1ab0984a-f688-4ce1-8d23-b7057fb91cca {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:58:22.693758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663af4bf80bd4cb8a62c989e001c2b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1982da1ea7c4ed8ae20c4ae780a9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:22.712397 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93378ff1-fc3c-4ea9-9b8b-23da9093d990 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 200 len: 1306 microversion: 2.1 time: 0.307179 Jul 19 19:58:22.731179 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1865/3648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:22 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:23.746082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:23.746881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] [instance: 1ab0984a-f688-4ce1-8d23-b7057fb91cca] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:23.773195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.773709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.777087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:23.779301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:23.877775 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] HTTP exception thrown: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Request method failure captured: Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca HTTP/1.1 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wy1B-G5oBUYhdKtW9lCf-_7TbqRPP3BwBfE6PygAuNfIBDg6ExEnTXYzgI1Hd8Z_i_T-N63_t33E9e65SHogYt0fj_819sKHKhKrqEnFJaoNTnJF-_8-A-vetAdUgeeX-9pdDtMcfiJkZWYfxG-HehI38zEhDmyUXgoRiXe8PO3dOQ Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c1982da1ea7c4ed8ae20c4ae780a9058 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerAddressesTestJSON-1598981732 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1982da1ea7c4ed8ae20c4ae780a9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1982da1ea7c4ed8ae20c4ae780a9058"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1982da1ea7c4ed8ae20c4ae780a9058"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1982da1ea7c4ed8ae20c4ae780a9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerAddressesTestJSON-1598981732 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c1982da1ea7c4ed8ae20c4ae780a9058 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1598981732 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerAddressesTestJSON-1598981732-project Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 663af4bf80bd4cb8a62c989e001c2b16 Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerAddressesTestJSON-1598981732-project Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1ab0984a-f688-4ce1-8d23-b7057fb91cca'} Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:58:23.884355 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. Jul 19 19:58:23.889266 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:58:23.895512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] Returning 404 to user: Instance 1ab0984a-f688-4ce1-8d23-b7057fb91cca could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:58:23.898190 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec5c134c-0248-4573-8fcf-8198425f6816 tempest-ServerAddressesTestJSON-1598981732 tempest-ServerAddressesTestJSON-1598981732-project] 10.222.0.23 "GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca" status: 404 len: 111 microversion: 2.1 time: 0.160075 Jul 19 19:58:23.902155 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1784/3649] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:23 2022] GET /compute/v2.1/servers/1ab0984a-f688-4ce1-8d23-b7057fb91cca => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:58:37.251386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=23 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:37.253215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:37.507744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-589290247", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0ddeeb6e-92a1-4066-88ba-9db7e5ed9672"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:37.614343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] validate_networks() for [('0ddeeb6e-92a1-4066-88ba-9db7e5ed9672', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:37.616669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de30eec3-3347-4308-9337-f5b0cdd33553 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:37.629862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:37.631369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:37.637337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de30eec3-3347-4308-9337-f5b0cdd33553 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.640488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de30eec3-3347-4308-9337-f5b0cdd33553 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.707507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de30eec3-3347-4308-9337-f5b0cdd33553 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:58:37.806419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de30eec3-3347-4308-9337-f5b0cdd33553 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.194921 Jul 19 19:58:37.818156 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1785/3650] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:58:37 2022] POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 19:58:37.827188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:37.827979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:37.841225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.841744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:37.842853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:37.845382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:38.577457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:38.586678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b174270-a6e4-47df-bb31-a6cdf59fbe8c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 0.763906 Jul 19 19:58:38.587380 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1786/3651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:37 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:39.245518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:39.247399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:39.248884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:39.249906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:39.251131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:39.273755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.274950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.276751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.277709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.349166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:39.364422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for user 3926da8f9dc6459f87f9e861110dbb9f and project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:39.395144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:39.398972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:39.511237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bbc49812-d9b7-4894-937c-533931c81d1c tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263088 Jul 19 19:58:39.512616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1866/3652] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:39.621564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:39.626353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:39.653066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.658825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.662443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:39.667577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:39.746367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1657591153", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0ddeeb6e-92a1-4066-88ba-9db7e5ed9672"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:39.908042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] validate_networks() for [('0ddeeb6e-92a1-4066-88ba-9db7e5ed9672', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:41.057005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:41.072758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9f1df7b-a655-45fe-83a1-276fa6a5678d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.470197 Jul 19 19:58:41.074838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1787/3653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:39 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:42.092726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:42.093465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:42.104690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.105140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.105926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:42.106357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:42.904844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:42.915799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-589e8a2e-fd4e-431b-82be-b3f20e4e5c3a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 0.827629 Jul 19 19:58:42.917203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1788/3654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:42 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:42.985252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:42.985987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:42.988100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:42.988826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:42.990094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:43.008646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.009399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.010456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.011201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.064069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:43.071316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for user 3926da8f9dc6459f87f9e861110dbb9f and project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:43.087325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:43.090200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:43.164495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04b23fea-eb78-455a-9c2d-1c5cbfec25e0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427446 Jul 19 19:58:43.180095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1867/3655] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:58:43.446704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-50869693", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "451", "networks": [{"uuid": "0ddeeb6e-92a1-4066-88ba-9db7e5ed9672"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:43.564754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] validate_networks() for [('0ddeeb6e-92a1-4066-88ba-9db7e5ed9672', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:58:43.934279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:43.934845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:43.966202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.968083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:43.969397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:43.975088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:46.286727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:46.311413 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96d6726f-dd8a-4ba3-8d48-1bc25dd5fe15 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 2.381379 Jul 19 19:58:46.318824 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1868/3656] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:43 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:47.329629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:47.331158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:47.350514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.351018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:47.358362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:47.359515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.218227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:58:48.219073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:58:48.221102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:58:48.223697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:58:48.227593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:58:48.250769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.251425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.252433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:48.253560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:48.294871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:58:48.302676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Getting quotas for user 3926da8f9dc6459f87f9e861110dbb9f and project 7108236f125544d2bf2b8fd7671a04cf. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:58:48.318467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:58:48.321292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:58:48.398875 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a005dddf-9f19-4206-a065-297fcdd600da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.957375 Jul 19 19:58:48.400270 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1789/3657] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:58:48.432296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c43b9855-7b6d-4094-b976-f8f34163f489 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:48.435830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c43b9855-7b6d-4094-b976-f8f34163f489 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:48.826776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:48.836176 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8cb3b22d-231f-44fe-a31e-8163ae66d60b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.510300 Jul 19 19:58:48.848239 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1869/3658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:47 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:49.248999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c43b9855-7b6d-4094-b976-f8f34163f489 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:49.258716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c43b9855-7b6d-4094-b976-f8f34163f489 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1219 microversion: 2.1 time: 0.849222 Jul 19 19:58:49.271722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1790/3659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:48 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1219 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:49.867641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:49.869505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:49.885581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:49.887082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:49.889216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:49.889891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.291213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:50.295032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:50.324749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.325615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.331747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.332208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.572198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.583923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2ff4ed39-df76-4f3d-89b1-e83e2446dd4a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1289 microversion: 2.1 time: 0.309753 Jul 19 19:58:50.584991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1791/3660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:50 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1289 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:50.866964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:50.876314 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ec71b452-9419-4c7d-b071-b23ea76a3858 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.014370 Jul 19 19:58:50.893609 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1870/3661] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:49 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:50.895489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b1308a44-4be2-4f1b-97a9-2f23315ccfac req-b88d8339-57c2-4439-976d-1065e6417d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ce26a9-f431-4e0f-8e56-b914982c006e", "tag": "46b3358c-323f-494d-b99c-f8cffe436370"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:50.919587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b1308a44-4be2-4f1b-97a9-2f23315ccfac req-b88d8339-57c2-4439-976d-1065e6417d78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:50.920865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b1308a44-4be2-4f1b-97a9-2f23315ccfac req-b88d8339-57c2-4439-976d-1065e6417d78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:50.942486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b1308a44-4be2-4f1b-97a9-2f23315ccfac req-b88d8339-57c2-4439-976d-1065e6417d78 service nova] Creating event network-changed:46b3358c-323f-494d-b99c-f8cffe436370 for instance 18ce26a9-f431-4e0f-8e56-b914982c006e on n-h2-843834-3 Jul 19 19:58:50.952061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b1308a44-4be2-4f1b-97a9-2f23315ccfac req-b88d8339-57c2-4439-976d-1065e6417d78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094869 Jul 19 19:58:50.953766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1792/3662] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:51.602009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:51.603045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:51.615726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.618605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.619726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.620388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.896904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:51.901438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:51.902319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:51.913773 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8eb0812f-0baf-493d-9e39-1d0a85bb2050 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1277 microversion: 2.1 time: 0.314052 Jul 19 19:58:51.914856 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1871/3663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:51 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:51.927030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.927903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:51.928844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:51.929360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:52.652326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:52.680383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8a25514-25a3-4aa1-9e17-cc894f6a9033 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 0.782782 Jul 19 19:58:52.686395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1793/3664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:51 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:58:52.945860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:52.948630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:52.965488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.966217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:52.967213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:52.967804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:53.048035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:53.083170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:53.705748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:53.706659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:53.721175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:53.721856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:53.722748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:53.724088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:54.329791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.346189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-20b63bb0-e7dc-46d2-937c-4da1a78d6450 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 1.412481 Jul 19 19:58:54.358406 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1872/3665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:52 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:54.669680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:54.680035 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7de3b04-f885-4d44-9bac-18f7b6bf858f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 0.978526 Jul 19 19:58:54.683172 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1794/3666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:53 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:55.364864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:55.366094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:55.375817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.384832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.393362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.393865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.700624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:55.701451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:55.714236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.721341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:55.722252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:55.731274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:56.640814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:56.654141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5587490-bc1c-4d64-ae65-8c3a97565f93 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 1.293397 Jul 19 19:58:56.658521 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1873/3667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:55 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:57.040057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:57.056038 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5abdfbc4-3632-4c65-9a13-a430585227bb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.362689 Jul 19 19:58:57.056887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1795/3668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:55 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:57.675589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:57.676035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:57.690983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.691430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:57.692226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:57.692670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.075179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:58.075627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:58.101745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.102594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.106825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.110029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.275920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:58.575963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:58.595724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d803940-2ec6-4e5d-89d5-2c9754e050e5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 0.924438 Jul 19 19:58:58.596550 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1874/3669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:57 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:58.610824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4747fdf1-8e10-428a-8501-35ff3f168a81 req-07a22c38-85b6-4e9c-9473-dadbc16a312c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5dae52-d633-4aa9-bd8c-95008f06d052", "tag": "5a63176c-7d1e-4175-a8be-aac80ec4614e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:58.651756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4747fdf1-8e10-428a-8501-35ff3f168a81 req-07a22c38-85b6-4e9c-9473-dadbc16a312c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.655770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4747fdf1-8e10-428a-8501-35ff3f168a81 req-07a22c38-85b6-4e9c-9473-dadbc16a312c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.705175 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4747fdf1-8e10-428a-8501-35ff3f168a81 req-07a22c38-85b6-4e9c-9473-dadbc16a312c service nova] Creating event network-changed:5a63176c-7d1e-4175-a8be-aac80ec4614e for instance ac5dae52-d633-4aa9-bd8c-95008f06d052 on n-h2-843834-3 Jul 19 19:58:58.724136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4747fdf1-8e10-428a-8501-35ff3f168a81 req-07a22c38-85b6-4e9c-9473-dadbc16a312c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125935 Jul 19 19:58:58.725024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1875/3670] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:58:58.741195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-771dc25a-ec1e-4dfc-8884-935c73a11b39 req-1989d945-57af-4caf-938b-56f5025c7671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b304b6-b644-4aae-a775-01a8da028967", "tag": "09a14a8c-95a8-4b5b-bae6-63b84b49a9fa"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:58:58.758872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-771dc25a-ec1e-4dfc-8884-935c73a11b39 req-1989d945-57af-4caf-938b-56f5025c7671 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:58.761401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-771dc25a-ec1e-4dfc-8884-935c73a11b39 req-1989d945-57af-4caf-938b-56f5025c7671 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:58.789119 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-771dc25a-ec1e-4dfc-8884-935c73a11b39 req-1989d945-57af-4caf-938b-56f5025c7671 service nova] Creating event network-changed:09a14a8c-95a8-4b5b-bae6-63b84b49a9fa for instance e4b304b6-b644-4aae-a775-01a8da028967 on n-h1-843834-3 Jul 19 19:58:58.819247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-771dc25a-ec1e-4dfc-8884-935c73a11b39 req-1989d945-57af-4caf-938b-56f5025c7671 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090557 Jul 19 19:58:58.820589 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1876/3671] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:58:58.914551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:58:58.926056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fd67334-7aeb-4137-9707-83e5ecf35bba tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 0.856158 Jul 19 19:58:58.926968 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1796/3672] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:58 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:58:59.614481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:59.615384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.622264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.623103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.624158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.624830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.944155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:58:59.945355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:58:59.952037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:58:59.954367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.955060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:58:59.956180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:58:59.956766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:00.347214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:00.358209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1c5f22fb-a6c9-4df7-a804-e63936b1adea tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 0.748231 Jul 19 19:59:00.360978 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1877/3673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:59 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:01.091471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:01.099904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-96d847cf-60eb-412c-b7ed-b49799be6afc tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.159619 Jul 19 19:59:01.100528 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1797/3674] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:58:59 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:01.377417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:01.378789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:01.386184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.399624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:01.400913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:01.401571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.058001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:02.071447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-905ccd17-44ef-4069-bfcb-19e89e3f4dad tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 0.697912 Jul 19 19:59:02.075788 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1878/3675] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:01 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:02.095035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-baec937d-6107-41dc-9c78-dbfa78a5ca5c req-d27d855a-4ae0-467e-a64c-a19bf0ce2c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ce26a9-f431-4e0f-8e56-b914982c006e", "name": "network-vif-plugged", "status": "completed", "tag": "46b3358c-323f-494d-b99c-f8cffe436370"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:02.105788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-943271361", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "000c266f-515e-47cb-9777-07879d497d69"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:02.127707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-baec937d-6107-41dc-9c78-dbfa78a5ca5c req-d27d855a-4ae0-467e-a64c-a19bf0ce2c7e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:02.130943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-baec937d-6107-41dc-9c78-dbfa78a5ca5c req-d27d855a-4ae0-467e-a64c-a19bf0ce2c7e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.164841 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-baec937d-6107-41dc-9c78-dbfa78a5ca5c req-d27d855a-4ae0-467e-a64c-a19bf0ce2c7e service nova] Creating event network-vif-plugged:46b3358c-323f-494d-b99c-f8cffe436370 for instance 18ce26a9-f431-4e0f-8e56-b914982c006e on n-h2-843834-3 Jul 19 19:59:02.178019 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-baec937d-6107-41dc-9c78-dbfa78a5ca5c req-d27d855a-4ae0-467e-a64c-a19bf0ce2c7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099398 Jul 19 19:59:02.180100 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1879/3676] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:02.195017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:02.198076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:02.216557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:02.217233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.218542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:02.220250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:02.226318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] validate_networks() for [('000c266f-515e-47cb-9777-07879d497d69', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:03.252247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:03.265150 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1dd20f50-8919-417c-a8b8-dbe7f0831910 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1722 microversion: 2.1 time: 1.083508 Jul 19 19:59:03.265761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1880/3677] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:02 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1722 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:03.409157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-658382681", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:03.517894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] validate_networks() for [('8b67c12f-7a1c-4171-ae6e-8903c66c3dc2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:05.970408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:05.972275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:05.973031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:05.973676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:05.974327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:05.999492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.000424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.005960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.006877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.060344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Getting quotas for project 74b2bc4e5a7c4ebeb026fbd314970db8. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:06.073637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Getting quotas for user f9196dbfe4764b7694b2179ece300d6b and project 74b2bc4e5a7c4ebeb026fbd314970db8. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:06.093427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:06.096484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:06.170866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d8e0adf-6beb-44a4-a28a-6e94d97cfc1b tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.398916 Jul 19 19:59:06.179509 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1798/3678] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 19:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4403 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 19 19:59:06.183559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:06.183559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:06.201984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.202448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.203280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.203775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.701824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:06.703897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:06.705017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:06.705763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:06.706439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:06.727994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.733404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.734480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.735048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.777659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Getting quotas for project 8f2ccedd522c4d61a6d3573da98b9ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:06.784567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Getting quotas for user c6ca5e22ec9e444691324207124798a2 and project 8f2ccedd522c4d61a6d3573da98b9ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:06.787868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:06.801877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61b685a5-7392-428e-a1c7-7d462115c604 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 0.625986 Jul 19 19:59:06.805374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:06.806593 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1799/3679] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:06 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:06.808292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:06.812761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:06.813470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:06.838714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.839288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.840313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:06.840929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:06.891996 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-391c7573-7721-42b3-8f6b-c02085dc6870 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.625055 Jul 19 19:59:06.894542 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1881/3680] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:59:07.078897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Action: 'create', calling method: .version_select at 0x7f23ef85d670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:07.136179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Getting quotas for project ae47f6dc2130426e8ba424934f175fac. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:07.148385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Getting quotas for user d3c0d6880ba2459cb0675717880c1339 and project ae47f6dc2130426e8ba424934f175fac. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:07.271299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Getting quotas for project ae47f6dc2130426e8ba424934f175fac. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:07.317455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=11 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:07.322145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Getting quotas for user d3c0d6880ba2459cb0675717880c1339 and project ae47f6dc2130426e8ba424934f175fac. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:07.405384 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f531487-b621-4cdb-aa59-3fcae74a57a6 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.509342 Jul 19 19:59:07.419281 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1882/3681] 10.222.0.23 () {62 vars in 1213 bytes} [Tue Jul 19 19:59:06 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:59:07.435487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.436128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:07.454179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.457435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.458452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.461089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.467124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=73 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:07.693546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.701461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.713431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-754eb5ac-6567-4b3e-abcb-857ece18063b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1699 microversion: 2.1 time: 0.905601 Jul 19 19:59:07.714063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1800/3682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:06 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1699 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:07.716476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.718699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:07.724810 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fea8ccd-5558-4d9d-9450-783ace8a962c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1254 microversion: 2.21 time: 0.304347 Jul 19 19:59:07.736052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a200fc0-d285-423b-b0e0-a35c59ae7a7e tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.736680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a200fc0-d285-423b-b0e0-a35c59ae7a7e tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:07.738823 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1883/3683] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1254 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:07.750631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed92557c-4f25-4094-b783-b92a840f5935 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:07.790563 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed92557c-4f25-4094-b783-b92a840f5935 tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050282 Jul 19 19:59:07.795014 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1884/3684] 10.222.0.23 () {60 vars in 1192 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:59:07.814124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74cd03a4-cb66-46cb-b2c7-6cd4b493c7af tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:07.836534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74cd03a4-cb66-46cb-b2c7-6cd4b493c7af tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:07.841422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74cd03a4-cb66-46cb-b2c7-6cd4b493c7af tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:07.949225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-74cd03a4-cb66-46cb-b2c7-6cd4b493c7af tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Going to try to start instance {{(pid=131229) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 19:59:08.065202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74cd03a4-cb66-46cb-b2c7-6cd4b493c7af tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.268018 Jul 19 19:59:08.066195 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1885/3685] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:07 2022] POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:08.074698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6552e659-6bea-409a-b99d-a841c5dea08a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.105624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6552e659-6bea-409a-b99d-a841c5dea08a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902" status: 200 len: 235 microversion: 2.64 time: 0.038118 Jul 19 19:59:08.106250 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1886/3686] 10.222.0.23 () {60 vars in 1303 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902 => generated 235 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:59:08.119700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.120510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.135834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a200fc0-d285-423b-b0e0-a35c59ae7a7e tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:08.142952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.143798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.146220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.147413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a200fc0-d285-423b-b0e0-a35c59ae7a7e tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1223 microversion: 2.1 time: 0.432222 Jul 19 19:59:08.149492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.152252 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1801/3687] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:07 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1223 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:08.179991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:08.181086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:08.193804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:08.221874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.225939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.230655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:08.231480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:08.249964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:10.028508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.057323 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f97e8803-faca-4c5e-a38b-f10c5079c681 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 1.949542 Jul 19 19:59:10.059130 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1887/3688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:10.101513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-150a4fdb-dc83-4ef8-b2ab-3afc6326e64d tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.208339 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-150a4fdb-dc83-4ef8-b2ab-3afc6326e64d tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902" status: 204 len: 0 microversion: 2.64 time: 0.127263 Jul 19 19:59:10.212379 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1888/3689] 10.222.0.23 () {60 vars in 1306 bytes} [Tue Jul 19 19:59:10 2022] DELETE /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 19:59:10.226326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.239980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.245020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:10.273574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.274851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.277827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.279537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.286424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68498178-c320-4d61-a147-cb8c9b929032 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1708 microversion: 2.1 time: 2.126042 Jul 19 19:59:10.289301 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1802/3690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:08 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1708 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:10.315057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.316831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:10.330706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.332425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.334203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.335383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:10.884451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.893078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.918730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.923316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d2e0998-6343-4be1-83f9-99fd3d9e9780 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1281 microversion: 2.1 time: 0.631958 Jul 19 19:59:10.924703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:10.926729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2c0566b-a87a-4d2e-ba9f-40f99f4bfda7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1316 microversion: 2.21 time: 0.711962 Jul 19 19:59:10.927761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1889/3691] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:10 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:10.929108 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1803/3692] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:10 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1281 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:10.948175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-316ce564-dad9-4d43-a66f-500b1a95e89a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:10.955341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4a832c82-07d9-42b4-b501-3ae3da4adae4 req-2f351cd3-db8e-44bc-9a90-20c014a8bb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5dae52-d633-4aa9-bd8c-95008f06d052", "name": "network-vif-plugged", "status": "completed", "tag": "5a63176c-7d1e-4175-a8be-aac80ec4614e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:10.984726 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-316ce564-dad9-4d43-a66f-500b1a95e89a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] HTTP exception thrown: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. Jul 19 19:59:10.989331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4a832c82-07d9-42b4-b501-3ae3da4adae4 req-2f351cd3-db8e-44bc-9a90-20c014a8bb93 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:10.992668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4a832c82-07d9-42b4-b501-3ae3da4adae4 req-2f351cd3-db8e-44bc-9a90-20c014a8bb93 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-316ce564-dad9-4d43-a66f-500b1a95e89a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Request method failure captured: Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902 HTTP/1.1 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Il9hQYi4Ik5sxyu6Qwit7iYqZ8sPZBLPlwKlXL-CXoUyyN6rNPd6aAtOJWmRLZxbDiPM3ORoJKgMlZ7VpBovyA_wYy7AfRmGIKwtRkRLHH81hpkKxXbnAsKNAeZHLgd9M-fBBWNKjxpPUMnWD6VA75YvuCsyEIZYGTXhHxMq8jK0 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.64 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ae47f6dc2130426e8ba424934f175fac Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroup264TestJSON-780111156 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae47f6dc2130426e8ba424934f175fac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ae47f6dc2130426e8ba424934f175fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ae47f6dc2130426e8ba424934f175fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae47f6dc2130426e8ba424934f175fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroup264TestJSON-780111156 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ae47f6dc2130426e8ba424934f175fac Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroup264TestJSON-780111156 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroup264TestJSON-780111156-project Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d3c0d6880ba2459cb0675717880c1339 Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroup264TestJSON-780111156-project Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd65a2925-bce3-426f-bd7a-578204aac902'} Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:11.001304 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. Jul 19 19:59:11.008779 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:11.026597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-316ce564-dad9-4d43-a66f-500b1a95e89a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] Returning 404 to user: Instance group d65a2925-bce3-426f-bd7a-578204aac902 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:11.028673 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-316ce564-dad9-4d43-a66f-500b1a95e89a tempest-ServerGroup264TestJSON-780111156 tempest-ServerGroup264TestJSON-780111156-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902" status: 404 len: 117 microversion: 2.64 time: 0.094268 Jul 19 19:59:11.038231 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1804/3693] 10.222.0.23 () {60 vars in 1306 bytes} [Tue Jul 19 19:59:10 2022] DELETE /compute/v2.1/os-server-groups/d65a2925-bce3-426f-bd7a-578204aac902 => generated 117 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:59:11.061036 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4a832c82-07d9-42b4-b501-3ae3da4adae4 req-2f351cd3-db8e-44bc-9a90-20c014a8bb93 service nova] Creating event network-vif-plugged:5a63176c-7d1e-4175-a8be-aac80ec4614e for instance ac5dae52-d633-4aa9-bd8c-95008f06d052 on n-h2-843834-3 Jul 19 19:59:11.088304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:11.092590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4a832c82-07d9-42b4-b501-3ae3da4adae4 req-2f351cd3-db8e-44bc-9a90-20c014a8bb93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157342 Jul 19 19:59:11.094274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:11.106815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1890/3694] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:11.161658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.163095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.164768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.168115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.327364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:11.329197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:11.356759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.364694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:11.368251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:11.371124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.629335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.651121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab6ba159-ee6d-4812-b04f-35de9cc258c5 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 1.571328 Jul 19 19:59:12.652469 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1805/3695] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:11 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:12.678346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.679926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.692762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.694228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.696003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.697021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.856291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.892769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.894748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:12.903603 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-50b2e02a-d456-4ffb-a5f8-244ebc3453a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1316 microversion: 2.21 time: 0.231492 Jul 19 19:59:12.905351 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1806/3696] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:12.922888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:12.928387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:12.943170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.944209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:12.945867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:12.946529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.016897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:13.060769 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90b2146b-ac36-4c8e-ab9b-3bfa4b54864e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1708 microversion: 2.1 time: 1.747194 Jul 19 19:59:13.067492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1891/3697] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:11 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1708 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:13.150433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6ee37b8e-3e89-4eea-85e1-a2f47945a434 req-cb8610c6-9810-40da-bf26-07174b09fcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b304b6-b644-4aae-a775-01a8da028967", "name": "network-vif-plugged", "status": "completed", "tag": "09a14a8c-95a8-4b5b-bae6-63b84b49a9fa"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:13.173487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6ee37b8e-3e89-4eea-85e1-a2f47945a434 req-cb8610c6-9810-40da-bf26-07174b09fcd9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.173785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6ee37b8e-3e89-4eea-85e1-a2f47945a434 req-cb8610c6-9810-40da-bf26-07174b09fcd9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.214012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6ee37b8e-3e89-4eea-85e1-a2f47945a434 req-cb8610c6-9810-40da-bf26-07174b09fcd9 service nova] Creating event network-vif-plugged:09a14a8c-95a8-4b5b-bae6-63b84b49a9fa for instance e4b304b6-b644-4aae-a775-01a8da028967 on n-h1-843834-3 Jul 19 19:59:13.221769 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6ee37b8e-3e89-4eea-85e1-a2f47945a434 req-cb8610c6-9810-40da-bf26-07174b09fcd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078244 Jul 19 19:59:13.223236 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1892/3698] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:13.373076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:13.396402 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6439683-8319-4e70-ad8d-421d949171f3 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1281 microversion: 2.1 time: 0.488106 Jul 19 19:59:13.397997 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1807/3699] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:12 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1281 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:13.679436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:13.680205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:13.705748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.706231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.707103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:13.707552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:13.934024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:13.946083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.019767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.026805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.033505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.054038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.793037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.811635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.819912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.825449 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1840f5a6-6b51-4219-b960-2cff5c98af34 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1316 microversion: 2.21 time: 0.896724 Jul 19 19:59:14.827831 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1808/3700] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:13 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:14.851013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.854138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.890636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:14.894563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.896120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.899528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.900830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.907321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f0555ab3-09a2-4811-84ef-42190a313285 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1319 microversion: 2.1 time: 1.231890 Jul 19 19:59:14.917628 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1893/3701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:13 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1319 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:14.921709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:14.923045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:14.937828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.939255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:14.940667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:14.941371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.932650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:15.935811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:15.944526 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-105ff14a-7d08-4ca7-b134-8c122611bf7c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1712 microversion: 2.1 time: 1.112327 Jul 19 19:59:15.949832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1809/3702] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1712 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:15.953696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-88a7a49f-70cf-4814-82ba-36a4b557b536 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 1.039646 Jul 19 19:59:15.955031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.957293 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1894/3703] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:14 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:15.961724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.976961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.979609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:15.980305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:15.980592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:15.981644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:15.988487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.001599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.002354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.003332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:16.003939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:16.035896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:16.762425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:16.914514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:16.973253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a02647e7-f167-4b7b-afb6-e2beecbf7bee tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1510 microversion: 2.1 time: 1.014060 Jul 19 19:59:16.991798 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1895/3704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1510 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:16.999517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.007811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.040964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.042261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.047236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.048306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.358498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=14 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:17.923413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.940198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.942074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:17.943285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c93f181-4deb-430a-87eb-423a90c382a1 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 1.992249 Jul 19 19:59:17.944186 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1810/3705] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:15 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:17.949106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:17.949719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:17.974310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.974862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:17.975739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:17.976163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.141233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:18.379515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:18.390041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5473d96-3b6b-48a7-8770-f5022afceea2 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 1.402249 Jul 19 19:59:18.390886 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1896/3706] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:16 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:18.395898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f985ebc0-52a1-497f-9059-975d09eca756 req-40f87a06-547d-45df-addc-427b50110daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e9a111-3bd1-4c2f-88bc-ba881a92ef1a", "tag": "dac71048-20cf-4a03-99d9-54eb80b1efa3"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:18.409562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f985ebc0-52a1-497f-9059-975d09eca756 req-40f87a06-547d-45df-addc-427b50110daf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.410395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f985ebc0-52a1-497f-9059-975d09eca756 req-40f87a06-547d-45df-addc-427b50110daf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.428679 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f985ebc0-52a1-497f-9059-975d09eca756 req-40f87a06-547d-45df-addc-427b50110daf service nova] Creating event network-changed:dac71048-20cf-4a03-99d9-54eb80b1efa3 for instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a on n-h1-843834-3 Jul 19 19:59:18.434100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f985ebc0-52a1-497f-9059-975d09eca756 req-40f87a06-547d-45df-addc-427b50110daf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041833 Jul 19 19:59:18.435177 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1897/3707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:18.963252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:18.964075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:18.979909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.980395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:18.983923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:18.984910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.160820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.177141 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-490decff-f38d-4c18-ab27-31d2b6f32fbd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1512 microversion: 2.1 time: 1.231858 Jul 19 19:59:19.200545 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1811/3708] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:17 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1512 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:19.239015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:19.239643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:19.278212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.278785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.282026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:19.282472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:19.967467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.968994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.979839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.988807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:19.992160 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-218dff71-85d3-436f-8c50-371a96980cde tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 1.033810 Jul 19 19:59:19.995128 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1898/3709] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:18 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:20.000683 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff46845a-fe02-4e5d-85de-c058f72df202 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 200 len: 1513 microversion: 2.1 time: 0.792534 Jul 19 19:59:20.005653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1812/3710] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 1513 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:20.007870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.008759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:20.018084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.022366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.023979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.025245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.025900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.026406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:20.027332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:20.069391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.069847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.070650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.071125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.276451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:20.413663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:20.413927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:20.429890 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dcb046f4-f251-4abd-bfd3-ef08f536e86d tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 0.428982 Jul 19 19:59:20.433830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.434289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.443638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1899/3711] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:19 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:20.448777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9052ac5d-659f-4722-8b60-93dfb1ab2eda req-0d0cb54a-f2db-4138-8908-610cb4b79a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62df3d52-7f44-41ca-a586-c13999e15b29", "tag": "58edb278-38e8-4115-a051-4e7886ae1c0a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:20.477495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9052ac5d-659f-4722-8b60-93dfb1ab2eda req-0d0cb54a-f2db-4138-8908-610cb4b79a89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.477953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9052ac5d-659f-4722-8b60-93dfb1ab2eda req-0d0cb54a-f2db-4138-8908-610cb4b79a89 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.526612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9052ac5d-659f-4722-8b60-93dfb1ab2eda req-0d0cb54a-f2db-4138-8908-610cb4b79a89 service nova] Creating event network-changed:58edb278-38e8-4115-a051-4e7886ae1c0a for instance 62df3d52-7f44-41ca-a586-c13999e15b29 on n-h1-843834-3 Jul 19 19:59:20.535486 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9052ac5d-659f-4722-8b60-93dfb1ab2eda req-0d0cb54a-f2db-4138-8908-610cb4b79a89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089873 Jul 19 19:59:20.537254 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1900/3712] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:20.937472 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2cd2bb1c-c23d-42af-8e0a-d441ac829fc7 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.923373 Jul 19 19:59:20.938084 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1813/3713] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 19 19:59:20 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:20.957398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:20.963182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:20.964283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-589290247', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:20.970452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.971221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:20.972320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:20.972985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.016841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.016841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.028530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.033077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.034691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.036487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.158090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:21.269315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.287151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.287625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.460535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.477277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.479043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.481613 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0e063466-2034-4a88-8923-c5157ba89f7d tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.471053 Jul 19 19:59:21.482789 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1814/3714] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:21.488360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.488983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:21.496374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.496728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.497487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.497916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.565597 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c491f089-2f4d-4394-8431-26c72b13a34d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-589290247" status: 200 len: 1515 microversion: 2.1 time: 0.611857 Jul 19 19:59:21.568611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1901/3715] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Jul 19 19:59:20 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-589290247 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:21.601417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:21.616760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:21.618804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:21.632217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.635418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.638888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:21.649194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:21.996250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:22.088358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:22.096946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.097756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.500313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:22.532656 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a441e0b-7762-4957-bbff-434d3fa591ee tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 1.042814 Jul 19 19:59:22.534378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1815/3716] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:22.547341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:22.547994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:22.568502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.568987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:22.573449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:22.574762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.102670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb456725-334f-4805-9570-58fb4757ae08 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.509187 Jul 19 19:59:23.103771 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1902/3717] 10.222.0.23 () {58 vars in 1172 bytes} [Tue Jul 19 19:59:21 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:23.125575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.130688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.133551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.servers [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Removing options 'limit' from query {{(pid=131229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:59:23.137689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:23.145217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.146737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.147789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.148386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.166008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:23.218761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.247344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.248084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.266883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.275619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.277163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.279379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d29a92f-6e5a-4337-878d-9cc67f3c9694 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.742912 Jul 19 19:59:23.290378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1816/3718] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:22 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:23.540879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5d3a62a-aeeb-4812-b4f1-f9205e1b99df tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.420352 Jul 19 19:59:23.556265 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1903/3719] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:23.561399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.563676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:23.578881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.585576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.586580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.588251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.589223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.596277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.604818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:23.619998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.620584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.621887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.622531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.764424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:23.855494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c72470be-1482-4c4b-8abb-26db3d84a2fe tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.283741 Jul 19 19:59:23.856142 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1904/3720] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:23.882883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:23.887315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:23.887767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.servers [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Removing options 'limit' from query {{(pid=131229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:59:23.888428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:23.895236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.895689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.896681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:23.897113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:23.951979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:24.051410 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23188537-67e6-4154-8da3-0cc7fd038467 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.166995 Jul 19 19:59:24.067209 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1905/3721] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:24.098085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.103666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.110120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81990cfb-dc17-48e3-bd3e-14c28917d851 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 0.562237 Jul 19 19:59:24.110723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1817/3722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:23 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:24.117772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.119175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:24.177563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.178287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.182840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.183666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.249237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:24.297342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.298202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:24.309291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.319005 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2b317e8-670a-43e0-82d9-95dc21482e76 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.247077 Jul 19 19:59:24.319909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.320547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1906/3723] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers => generated 1009 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:24.321162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.321609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.342460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:24.350577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.352099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:24.380795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.381160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.382932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:24.383432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:24.821751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.839482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.841325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:24.842695 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2663ae83-1ed2-40b0-91f8-25b9d4b863cd tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.549290 Jul 19 19:59:24.843804 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1818/3724] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:24.894200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:24.988393 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59b2b7cb-abf1-4854-9474-49d373ffb5cd tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.652728 Jul 19 19:59:24.989234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1907/3725] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:25.002461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.006613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:25.007378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.servers [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Removing options 'limit' from query {{(pid=131230) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:59:25.008219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:25.023886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.025024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.026512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.027164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.051835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:25.081526 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5807895f-63d1-4c3b-928a-baff5f782b57 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.083719 Jul 19 19:59:25.082435 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1819/3726] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 19 19:59:24 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:25.108345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.129269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.130164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:25.132578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:25.139630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-589290247', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:25.147088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.148796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.150160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.150807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.162831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.165566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.167133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.171137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.328877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:25.445569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d33bc1a-e9be-487f-a04e-08077a8d32c2 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-589290247" status: 200 len: 345 microversion: 2.1 time: 0.344890 Jul 19 19:59:25.460829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1908/3727] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-589290247 => generated 345 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:25.468251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7877faf-39bc-4fdb-bd08-e16180f44ab3 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:25.483446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7877faf-39bc-4fdb-bd08-e16180f44ab3 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.484186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7877faf-39bc-4fdb-bd08-e16180f44ab3 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.511978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7877faf-39bc-4fdb-bd08-e16180f44ab3 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Going to try to stop instance {{(pid=131229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 19:59:25.586765 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7877faf-39bc-4fdb-bd08-e16180f44ab3 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "POST /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e/action" status: 202 len: 0 microversion: 2.1 time: 0.123961 Jul 19 19:59:25.592296 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1909/3728] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:25 2022] POST /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:25.616424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:25.619019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:25.633390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.634718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:25.638419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:25.639771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.081292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.093222 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3bc528b-b777-44ef-88b0-a890e9bedfce tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 0.968388 Jul 19 19:59:26.094331 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1820/3729] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:26.121542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:26.122535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:26.137269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.138026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.138827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.139465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.353771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.365635 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4fc50d22-b093-4d19-ae19-5e2bd2c18d8b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 0.763021 Jul 19 19:59:26.366520 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1910/3730] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:25 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:26.828052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.870469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.875788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ce85d7bf-ce9f-48c9-8f33-ee40bad1c071 req-0d5b6156-a63e-4369-a7e0-bcb90b07c474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e9a111-3bd1-4c2f-88bc-ba881a92ef1a", "name": "network-vif-plugged", "status": "completed", "tag": "dac71048-20cf-4a03-99d9-54eb80b1efa3"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:26.877949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:26.881754 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52158f5f-b82d-449b-aa1e-dcce754d0710 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.784937 Jul 19 19:59:26.882632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1821/3731] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:26 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:26.893867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ce85d7bf-ce9f-48c9-8f33-ee40bad1c071 req-0d5b6156-a63e-4369-a7e0-bcb90b07c474 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:26.894327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ce85d7bf-ce9f-48c9-8f33-ee40bad1c071 req-0d5b6156-a63e-4369-a7e0-bcb90b07c474 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:26.913999 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ce85d7bf-ce9f-48c9-8f33-ee40bad1c071 req-0d5b6156-a63e-4369-a7e0-bcb90b07c474 service nova] Creating event network-vif-plugged:dac71048-20cf-4a03-99d9-54eb80b1efa3 for instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a on n-h1-843834-3 Jul 19 19:59:26.919948 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ce85d7bf-ce9f-48c9-8f33-ee40bad1c071 req-0d5b6156-a63e-4369-a7e0-bcb90b07c474 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048977 Jul 19 19:59:26.922034 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1911/3732] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:27.118559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.120776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.132382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.135700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.141305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.141888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.386770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.389079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.406247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.406710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.412332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.413252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.594679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:27.607549 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-400ac13b-3872-4d8e-8250-f506b2094f11 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 0.492643 Jul 19 19:59:27.608896 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1822/3733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:27.840195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:27.853254 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e78556f-60de-46f6-9556-95c7a2a22d67 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 0.470685 Jul 19 19:59:27.863370 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1912/3734] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:27.902946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:27.903963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:27.916675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.917766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:27.922667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:27.923536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.427721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.464963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.470112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:28.472461 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-45a9c17e-9bd7-414b-92a7-fd3c06db0d06 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.575887 Jul 19 19:59:28.478747 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1823/3735] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:27 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 19:59:28.633694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:28.634446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:28.665354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.665816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.671418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.673686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.886153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:28.891825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:28.922631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.930568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:28.932112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:28.932877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.150964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.162291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4c748dc9-efef-485f-9d55-44764e1d2933 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1323 microversion: 2.1 time: 0.532864 Jul 19 19:59:29.162931 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1913/3736] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:28 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:29.181623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-aff9d1a1-19e0-49be-a90b-1318ed7e79a6 req-0c971677-971b-43cc-ae78-8599760a28d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62df3d52-7f44-41ca-a586-c13999e15b29", "name": "network-vif-plugged", "status": "completed", "tag": "58edb278-38e8-4115-a051-4e7886ae1c0a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:29.216193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-aff9d1a1-19e0-49be-a90b-1318ed7e79a6 req-0c971677-971b-43cc-ae78-8599760a28d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.217159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-aff9d1a1-19e0-49be-a90b-1318ed7e79a6 req-0c971677-971b-43cc-ae78-8599760a28d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.248978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-aff9d1a1-19e0-49be-a90b-1318ed7e79a6 req-0c971677-971b-43cc-ae78-8599760a28d6 service nova] Creating event network-vif-plugged:58edb278-38e8-4115-a051-4e7886ae1c0a for instance 62df3d52-7f44-41ca-a586-c13999e15b29 on n-h1-843834-3 Jul 19 19:59:29.257384 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-aff9d1a1-19e0-49be-a90b-1318ed7e79a6 req-0c971677-971b-43cc-ae78-8599760a28d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089122 Jul 19 19:59:29.258942 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1914/3737] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:29.438840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.465194 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3321cae-e1f4-4aee-8018-26fdfdb3696f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 0.596697 Jul 19 19:59:29.486504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1824/3738] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:28 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:29.526175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:29.528921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:29.556275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.557088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.558894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:29.560013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:29.861495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.877655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.881558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:29.884738 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-faef56e4-cb8b-4662-a150-32fa52f874a7 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1358 microversion: 2.21 time: 0.386950 Jul 19 19:59:29.905577 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1915/3739] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:29 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:30.183485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:30.184942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:30.202401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.203856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.205578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.206808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.405256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:30.492882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:30.493642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:30.501208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.502222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.503310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.503988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.691031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:30.707433 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d7ca405-2914-4c79-b4e8-d5b3891e844b tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1520 microversion: 2.1 time: 0.529619 Jul 19 19:59:30.708840 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1825/3740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:30 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:30.899377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c218c44-5c11-4a56-8af7-563fd1002941 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1350277686", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c218c44-5c11-4a56-8af7-563fd1002941 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 243 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1350277686", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1350277686', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8b67c12f-7a1c-4171-ae6e-8903c66c3dc2'}]}}} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:30.903835 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c218c44-5c11-4a56-8af7-563fd1002941 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2c218c44-5c11-4a56-8af7-563fd1002941 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012144 Jul 19 19:59:30.907498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1826/3741] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:30 2022] POST /compute/v2.1/servers => generated 175 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:59:30.932352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:30.933725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:30.967497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.967497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:30.967497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:30.967497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:31.681009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:31.704053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b718c808-c94c-4bd6-9851-81983761b19a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 1.213779 Jul 19 19:59:31.706598 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1916/3742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:30 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:31.719441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:31.720937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 828d528a-14e4-4c31-b9a4-62093a5df818] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:31.733473 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] HTTP exception thrown: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/828d528a-14e4-4c31-b9a4-62093a5df818/metadata HTTP/1.1 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '828d528a-14e4-4c31-b9a4-62093a5df818'} Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:31.743339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 404 to user: Instance 828d528a-14e4-4c31-b9a4-62093a5df818 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8836aebc-816b-461f-bbdf-4b2e9a9afdd4 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/828d528a-14e4-4c31-b9a4-62093a5df818/metadata" status: 404 len: 111 microversion: 2.1 time: 0.036740 Jul 19 19:59:31.752806 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1917/3743] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 19:59:31 2022] GET /compute/v2.1/servers/828d528a-14e4-4c31-b9a4-62093a5df818/metadata => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:59:31.965448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75cfab66-49e1-4d30-885f-30ed88007b87 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868160881", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75cfab66-49e1-4d30-885f-30ed88007b87 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 499 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868160881", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1868160881', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b67c12f-7a1c-4171-ae6e-8903c66c3dc2'}]}}} Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:59:31.972404 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:31.975589 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:31.979658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75cfab66-49e1-4d30-885f-30ed88007b87 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:31.980839 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75cfab66-49e1-4d30-885f-30ed88007b87 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021871 Jul 19 19:59:31.982524 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1918/3744] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:31 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:59:32.066840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46f5680a-d465-4dda-a9a1-12c89eb76ba6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1299962641", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46f5680a-d465-4dda-a9a1-12c89eb76ba6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 500 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1299962641", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1299962641', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b67c12f-7a1c-4171-ae6e-8903c66c3dc2'}]}}} Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:59:32.073290 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46f5680a-d465-4dda-a9a1-12c89eb76ba6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:32.080987 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46f5680a-d465-4dda-a9a1-12c89eb76ba6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017470 Jul 19 19:59:32.091228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1919/3745] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:32 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 19:59:32.106540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.143578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.154136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:32.156826 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07cf4b37-4c0b-4fb5-86e8-f3b5f836441a tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1552 microversion: 2.21 time: 1.240661 Jul 19 19:59:32.167933 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1827/3746] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:30 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1552 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:32.199753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.202058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.212470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57923336-88b2-415d-a833-715617ee3e4f tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1241811290", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57923336-88b2-415d-a833-715617ee3e4f tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 754 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1241811290", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1241811290', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b67c12f-7a1c-4171-ae6e-8903c66c3dc2'}]}}} Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:59:32.221676 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:59:32.227047 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:59:32.238168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.238168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.240948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57923336-88b2-415d-a833-715617ee3e4f tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:32.242182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.242667 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57923336-88b2-415d-a833-715617ee3e4f tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.040890 Jul 19 19:59:32.243631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.244730 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1828/3747] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:32 2022] POST /compute/v2.1/servers => generated 1197 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 19:59:32.251646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.253605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.330003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:32.360350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cacb8b1-eb5c-45b3-8bf4-bd7b52335782 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-893600257", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cacb8b1-eb5c-45b3-8bf4-bd7b52335782 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 1265 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-893600257", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b67c12f-7a1c-4171-ae6e-8903c66c3dc2"}]}} Jul 19 19:59:32.381371 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-893600257', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b67c12f-7a1c-4171-ae6e-8903c66c3dc2'}]}}} Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.385657 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 19:59:32.389420 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 19:59:32.411902 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 19:59:32.411902 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.411902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cacb8b1-eb5c-45b3-8bf4-bd7b52335782 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:32.411902 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cacb8b1-eb5c-45b3-8bf4-bd7b52335782 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.040613 Jul 19 19:59:32.411902 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1829/3748] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Jul 19 19:59:32 2022] POST /compute/v2.1/servers => generated 2221 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 19:59:32.438503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.441979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 646f77b3-e71e-4990-991a-b835b8a4abcc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.467659 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] HTTP exception thrown: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/646f77b3-e71e-4990-991a-b835b8a4abcc/metadata/test2 HTTP/1.1 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '646f77b3-e71e-4990-991a-b835b8a4abcc', 'id': 'test2'} Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:32.492324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:32.504048 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:32.504048 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:32.504048 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. Jul 19 19:59:32.504048 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:32.507486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:32.510729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 404 to user: Instance 646f77b3-e71e-4990-991a-b835b8a4abcc could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:32.513765 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4afc6a16-703a-4e81-a488-3a9b6b670e24 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/646f77b3-e71e-4990-991a-b835b8a4abcc/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.090650 Jul 19 19:59:32.518069 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1830/3749] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/646f77b3-e71e-4990-991a-b835b8a4abcc/metadata/test2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 19:59:32.582905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.590391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.631950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.634833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.641201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.642598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.674359 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-47f4b159-d5e1-4adf-8fe0-37ebd86d9107 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 204 len: 0 microversion: 2.21 time: 0.495071 Jul 19 19:59:32.678519 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1920/3750] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:59:32 2022] DELETE /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 19:59:32.687596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:32.690804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:32.711247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.712229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.713250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:32.713902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:32.772207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:33.005872 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-32e9fb63-a433-429e-a509-b26bda4abed6 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 204 len: 0 microversion: 2.1 time: 0.431993 Jul 19 19:59:33.014627 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1831/3751] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:32 2022] DELETE /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 19:59:33.030081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:33.032174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:33.050416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.052725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.054707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:33.056993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:33.213787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:34.209773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.245129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.260493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.274581 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72b9fa78-af28-4a4f-aec5-1a92d916b34c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1558 microversion: 2.21 time: 1.588710 Jul 19 19:59:34.288701 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1921/3752] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:32 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1558 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:34.327671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:34.332246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:34.340031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:34.367974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.369027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.370664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:34.371356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:34.401116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:34.441696 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-141d6f35-8efe-4703-8e9c-aeec3d54fa45 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 1.424171 Jul 19 19:59:34.463948 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1832/3753] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:33 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:35.030166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:35.054469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc04f707-56ec-477b-902c-69e3e2090c40 tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1526 microversion: 2.1 time: 0.762617 Jul 19 19:59:35.057476 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1922/3754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:34 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1526 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:35.316228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.317134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.328897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.336929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.337543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.339421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.345290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.490668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:35.491347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:35.493910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=16 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:35.516352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.519312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:35.520952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:35.521601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.238311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.258589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.268837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.273817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c99f6e0c-0d7d-4cca-90e9-17e095b70ed0 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1558 microversion: 2.21 time: 0.961892 Jul 19 19:59:36.276601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1833/3755] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1558 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:36.286641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:36.288113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:36.317733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.319200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.321787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:36.323242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:36.561929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:36.579448 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-228edb4e-8ff9-4e16-8f43-386764eb48a0 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1522 microversion: 2.1 time: 1.093909 Jul 19 19:59:36.597575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1923/3756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:35 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1522 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:37.296909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:37.298003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:37.315391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.317380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.318805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.319625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.649555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ca5e22ec9e444691324207124798a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ccedd522c4d61a6d3573da98b9ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:37.665970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9b6cd4b-b282-4ca5-b9af-3697eb56ddfe tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 200 len: 1526 microversion: 2.1 time: 1.386139 Jul 19 19:59:37.672848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1834/3757] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:36 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 1526 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:37.691711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:37.724296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:37.737680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.738397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:37.740176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:37.740833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.428605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.445885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.448716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9196dbfe4764b7694b2179ece300d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b2bc4e5a7c4ebeb026fbd314970db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.453404 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-882a89dc-b507-490a-9ff4-5f590be716f9 tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 200 len: 1558 microversion: 2.21 time: 1.162148 Jul 19 19:59:38.456002 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1924/3758] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:37 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 1558 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 19:59:38.462348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3dbffad5-ff92-499d-b41d-15b7588887f9 req-408d2f03-4d83-4a74-8cd5-516519d6cd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e9a111-3bd1-4c2f-88bc-ba881a92ef1a", "name": "network-vif-deleted", "tag": "dac71048-20cf-4a03-99d9-54eb80b1efa3"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:38.506240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3dbffad5-ff92-499d-b41d-15b7588887f9 req-408d2f03-4d83-4a74-8cd5-516519d6cd3a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.507858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3dbffad5-ff92-499d-b41d-15b7588887f9 req-408d2f03-4d83-4a74-8cd5-516519d6cd3a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.536605 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3dbffad5-ff92-499d-b41d-15b7588887f9 req-408d2f03-4d83-4a74-8cd5-516519d6cd3a service nova] Creating event network-vif-deleted:dac71048-20cf-4a03-99d9-54eb80b1efa3 for instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a on n-h1-843834-3 Jul 19 19:59:38.543550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3dbffad5-ff92-499d-b41d-15b7588887f9 req-408d2f03-4d83-4a74-8cd5-516519d6cd3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085684 Jul 19 19:59:38.544844 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1925/3759] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:38.558859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.576092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-148ce7c5-1808-4fd9-8a54-d304ee32cee4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1499 microversion: 2.1 time: 0.897887 Jul 19 19:59:38.576810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-732ad1b2-dac7-44a2-b63b-f195090789ec req-dbfc185d-90dc-498e-bc5f-3fb022abc959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62df3d52-7f44-41ca-a586-c13999e15b29", "name": "network-vif-deleted", "tag": "58edb278-38e8-4115-a051-4e7886ae1c0a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:38.582993 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1835/3760] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:37 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1499 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:38.591901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-732ad1b2-dac7-44a2-b63b-f195090789ec req-dbfc185d-90dc-498e-bc5f-3fb022abc959 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.592784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-732ad1b2-dac7-44a2-b63b-f195090789ec req-dbfc185d-90dc-498e-bc5f-3fb022abc959 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.598965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.603290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:38.608025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:38.617915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:38.625975 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-732ad1b2-dac7-44a2-b63b-f195090789ec req-dbfc185d-90dc-498e-bc5f-3fb022abc959 service nova] Creating event network-vif-deleted:58edb278-38e8-4115-a051-4e7886ae1c0a for instance 62df3d52-7f44-41ca-a586-c13999e15b29 on n-h1-843834-3 Jul 19 19:59:38.627533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.628478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.629627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.630462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.647678 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-732ad1b2-dac7-44a2-b63b-f195090789ec req-dbfc185d-90dc-498e-bc5f-3fb022abc959 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101011 Jul 19 19:59:38.649201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1926/3761] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 19:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:38.670189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:38.690661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.691593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] [instance: 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.706303 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20c4ff4e-2950-4ef6-8a21-8b2a7897aa48 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.111750 Jul 19 19:59:38.706750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.707256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.708148 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1836/3762] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:38.716640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.717786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.736142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-714976b9-a5fe-41b2-9c19-89dae6906b73 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:38.738664 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] HTTP exception thrown: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Request method failure captured: Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a HTTP/1.1 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0Fz62BOMNESXJQ05iPClFSNVwiWn3HbLzdhtxz3U1Qf9BLcyVbjeyruy8L9BH6CsG2RuE2yDkVZIl8ZHZOFnfvXoK_gMDqJwMG7UlcSXbv_JSNp_bLVsuM77jFZXWSPL0uo0br2xwQyw0F8cbtmlaCS8vIkDryO8Re0HP-G_fOOzU Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f2ccedd522c4d61a6d3573da98b9ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 8f2ccedd522c4d61a6d3573da98b9ff5 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-229286765 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c6ca5e22ec9e444691324207124798a2 Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-229286765-project Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '38e9a111-3bd1-4c2f-88bc-ba881a92ef1a'} Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:38.740927 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. Jul 19 19:59:38.745884 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:38.747595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] Returning 404 to user: Instance 38e9a111-3bd1-4c2f-88bc-ba881a92ef1a could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:38.749283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-646d50d3-19cc-4a91-8377-f8d2203dca6a tempest-ServerMetadataNegativeTestJSON-229286765 tempest-ServerMetadataNegativeTestJSON-229286765-project] 10.222.0.23 "GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a" status: 404 len: 111 microversion: 2.1 time: 0.062494 Jul 19 19:59:38.764441 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1927/3763] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/38e9a111-3bd1-4c2f-88bc-ba881a92ef1a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 19:59:38.770081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714976b9-a5fe-41b2-9c19-89dae6906b73 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.771545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-714976b9-a5fe-41b2-9c19-89dae6906b73 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.811462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-714976b9-a5fe-41b2-9c19-89dae6906b73 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 19:59:38.840141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:38.913530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-714976b9-a5fe-41b2-9c19-89dae6906b73 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "POST /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e/action" status: 202 len: 0 microversion: 2.1 time: 0.195484 Jul 19 19:59:38.919163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1837/3764] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 19:59:38 2022] POST /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:38.929739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:38.930702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:38.937875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.939083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:38.940245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:38.940884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.478545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.479739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.506729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.507572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.520230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.521327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.525028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:39.537983 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2542ee97-6a26-4e46-86e1-99e9fdefd3e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1508 microversion: 2.1 time: 0.614064 Jul 19 19:59:39.538937 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1928/3765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:38 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1508 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:39.559943 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] HTTP exception thrown: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Request method failure captured: Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 HTTP/1.1 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fp-jAxfLAb5BlKUrq8fha9EW9YO6fTF6dmIWQ1LiHHCExKl0f4RO-K6GpUZp8cOUqnQFVUiw7i5f84vHsI-K59uyyC4jGwS8-XDKWcUf_MzsRu94ztrmMIC8pHnvLhZqRp6mT9fjuJER873GkC6lmFkyPx78eD7OFBhxc9CGlnuA Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f9196dbfe4764b7694b2179ece300d6b Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '62df3d52-7f44-41ca-a586-c13999e15b29'} Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.561684 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Returning 404 to user: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:39.566373 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0277cde5-e62a-4b7d-9f60-c2f58e7c9b3c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 404 len: 111 microversion: 2.21 time: 0.093245 Jul 19 19:59:39.567578 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1838/3766] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:39 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:59:39.574297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '.version_select at 0x7f23eefbf4c0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.575374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.585369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.587858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.589681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.591540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.728989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92efb37c-fd8a-4c41-9a2e-481f951404ab tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.160192 Jul 19 19:59:39.729946 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1929/3767] 10.222.0.23 () {60 vars in 1336 bytes} [Tue Jul 19 19:59:39 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29/os-instance-actions => generated 611 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 19:59:39.758280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.759572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.767897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.768732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.769763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.770407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.789607 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] HTTP exception thrown: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Request method failure captured: Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 HTTP/1.1 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0Fp-jAxfLAb5BlKUrq8fha9EW9YO6fTF6dmIWQ1LiHHCExKl0f4RO-K6GpUZp8cOUqnQFVUiw7i5f84vHsI-K59uyyC4jGwS8-XDKWcUf_MzsRu94ztrmMIC8pHnvLhZqRp6mT9fjuJER873GkC6lmFkyPx78eD7OFBhxc9CGlnuA Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f9196dbfe4764b7694b2179ece300d6b Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '62df3d52-7f44-41ca-a586-c13999e15b29'} Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:39.791810 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.795411 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.800797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Returning 404 to user: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:39.801968 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ab69acb-e164-4ee5-94f9-3b177003ce5c tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 404 len: 111 microversion: 2.21 time: 0.048961 Jul 19 19:59:39.803086 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1839/3768] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 19:59:39 2022] DELETE /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:59:39.814727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:39.815704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] [instance: 62df3d52-7f44-41ca-a586-c13999e15b29] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:39.826021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.826807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.827839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:39.828563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:39.853063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] HTTP exception thrown: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Request method failure captured: Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 HTTP/1.1 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0Fp-jAxfLAb5BlKUrq8fha9EW9YO6fTF6dmIWQ1LiHHCExKl0f4RO-K6GpUZp8cOUqnQFVUiw7i5f84vHsI-K59uyyC4jGwS8-XDKWcUf_MzsRu94ztrmMIC8pHnvLhZqRp6mT9fjuJER873GkC6lmFkyPx78eD7OFBhxc9CGlnuA Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74b2bc4e5a7c4ebeb026fbd314970db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 74b2bc4e5a7c4ebeb026fbd314970db8 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-99500052 Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: f9196dbfe4764b7694b2179ece300d6b Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-InstanceActionsV221TestJSON-99500052-project Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '62df3d52-7f44-41ca-a586-c13999e15b29'} Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.856877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. Jul 19 19:59:39.860666 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 19:59:39.864991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] Returning 404 to user: Instance 62df3d52-7f44-41ca-a586-c13999e15b29 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 19:59:39.866501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-155766d3-f8e1-4aa8-afe9-906f572d57ff tempest-InstanceActionsV221TestJSON-99500052 tempest-InstanceActionsV221TestJSON-99500052-project] 10.222.0.23 "GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29" status: 404 len: 111 microversion: 2.21 time: 0.057144 Jul 19 19:59:39.868083 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1930/3769] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 19:59:39 2022] GET /compute/v2.1/servers/62df3d52-7f44-41ca-a586-c13999e15b29 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 19:59:40.557860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:40.558488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:40.572350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.573332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:40.574311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:40.574930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:41.729038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:41.742621 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47505029-b51b-4971-9205-9b84bddb97e4 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1508 microversion: 2.1 time: 1.189073 Jul 19 19:59:41.744033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1840/3770] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:40 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1508 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:42.761232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:42.762842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:42.778101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.780660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:42.781882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:42.785400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.454688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:43.470943 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4871d14-1141-43c3-bd05-c633a7504cbf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1512 microversion: 2.1 time: 0.713782 Jul 19 19:59:43.473147 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1931/3771] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:42 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:43.494204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:43.499930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:43.500724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.servers [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Removing options 'limit' from query {{(pid=131230) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 19:59:43.501834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:43.504402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.505141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.507278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.508173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.512552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34b3e9d1-8b31-4ea8-b9f3-3d4593c2df34 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.023141 Jul 19 19:59:43.513550 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1841/3772] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 19 19:59:43 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 19:59:43.532405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:43.533690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:43.546200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.547310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:43.548679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:43.549365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.736544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:44.759808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1da9265-d836-4016-a191-223ea1946740 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1512 microversion: 2.1 time: 1.237241 Jul 19 19:59:44.764092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1932/3773] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:43 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1512 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:44.780510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:44.781396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:44.818971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.835352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:44.836585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:44.841844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.245712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:46.268074 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-403b1265-6003-49da-af2b-7758bb722610 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 200 len: 1513 microversion: 2.1 time: 1.481075 Jul 19 19:59:46.269771 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1842/3774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:44 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 1513 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:46.284992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:46.285614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:46.305461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.306139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.308644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:46.309778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:46.610744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-937991360", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:46.754239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] validate_networks() for [('0fe2528f-13ca-4fb6-a5bc-8f5b968aaf59', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:47.149895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:47.174352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7109ef0f-f052-48f0-85b1-19f393b97a14 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1510 microversion: 2.1 time: 0.893498 Jul 19 19:59:47.175784 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1933/3775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:46 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1510 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:47.192048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:47.196546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:47.198094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:47.939075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.940066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:47.941444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:47.943321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.173738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:48.355030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f19bb812-95f6-42e5-8d24-46566afe293a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 1.167317 Jul 19 19:59:48.356614 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1934/3776] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Jul 19 19:59:47 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:48.392753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:48.396621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:48.417453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:48.419627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.423397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:48.424340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:48.638634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:49.073689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:49.104337 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8b7bf28-23e9-4f7f-8308-f07096fa2487 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1512 microversion: 2.1 time: 0.738466 Jul 19 19:59:49.105775 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1935/3777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:48 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1512 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:49.149901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:49.151460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:49.164378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.165709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.167682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.168849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.826097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:49.852746 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2aef3cb-80c9-4410-acfe-fb2a758f4b5e tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 200 len: 1513 microversion: 2.1 time: 0.726816 Jul 19 19:59:49.853843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1936/3778] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:49 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 1513 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:49.874751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:49.884678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:49.902138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.902874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:49.904222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:49.904921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.771322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:50.772167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:50.772403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:50.773070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:50.773730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:50.791858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.792471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.793579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:50.794259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:50.850208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:50.864874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for user 0810747a1c58432f9cf6c0731051a2c3 and project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:50.901569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:50.904400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:51.019134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1da8803b-1c70-4e5c-9526-7fae91558f23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.722034 Jul 19 19:59:51.031744 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1843/3779] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 19:59:51.039099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a031be1-ebf2-4936-8036-332c49eb4cd6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:51.040830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a031be1-ebf2-4936-8036-332c49eb4cd6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:51.282782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a031be1-ebf2-4936-8036-332c49eb4cd6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.290497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a031be1-ebf2-4936-8036-332c49eb4cd6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1221 microversion: 2.1 time: 0.257421 Jul 19 19:59:51.291227 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1844/3780] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:51 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:51.390361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1340592101", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 19:59:51.463262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.510723 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c35b97ae-057c-4313-b45e-5c3d481d920a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1510 microversion: 2.1 time: 1.642847 Jul 19 19:59:51.512795 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1937/3781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:49 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1510 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:51.540918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:51.547082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] validate_networks() for [('0fe2528f-13ca-4fb6-a5bc-8f5b968aaf59', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 19:59:51.613301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:51.618672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:51.634887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.636842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.639079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:51.647418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:51.844169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:51.980156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 19:59:52.299181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:52.317740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:52.318204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:52.885821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c47c9c2b-3da9-44d7-8e24-2662ccc01931 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.358435 Jul 19 19:59:52.887287 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1938/3782] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 19:59:51 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:52.927693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:52.937305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:52.944597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:53.186092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.188673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.194161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.198541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.302887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:53.430995 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a44e993-a613-4cc5-9982-3de1e314fb84 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.513030 Jul 19 19:59:53.434010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1939/3783] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Jul 19 19:59:52 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:53.463318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.482401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.484461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:53.498281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.499844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.500989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.502187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.760011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:53.872272 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c25917c2-de4e-4802-9491-d5695191185a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.420338 Jul 19 19:59:53.873761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1940/3784] 10.222.0.23 () {58 vars in 1211 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:53.908250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:53.912245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:53.912926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:53.930354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.930689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:53.931544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:53.931991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.060929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:54.262564 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ec2d1e6-7737-45c8-9cc2-1ee84869a8da tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.375240 Jul 19 19:59:54.275902 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1941/3785] 10.222.0.23 () {58 vars in 1195 bytes} [Tue Jul 19 19:59:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:54.287450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.305808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:54.316436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': '-589290247', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:54.326723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.334445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.334445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.334445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.494849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 19:59:54.503105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 19:59:54.504529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 19:59:54.505751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 19:59:54.507117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 19:59:54.577266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.581424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.586666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.592221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.635142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 19:59:54.649851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for user 0810747a1c58432f9cf6c0731051a2c3 and project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 19:59:54.668323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:54.680989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 19:59:54.688389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 19:59:54.816735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c1578f12-e4f5-4425-96b1-56b98d6585ae tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.430177 Jul 19 19:59:54.824974 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1845/3786] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 19:59:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 19:59:54.843335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.844681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.858905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a04b5b60-8db8-4acb-9b4a-d4a47a2cc89b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-589290247" status: 200 len: 345 microversion: 2.1 time: 0.580951 Jul 19 19:59:54.860020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1942/3787] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers?name=-589290247 => generated 345 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 19:59:54.875439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.876447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9186b43b-27ce-4e6d-af13-200ab3c3368a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:54.877615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9186b43b-27ce-4e6d-af13-200ab3c3368a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:54.882825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:54.885155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:54.899611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.132590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lazy-loading 'services' on Instance uuid 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 19:59:55.368627 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d1f6929-38d9-4d20-8c20-8971e1dbaf22 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments/64f95568-98c0-43d2-8b98-c05c361e0557" status: 202 len: 0 microversion: 2.1 time: 0.541978 Jul 19 19:59:55.403291 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1846/3788] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 19:59:54 2022] DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments/64f95568-98c0-43d2-8b98-c05c361e0557 => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 19:59:55.484924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:55.522333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:55.531629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:55.565903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.566725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.573633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:55.578443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:55.780061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9186b43b-27ce-4e6d-af13-200ab3c3368a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:55.802566 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9186b43b-27ce-4e6d-af13-200ab3c3368a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1222 microversion: 2.1 time: 0.940611 Jul 19 19:59:55.824625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1943/3789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:54 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1222 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:55.837981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:56.027769 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d0e48d9-936d-493d-8b2f-fa5ce1b9cbdc tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.624465 Jul 19 19:59:56.029683 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1847/3790] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Jul 19 19:59:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:56.044571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.063500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:56.068843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-58929024', 'deleted': False, 'project_id': '7108236f125544d2bf2b8fd7671a04cf'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 19:59:56.101587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.106086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.108186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.112194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.397855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 19:59:56.592634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8d3805d-8fa4-4332-ac8f-29e9c2f80f3b tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-58929024" status: 200 len: 345 microversion: 2.1 time: 0.553478 Jul 19 19:59:56.596093 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1944/3791] 10.222.0.23 () {58 vars in 1225 bytes} [Tue Jul 19 19:59:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-58929024 => generated 345 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 19:59:56.616485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.620662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.652051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.652860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.658800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.660971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.812293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 19:59:56.836037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:56.837160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:56.877096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.877878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:56.886000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:56.886810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.249112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfee2dd6-f57a-464c-9828-6fb451e3601d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 204 len: 0 microversion: 2.1 time: 0.641866 Jul 19 19:59:57.251129 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1848/3792] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 19:59:56 2022] DELETE /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 19:59:57.267140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:57.283124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:57.294662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.302951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:57.304881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:57.306008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:58.294883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.308920 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-489ee9fd-27c4-403b-89da-bba777aeec68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1274 microversion: 2.1 time: 1.480235 Jul 19 19:59:58.309559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1945/3793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:56 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1274 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:58.828380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:58.841395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92fef393-500d-4ecd-a65a-548d4827285f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1516 microversion: 2.1 time: 1.582411 Jul 19 19:59:58.845089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1849/3794] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:57 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1516 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 19:59:59.328447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.329612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.346615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.347372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.349225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.352800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.721874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 19:59:59.787857 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c065a453-ad83-46ad-91fb-bbbb0efd9a0c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1280 microversion: 2.1 time: 0.463211 Jul 19 19:59:59.789332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1946/3795] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1280 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 19:59:59.873785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 19:59:59.876108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 19:59:59.956053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.957307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 19:59:59.959553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 19:59:59.960480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.821628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:00.823364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:00.844890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.848361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:00.850589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:00.856166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:01.219128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:01.252855 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c388da47-3584-4083-bb16-985e06234270 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1280 microversion: 2.1 time: 0.434699 Jul 19 20:00:01.253900 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1947/3796] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:00 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:02.130074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:02.183202 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ab36ffc-98ba-4925-b2f2-2101e6537f27 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1516 microversion: 2.1 time: 2.327181 Jul 19 20:00:02.185086 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1850/3797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 19:59:59 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1516 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:02.274898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:02.283210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:02.318045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.337482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:02.341723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:02.342986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.157243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b8291214-741d-47c9-8bdf-404a63fedc82 req-e697df0c-e387-47b8-b6c8-24e6f505652c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5dae52-d633-4aa9-bd8c-95008f06d052", "name": "network-vif-deleted", "tag": "5a63176c-7d1e-4175-a8be-aac80ec4614e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:03.213529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8291214-741d-47c9-8bdf-404a63fedc82 req-e697df0c-e387-47b8-b6c8-24e6f505652c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.217131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b8291214-741d-47c9-8bdf-404a63fedc82 req-e697df0c-e387-47b8-b6c8-24e6f505652c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.285359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b8291214-741d-47c9-8bdf-404a63fedc82 req-e697df0c-e387-47b8-b6c8-24e6f505652c service nova] Creating event network-vif-deleted:5a63176c-7d1e-4175-a8be-aac80ec4614e for instance ac5dae52-d633-4aa9-bd8c-95008f06d052 on n-h2-843834-3 Jul 19 20:00:03.333121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b8291214-741d-47c9-8bdf-404a63fedc82 req-e697df0c-e387-47b8-b6c8-24e6f505652c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182357 Jul 19 20:00:03.339931 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1851/3798] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:03.373745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:03.375334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:03.408580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.410249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.413693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.420481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.564926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:03.565945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:03.567434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lazy-loading 'fault' on Instance uuid ac5dae52-d633-4aa9-bd8c-95008f06d052 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:03.596996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:03.617631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3690d4ba-d242-4e85-8ce1-999f2f5b41be tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1280 microversion: 2.1 time: 1.346474 Jul 19 20:00:03.619253 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1948/3799] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:02 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1280 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:03.989108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:04.008699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6bcf326f-e353-4333-ba34-f1a04f679657 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 200 len: 1309 microversion: 2.1 time: 0.666342 Jul 19 20:00:04.022832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1852/3800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:03 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 1309 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:04.636735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:04.637525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:04.652391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:04.655624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.656074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.657256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:04.660626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:04.826455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:04.835328 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fd4b3b4-773d-481c-b3fa-287359244391 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1280 microversion: 2.1 time: 0.203098 Jul 19 20:00:04.835947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1949/3801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:04 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:05.039823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.040663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: ac5dae52-d633-4aa9-bd8c-95008f06d052] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.061223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:05.063504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.064201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.065332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.066041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.105142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] HTTP exception thrown: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Request method failure captured: Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 HTTP/1.1 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wzs0zPpD5JVbK9KJpz_l3Oh6acBe7iELaJFKyv7mbf8J9xsi1xor80qI_Y6sM9NWTeKtJJhPlwvJrI3-Uz60sAGo7s4i5NqtMwH0TOGvd5Hz9smwYz-nJnmjZ47fSSk6XvlfArNBQzOJFnxHcwPX0toGrLp92zBrt1URu1k3P3KZtI Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3926da8f9dc6459f87f9e861110dbb9f Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ac5dae52-d633-4aa9-bd8c-95008f06d052'} Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:05.113377 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. Jul 19 20:00:05.117636 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:05.124400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Returning 404 to user: Instance ac5dae52-d633-4aa9-bd8c-95008f06d052 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:05.128112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5168df3d-1a2f-4e20-ac79-888fb37cc7cf tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052" status: 404 len: 111 microversion: 2.1 time: 0.092135 Jul 19 20:00:05.131528 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1853/3802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/ac5dae52-d633-4aa9-bd8c-95008f06d052 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:05.139813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.140927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.155690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.160325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.165701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.166650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.244096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:05.461466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d79ecf26-e3ac-42ad-a342-d1d8143bc33f tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 204 len: 0 microversion: 2.1 time: 0.326542 Jul 19 20:00:05.463968 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1950/3803] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:05 2022] DELETE /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:05.475305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.477036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.484981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.486411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.487516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.488128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.748035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:05.854956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:05.856405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:05.894058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:05.897572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.901473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:05.903656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:05.905200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:06.219307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=14 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:06.838282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:06.850946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c68bc003-9116-458c-9087-06ca63609c30 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 200 len: 1519 microversion: 2.1 time: 1.380705 Jul 19 20:00:06.851885 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1854/3804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 1519 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:06.918130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:06.927414 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f8a47e4-99d2-4503-8499-3cd4bfecc493 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 1.078002 Jul 19 20:00:06.931513 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1951/3805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:05 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:07.212858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c751b120-118d-43f4-b189-7808cd4ddbd1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:07.229107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c751b120-118d-43f4-b189-7808cd4ddbd1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.231186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c751b120-118d-43f4-b189-7808cd4ddbd1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.295605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c751b120-118d-43f4-b189-7808cd4ddbd1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:00:07.395983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:07.410261 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c751b120-118d-43f4-b189-7808cd4ddbd1 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.202384 Jul 19 20:00:07.411738 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1855/3806] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:07 2022] POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:00:07.426027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:07.427180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:07.446802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.448741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.453722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.456078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.525480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:07.879100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:07.881067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:07.896352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.902741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:07.904506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:07.908504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.172728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:08.183362 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89e071a0-61e3-4b31-82e8-1757aa987fa6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1676 microversion: 2.1 time: 0.766863 Jul 19 20:00:08.186721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1952/3807] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:07 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1676 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:08.192847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:08.199516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:08.214826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.219635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:08.222609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:08.223321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.628079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:09.655946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2ee2e8c-8b8d-45c6-a41d-3243f6af2b7a tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 200 len: 1519 microversion: 2.1 time: 1.790169 Jul 19 20:00:09.668675 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1856/3808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:07 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 1519 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:09.682076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:09.683240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:09.685755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:09.694591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.695530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:09.698672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:09.699404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.112641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:10.176269 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bea465fd-4572-47fe-80c1-292caba6e6ee tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 1.977815 Jul 19 20:00:10.178269 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1953/3809] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:08 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:10.191681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9de19608-9d92-45c2-9ed5-e8fd222741f9 req-a4038453-b90a-4aff-9529-e067427345ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b304b6-b644-4aae-a775-01a8da028967", "name": "network-vif-deleted", "tag": "09a14a8c-95a8-4b5b-bae6-63b84b49a9fa"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:10.208907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9de19608-9d92-45c2-9ed5-e8fd222741f9 req-a4038453-b90a-4aff-9529-e067427345ff service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.210156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9de19608-9d92-45c2-9ed5-e8fd222741f9 req-a4038453-b90a-4aff-9529-e067427345ff service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.253139 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9de19608-9d92-45c2-9ed5-e8fd222741f9 req-a4038453-b90a-4aff-9529-e067427345ff service nova] Creating event network-vif-deleted:09a14a8c-95a8-4b5b-bae6-63b84b49a9fa for instance e4b304b6-b644-4aae-a775-01a8da028967 on n-h1-843834-3 Jul 19 20:00:10.278709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9de19608-9d92-45c2-9ed5-e8fd222741f9 req-a4038453-b90a-4aff-9529-e067427345ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094379 Jul 19 20:00:10.281492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1954/3810] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:10.393536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:10.401961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a918627-654d-45e6-b5aa-41777716d0e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1676 microversion: 2.1 time: 0.731393 Jul 19 20:00:10.422240 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1857/3811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:09 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1676 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:10.548260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ddcddc5b-c0d5-4119-a8ae-1184237aee5b req-d8cd5d04-71a5-48d3-9aff-5443fe855bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8813ef55-e645-4822-8578-e953516d4ade", "tag": "20db4582-8aca-425f-896d-86435e1fcb11"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:10.583034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ddcddc5b-c0d5-4119-a8ae-1184237aee5b req-d8cd5d04-71a5-48d3-9aff-5443fe855bd5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.583441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ddcddc5b-c0d5-4119-a8ae-1184237aee5b req-d8cd5d04-71a5-48d3-9aff-5443fe855bd5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.615829 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ddcddc5b-c0d5-4119-a8ae-1184237aee5b req-d8cd5d04-71a5-48d3-9aff-5443fe855bd5 service nova] Creating event network-changed:20db4582-8aca-425f-896d-86435e1fcb11 for instance 8813ef55-e645-4822-8578-e953516d4ade on n-h2-843834-3 Jul 19 20:00:10.626303 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ddcddc5b-c0d5-4119-a8ae-1184237aee5b req-d8cd5d04-71a5-48d3-9aff-5443fe855bd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341911 Jul 19 20:00:10.637021 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1955/3812] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:10.674583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.675955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: e4b304b6-b644-4aae-a775-01a8da028967] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:10.695034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.695496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.696593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.697277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.723455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] HTTP exception thrown: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Request method failure captured: Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 HTTP/1.1 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wzs0zPpD5JVbK9KJpz_l3Oh6acBe7iELaJFKyv7mbf8J9xsi1xor80qI_Y6sM9NWTeKtJJhPlwvJrI3-Uz60sAGo7s4i5NqtMwH0TOGvd5Hz9smwYz-nJnmjZ47fSSk6XvlfArNBQzOJFnxHcwPX0toGrLp92zBrt1URu1k3P3KZtI Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3926da8f9dc6459f87f9e861110dbb9f Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'e4b304b6-b644-4aae-a775-01a8da028967'} Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:10.726091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. Jul 19 20:00:10.729776 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:10.731084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Returning 404 to user: Instance e4b304b6-b644-4aae-a775-01a8da028967 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:10.732150 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-19035c7a-6b4b-4e2e-b45f-f44294bd8d94 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967" status: 404 len: 111 microversion: 2.1 time: 0.062252 Jul 19 20:00:10.736750 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1858/3813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:10 2022] GET /compute/v2.1/servers/e4b304b6-b644-4aae-a775-01a8da028967 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:00:10.751637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:10.753428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:10.770758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.772061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.774234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:10.776695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:10.868920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:00:11.182578 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-112425a4-4639-4715-8a71-4fe0b2797272 tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 204 len: 0 microversion: 2.1 time: 0.442660 Jul 19 20:00:11.188190 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1956/3814] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:00:10 2022] DELETE /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:00:11.198135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.198768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.219045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.219624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.220535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.221024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.224336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.225134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.256692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.257445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.257963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.258405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.926108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:11.938528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9023c605-9781-46e0-966e-fd6526048d9d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 0.745136 Jul 19 20:00:11.939535 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1859/3815] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:11.963818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:11.965662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:11.980991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:11.988571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:11.990517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:11.993574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:12.007506 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f50cc645-90e2-4a1c-a884-486fc00dbfeb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1518 microversion: 2.1 time: 0.800248 Jul 19 20:00:12.009606 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1957/3816] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1518 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:12.012489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:12.766078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d4588759-ed0b-49cd-ace1-7e07027eb43d req-8e664dc9-78c1-4473-b68c-0e8b98cd061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978eae6a-ef19-414a-afdb-571544ed0fed", "tag": "d5438201-25cf-4d34-9f7f-fb3dd1108c16"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:12.814443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4588759-ed0b-49cd-ace1-7e07027eb43d req-8e664dc9-78c1-4473-b68c-0e8b98cd061c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:12.814443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4588759-ed0b-49cd-ace1-7e07027eb43d req-8e664dc9-78c1-4473-b68c-0e8b98cd061c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:12.841462 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d4588759-ed0b-49cd-ace1-7e07027eb43d req-8e664dc9-78c1-4473-b68c-0e8b98cd061c service nova] Creating event network-changed:d5438201-25cf-4d34-9f7f-fb3dd1108c16 for instance 978eae6a-ef19-414a-afdb-571544ed0fed on n-h1-843834-3 Jul 19 20:00:12.851550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d4588759-ed0b-49cd-ace1-7e07027eb43d req-8e664dc9-78c1-4473-b68c-0e8b98cd061c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094245 Jul 19 20:00:12.853702 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1958/3817] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:12.990837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:12.992913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:13.027750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.031569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.035103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.036064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.301374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:13.317959 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05587573-18d6-4176-94b3-b1acb3cb33b6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1676 microversion: 2.1 time: 1.376490 Jul 19 20:00:13.324256 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1860/3818] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:11 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1676 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:13.343767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:13.351102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:13.361035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.361828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.363994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:13.364695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:13.855252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:13.867057 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c029ba38-e75b-4d6e-87e1-a8dbf9065a6e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 0.908421 Jul 19 20:00:13.882201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1959/3819] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:12 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:14.141731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3926da8f9dc6459f87f9e861110dbb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7108236f125544d2bf2b8fd7671a04cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:14.159511 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc0b20fd-89bf-446e-b89b-5345583aad1d tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 200 len: 1518 microversion: 2.1 time: 0.821537 Jul 19 20:00:14.169754 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1861/3820] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:13 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 1518 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:14.350061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:14.351919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:14.366118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.367536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.369480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.370663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.896200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:14.896938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:14.975991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.977573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:14.983139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:14.984339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.604421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:17.629600 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e43f62cc-fbb4-430e-90fe-f07fac23d71d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 2.743572 Jul 19 20:00:17.642679 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1862/3821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:14 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:17.652306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:17.652984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] [instance: 18ce26a9-f431-4e0f-8e56-b914982c006e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:17.674997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.675464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.676274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.676721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.705009 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] HTTP exception thrown: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Request method failure captured: Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e HTTP/1.1 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wzs0zPpD5JVbK9KJpz_l3Oh6acBe7iELaJFKyv7mbf8J9xsi1xor80qI_Y6sM9NWTeKtJJhPlwvJrI3-Uz60sAGo7s4i5NqtMwH0TOGvd5Hz9smwYz-nJnmjZ47fSSk6XvlfArNBQzOJFnxHcwPX0toGrLp92zBrt1URu1k3P3KZtI Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7108236f125544d2bf2b8fd7671a04cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7108236f125544d2bf2b8fd7671a04cf Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1540814547 Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3926da8f9dc6459f87f9e861110dbb9f Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServerFiltersTestJSON-1540814547-project Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '18ce26a9-f431-4e0f-8e56-b914982c006e'} Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:00:17.707109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] Returning 404 to user: Instance 18ce26a9-f431-4e0f-8e56-b914982c006e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd2fa9e2-7a39-47fe-a46f-136620b90fdb tempest-ListServerFiltersTestJSON-1540814547 tempest-ListServerFiltersTestJSON-1540814547-project] 10.222.0.23 "GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e" status: 404 len: 111 microversion: 2.1 time: 0.070401 Jul 19 20:00:17.715003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1863/3822] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:17 2022] GET /compute/v2.1/servers/18ce26a9-f431-4e0f-8e56-b914982c006e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:00:17.727432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4c4f5120-d478-4aea-b2f1-537a5dcd33bd req-fd852c2e-97e6-4e92-8021-3fa6e182f1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ce26a9-f431-4e0f-8e56-b914982c006e", "name": "network-vif-deleted", "tag": "46b3358c-323f-494d-b99c-f8cffe436370"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:17.744727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4c4f5120-d478-4aea-b2f1-537a5dcd33bd req-fd852c2e-97e6-4e92-8021-3fa6e182f1b0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:17.755797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4c4f5120-d478-4aea-b2f1-537a5dcd33bd req-fd852c2e-97e6-4e92-8021-3fa6e182f1b0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:17.772125 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4c4f5120-d478-4aea-b2f1-537a5dcd33bd req-fd852c2e-97e6-4e92-8021-3fa6e182f1b0 service nova] Creating event network-vif-deleted:46b3358c-323f-494d-b99c-f8cffe436370 for instance 18ce26a9-f431-4e0f-8e56-b914982c006e on n-h2-843834-3 Jul 19 20:00:17.796930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4c4f5120-d478-4aea-b2f1-537a5dcd33bd req-fd852c2e-97e6-4e92-8021-3fa6e182f1b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086145 Jul 19 20:00:17.798327 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1864/3823] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:18.651568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:18.653840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:18.697271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:18.698644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.699145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.699977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:18.700422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:18.741280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51fe2e4e-f841-48fc-9065-07fc47a7565b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1676 microversion: 2.1 time: 4.397430 Jul 19 20:00:18.753727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1960/3824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:14 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1676 bytes in 4411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:19.759738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:19.760395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:19.769799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:19.779730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.780196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.781015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:19.781458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:19.799555 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7e36e5c3-9bb4-4425-8cb3-e9f8c9547b21 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 1.152739 Jul 19 20:00:19.812119 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1865/3825] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:18 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:20.711588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:20.726968 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b386428-8acf-4e33-b09c-8a899de6ede4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1653 microversion: 2.1 time: 0.970851 Jul 19 20:00:20.739372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1961/3826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:19 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1653 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:20.755273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7708b945-6522-4690-b3b9-ca1f6a04cbc5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:20.789730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7708b945-6522-4690-b3b9-ca1f6a04cbc5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.793612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7708b945-6522-4690-b3b9-ca1f6a04cbc5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.818452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:20.819226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:20.836738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.837211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.838037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.838529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.856916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7708b945-6522-4690-b3b9-ca1f6a04cbc5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:00:20.933399 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7708b945-6522-4690-b3b9-ca1f6a04cbc5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.191649 Jul 19 20:00:20.935263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1866/3827] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:20 2022] POST /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:00:20.951201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:20.952958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:20.978778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.982312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:20.987489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:20.989698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:22.506557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:22.522872 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8abacb17-a3fc-4ede-a28b-d988130bde5b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1662 microversion: 2.1 time: 1.581069 Jul 19 20:00:22.526873 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1867/3828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:20 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1662 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:22.928555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-578a41cb-429f-4464-95af-e8f109ce4134 req-f04ff94b-a7c4-4be6-9cd5-5957ce1e6a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8813ef55-e645-4822-8578-e953516d4ade", "name": "network-vif-plugged", "status": "completed", "tag": "20db4582-8aca-425f-896d-86435e1fcb11"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:22.977469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-578a41cb-429f-4464-95af-e8f109ce4134 req-f04ff94b-a7c4-4be6-9cd5-5957ce1e6a74 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:22.983158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-578a41cb-429f-4464-95af-e8f109ce4134 req-f04ff94b-a7c4-4be6-9cd5-5957ce1e6a74 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.054828 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-578a41cb-429f-4464-95af-e8f109ce4134 req-f04ff94b-a7c4-4be6-9cd5-5957ce1e6a74 service nova] Creating event network-vif-plugged:20db4582-8aca-425f-896d-86435e1fcb11 for instance 8813ef55-e645-4822-8578-e953516d4ade on n-h2-843834-3 Jul 19 20:00:23.076397 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-578a41cb-429f-4464-95af-e8f109ce4134 req-f04ff94b-a7c4-4be6-9cd5-5957ce1e6a74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.547870 Jul 19 20:00:23.077495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1868/3829] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:23.550554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:23.558555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:23.573511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.574016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.578163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:23.579944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:23.588049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:23.610661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d2baeb5-8171-4407-a9cf-be079812c556 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 2.796560 Jul 19 20:00:23.622108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1962/3830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:20 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:24.102862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:24.117440 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-82310d3e-3850-410e-85eb-e3f1af692e86 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1662 microversion: 2.1 time: 0.575240 Jul 19 20:00:24.121300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1869/3831] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:23 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1662 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:24.645381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:24.646579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:24.659552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.660395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:24.661721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:24.662476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.121628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-04c187f6-a057-45d2-93a7-42097db2327d req-97addaf2-6d0c-4072-b485-4aa683dfbea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978eae6a-ef19-414a-afdb-571544ed0fed", "name": "network-vif-plugged", "status": "completed", "tag": "d5438201-25cf-4d34-9f7f-fb3dd1108c16"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:25.139125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-04c187f6-a057-45d2-93a7-42097db2327d req-97addaf2-6d0c-4072-b485-4aa683dfbea7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.141710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-04c187f6-a057-45d2-93a7-42097db2327d req-97addaf2-6d0c-4072-b485-4aa683dfbea7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.171360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-04c187f6-a057-45d2-93a7-42097db2327d req-97addaf2-6d0c-4072-b485-4aa683dfbea7 service nova] Creating event network-vif-plugged:d5438201-25cf-4d34-9f7f-fb3dd1108c16 for instance 978eae6a-ef19-414a-afdb-571544ed0fed on n-h1-843834-3 Jul 19 20:00:25.184910 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-04c187f6-a057-45d2-93a7-42097db2327d req-97addaf2-6d0c-4072-b485-4aa683dfbea7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066913 Jul 19 20:00:25.185555 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1870/3832] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:25.204154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:25.205182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:25.208282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:25.214950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.216736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.217968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:25.221786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:25.240173 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae86aa89-e5cf-4cf9-a9a6-d12d48e2a2a3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 0.599796 Jul 19 20:00:25.246195 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1963/3833] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:24 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:26.278067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:26.278722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:26.298241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.298610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.299460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:26.299899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:26.722902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:26.737995 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ed96d3ff-0b65-4212-bb26-7727d5588696 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1662 microversion: 2.1 time: 1.550493 Jul 19 20:00:26.745097 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1871/3834] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:25 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1662 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:26.964949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:26.976536 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43e595c6-ed28-4984-8bab-3cdd8184976f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1322 microversion: 2.1 time: 0.702443 Jul 19 20:00:26.987805 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1964/3835] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:26 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:27.756314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:27.757606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:27.780070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.780541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:27.781588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:27.782104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.006380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:28.007721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:28.021828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.031893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.032798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:28.033253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:28.439735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:28.481644 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aac08f55-94e1-4dc7-979a-583729f6611d tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1666 microversion: 2.1 time: 0.728832 Jul 19 20:00:28.497413 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1872/3836] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:27 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1666 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:29.189270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:29.206612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-998336ad-c4a0-4196-9938-8af5b73e1b7f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1517 microversion: 2.1 time: 1.206210 Jul 19 20:00:29.210105 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1965/3837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:27 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1517 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:29.238445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:29.240391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:29.259330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.260036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.261046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.261666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.315656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lazy-loading 'flavor' on Instance uuid 978eae6a-ef19-414a-afdb-571544ed0fed {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:00:29.437562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-757749621", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:29.518850 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7f8faabb-ee04-44a9-a68a-0b76110276f2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action" status: 200 len: 32 microversion: 2.1 time: 0.295269 Jul 19 20:00:29.519809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1966/3838] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:00:29 2022] POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:00:29.535078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:29.539201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:29.552475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.553041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.553959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:29.566708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:29.610801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:29.655714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] validate_networks() for [('c6df2121-a511-4ff4-b44f-c10d518370e5', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:30.410878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:30.427052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f57eb993-5b25-4bad-8de4-53b5e5739ea8 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.899491 Jul 19 20:00:30.427875 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1967/3839] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:29 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:31.170708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:31.171366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:31.172253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:31.173221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:31.173886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:31.199487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.200807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.201917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.207015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.255544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Getting quotas for project c69549fd54d64e88bfe7aa3ee41223d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:31.262389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Getting quotas for user af0a63fe66184144a91ab84dddc628e2 and project c69549fd54d64e88bfe7aa3ee41223d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:31.299490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:31.302008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:31.397679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fbdcd94a-dde0-405f-9552-9120620e3fdc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224267 Jul 19 20:00:31.399000 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1873/3840] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:31.408781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de802865-a2f6-44db-9d37-3f1b6035074f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.409802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de802865-a2f6-44db-9d37-3f1b6035074f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.455783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:31.456784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:31.483784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.486169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.490540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:31.492978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:31.749099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de802865-a2f6-44db-9d37-3f1b6035074f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:31.757421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de802865-a2f6-44db-9d37-3f1b6035074f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1216 microversion: 2.1 time: 0.352537 Jul 19 20:00:31.766963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1968/3841] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1216 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:32.150668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:32.165670 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4471da9-068d-4e22-bbae-ea09fcc43dac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.713752 Jul 19 20:00:32.168164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1874/3842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:31 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:32.787384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:32.788152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:32.829862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.834446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:32.840115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:32.843584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.147709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:33.175493 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0cefe019-9dff-45d5-8cd0-6540c74cc101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1220 microversion: 2.1 time: 0.404234 Jul 19 20:00:33.177468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1969/3843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:32 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1220 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:33.191264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:33.193638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:33.216998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.220202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.222406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:33.223535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:33.268056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:34.200306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:34.210329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:34.246797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.250642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.253959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:34.258465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:34.566248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:34.604531 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bed20fc1-9168-4719-bd41-4cfb16715749 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 1.418040 Jul 19 20:00:34.617789 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1875/3844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:33 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:34.842210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:34.876702 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4cf1709f-ce61-4678-a29e-820fbeb24321 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1274 microversion: 2.1 time: 0.684489 Jul 19 20:00:34.882670 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1970/3845] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:34 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1274 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:35.639045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:35.639733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:35.659144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.659875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.660896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.661513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.909706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:35.910883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:35.921755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:35.955374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.959277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:35.964738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:35.967205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:36.958608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:36.969038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1127b962-b299-4268-98ac-6bc987fe8c89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1274 microversion: 2.1 time: 1.067861 Jul 19 20:00:36.979625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1971/3846] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:35 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1274 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.092391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: .version_select at 0x7f23ef9078b0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-268446253", "policies": ["affinity"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.111411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.118024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.192414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.207346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.245692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ee01a32-7a30-4126-a673-19348ad588fa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.264424 Jul 19 20:00:37.246335 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1972/3847] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Jul 19 20:00:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:37.262742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: .version_select at 0x7f23ef805040>, body: {"server_group": {"name": "tempest-server-group-864741348", "policies": ["affinity"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.294234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.304478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.398578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.412995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.449525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3dd968c-1d6f-4b60-bf90-837094e76e7f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.193038 Jul 19 20:00:37.452379 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1973/3848] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:37.466314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: .version_select at 0x7f23ef58f430>, body: {"server_group": {"name": "tempest-server-group-864741348", "policies": ["affinity"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:37.509821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.516729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.610115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:37.627122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:37.675560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7f72c18b-3373-4c6d-9fe8-2273885c8949 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.216381 Jul 19 20:00:37.677591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1974/3849] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 20:00:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:37.689860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6598f0b1-2207-42ad-b227-2a9cd98b235b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.702619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:37.720489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c741368f-5366-4abd-8ddb-0e67706db2fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 2.086983 Jul 19 20:00:37.739431 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1876/3850] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:35 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:37.807804 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6598f0b1-2207-42ad-b227-2a9cd98b235b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/bc21c624-4172-425c-86ae-1bef5a57dd91" status: 204 len: 0 microversion: 2.1 time: 0.121831 Jul 19 20:00:37.813815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1975/3851] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:00:37 2022] DELETE /compute/v2.1/os-server-groups/bc21c624-4172-425c-86ae-1bef5a57dd91 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:37.827214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a752344-8408-4419-a264-557a0c006ac1 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.869250 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a752344-8408-4419-a264-557a0c006ac1 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.049125 Jul 19 20:00:37.870723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1877/3852] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:00:37 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:37.884786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6f0baf5-9e8b-4b2f-8eff-dff9e9264534 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.959513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6f0baf5-9e8b-4b2f-8eff-dff9e9264534 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/b5af4d15-ab49-488f-95f8-52b7424cab34" status: 204 len: 0 microversion: 2.1 time: 0.079588 Jul 19 20:00:37.961545 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1976/3853] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:00:37 2022] DELETE /compute/v2.1/os-server-groups/b5af4d15-ab49-488f-95f8-52b7424cab34 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:37.975475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-694f18c4-d2df-4aad-b601-0f06b4993fa9 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.987856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:37.988740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:37.990262 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-694f18c4-d2df-4aad-b601-0f06b4993fa9 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.021395 Jul 19 20:00:37.992032 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1878/3854] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:00:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:38.004015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:38.008741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.009500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: .version_select at 0x7f23ef2c3dc0>, body: {"server_group": {"name": "tempest-server-group-464358201", "policies": ["affinity"]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:38.012336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.015607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.018590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.035303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:38.043221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:38.107579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:38.145124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:38.217087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5188bf61-1be7-4442-8cfa-91213e0429d8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.213061 Jul 19 20:00:38.218209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1879/3855] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 20:00:38 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:38.247642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a99422b9-2007-498d-8ed2-8c1c7f450d15 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.341386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a99422b9-2007-498d-8ed2-8c1c7f450d15 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/64a657a1-7c34-4809-9ff3-cc12acb9533c" status: 204 len: 0 microversion: 2.1 time: 0.112054 Jul 19 20:00:38.342785 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1880/3856] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:00:38 2022] DELETE /compute/v2.1/os-server-groups/64a657a1-7c34-4809-9ff3-cc12acb9533c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:00:38.353304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70ca0cfb-cbdb-465e-a4aa-1db341af313a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.385618 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70ca0cfb-cbdb-465e-a4aa-1db341af313a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035782 Jul 19 20:00:38.388411 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1881/3857] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:38.411320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: .version_select at 0x7f23ef2b2310>, body: {"server_group": {"name": "tempest-server-group-854839966", "policies": ["anti-affinity"]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:38.462946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:38.473943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:38.481966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:38.617693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:38.635919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_groups'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:38.688641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a9a9551-da25-4c0a-afc3-1f39f76f783b tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.288232 Jul 19 20:00:38.697150 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1882/3858] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 20:00:38 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:38.705854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-254b645d-a0c6-40e1-ba98-46f70e4182db tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.769181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:38.785393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-254b645d-a0c6-40e1-ba98-46f70e4182db tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/29d536e6-f72a-40bf-96f4-502689d65a18" status: 204 len: 0 microversion: 2.1 time: 0.085963 Jul 19 20:00:38.786590 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1883/3859] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:00:38 2022] DELETE /compute/v2.1/os-server-groups/29d536e6-f72a-40bf-96f4-502689d65a18 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:00:38.794510 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-596448d3-2d03-4eba-a969-1dc3943f2af0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.812363 Jul 19 20:00:38.795387 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1977/3860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:37 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:38.799353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.801447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:38.805349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-235bcd18-7da2-45c5-9709-e8a59d7229b9 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:38.819868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-235bcd18-7da2-45c5-9709-e8a59d7229b9 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023244 Jul 19 20:00:38.820136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.823640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.824897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:38.825367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:38.826171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1978/3861] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:38.949354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-583112896", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1cb1f71c-f723-4f6b-b366-1918778e02c1"}]}, "os:scheduler_hints": {"group": "fe66ddde-0277-4a9c-b5d6-e67eb850f88c"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:39.094271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] validate_networks() for [('1cb1f71c-f723-4f6b-b366-1918778e02c1', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:39.605262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:39.619553 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-da2176bd-5975-4e08-abd8-1bceb1972822 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.829956 Jul 19 20:00:39.620186 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1884/3862] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:38 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:39.811437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:39.812205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:39.835718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.836724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:39.838025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:39.838793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.523262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:40.540954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a87d5804-a2ca-404e-80ba-7f34ddabf738 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.732372 Jul 19 20:00:40.573543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:40.574108 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1885/3863] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:39 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:40.574953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:40.575617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:40.576213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:40.576805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:40.596238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.597350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.598749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.599406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.622566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:40.637855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.638950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:40.642713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:40.648480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.649250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.650388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:40.651125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:40.680260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:40.682874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:40.736951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131229) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 20:00:40.775103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_group_members'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:40.787374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_group_members'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:40.862448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for project cc4497fd028147b68c175ba267d73597. Resources: {'server_group_members'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:40.872678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Getting quotas for user 0a2627b29b5d42f79809d157063148ba and project cc4497fd028147b68c175ba267d73597. Resources: {'server_group_members'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:40.929153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-afe5a61e-aaae-475a-ba80-2293ce4ca2b3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984784 Jul 19 20:00:40.929856 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1979/3864] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:40.949660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1178e7b-fb28-4eb0-bb05-1708aef9f5aa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:40.950546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1178e7b-fb28-4eb0-bb05-1708aef9f5aa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:41.066467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1178e7b-fb28-4eb0-bb05-1708aef9f5aa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:41.075713 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1178e7b-fb28-4eb0-bb05-1708aef9f5aa tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1212 microversion: 2.1 time: 0.135757 Jul 19 20:00:41.076753 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1980/3865] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1212 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:41.151812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:41.191955 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c922b0fd-bfe8-4092-b436-371ee4ef1b09 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.558861 Jul 19 20:00:41.196795 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1886/3866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:40 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:41.570702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:41.571407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:41.590875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.591603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:41.592144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:41.592580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.089996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.099579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.100905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b65a4c9-0f17-4e31-ac5e-07a8c183a933 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.533726 Jul 19 20:00:42.104851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:42.110846 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1981/3867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:41 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:42.146609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:42.152162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.155509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.157933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.171408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.188953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e65fb689-cde0-4b79-8799-c42cb7b3dd8b req-e7cb417c-3295-49bb-8d1f-9ae9b52d96be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:42.219594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e65fb689-cde0-4b79-8799-c42cb7b3dd8b req-e7cb417c-3295-49bb-8d1f-9ae9b52d96be service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.220088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e65fb689-cde0-4b79-8799-c42cb7b3dd8b req-e7cb417c-3295-49bb-8d1f-9ae9b52d96be service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.246195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e65fb689-cde0-4b79-8799-c42cb7b3dd8b req-e7cb417c-3295-49bb-8d1f-9ae9b52d96be service nova] Creating event network-changed:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h2-843834-3 Jul 19 20:00:42.253911 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e65fb689-cde0-4b79-8799-c42cb7b3dd8b req-e7cb417c-3295-49bb-8d1f-9ae9b52d96be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070766 Jul 19 20:00:42.255187 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1982/3868] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:42.266943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:42.268428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:42.292775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.293598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.294616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:42.295271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:42.379320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.411561 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc055f8c-e596-4411-90f4-dabd4380dd9a tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1264 microversion: 2.1 time: 0.320747 Jul 19 20:00:42.416544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1887/3869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:42 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1264 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:42.875107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:42.891918 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61c86e9f-b040-44c3-aaf1-c32a5b926e7e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.634991 Jul 19 20:00:42.908118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1983/3870] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:42 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.136605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.140646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.186639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.188784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.191517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.192375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.429635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.430546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.438492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.439316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.440340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.440951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.487455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:43.521497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42daa256-580e-4f33-8864-9702a36f3cc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.406016 Jul 19 20:00:43.522541 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1888/3871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.609267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:43.631376 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e96a712-504b-4258-b877-68288fbded33 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1270 microversion: 2.1 time: 0.204775 Jul 19 20:00:43.632602 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1984/3872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:43.912818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:43.915499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:43.937060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.937522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:43.947115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:43.948993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.558804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:44.584446 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f78874de-4be3-42f6-9f52-949d72e90db1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.675930 Jul 19 20:00:44.584714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:44.585599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:44.603577 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1889/3873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:43 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:44.641949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.642449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.650681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:44.651254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:44.658140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.658848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.664491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.665574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:44.666583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:44.668341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.232533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:45.267134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a79250f-8fc0-4392-8a3f-9d965dd89c30 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1270 microversion: 2.1 time: 0.620499 Jul 19 20:00:45.268054 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1890/3874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:44 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1270 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:45.615507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:45.616443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:45.638695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.654255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:45.655237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:45.655707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.025915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:46.036272 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c91796f-d74e-4207-bc29-65a1dc9a6e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 1.500374 Jul 19 20:00:46.041033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1985/3875] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:44 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:46.285689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:46.286368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:46.300506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.302351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.310805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:46.311324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:46.541974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:46.548833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:46.560976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3cff0b2-92b7-4740-8435-0551a0876411 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.954809 Jul 19 20:00:46.563689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83dd66a8-4bdc-410f-90bd-8ddb1d2405b0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1270 microversion: 2.1 time: 0.282039 Jul 19 20:00:46.573283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1986/3876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:46 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:46.573800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1891/3877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:45 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:47.070730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:47.071804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:47.105355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.107838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.108929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.114378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.582514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:47.583171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:47.600981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.601492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.602585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.603284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.674091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:47.693602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c1f5d450-5ae3-4b47-9512-bdcdc3ae9e17 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.630133 Jul 19 20:00:47.697803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1987/3878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:47 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:47.731596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:47.732632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:47.762129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.763421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:47.768712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:47.770258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:48.192552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:48.208075 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-75bc1729-15b3-4603-9b65-eb809ac589c0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.629111 Jul 19 20:00:48.209155 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1892/3879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:47 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:48.716081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:48.718027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:48.733397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=22 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:48.738076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:48.739297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:48.742411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:48.745014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:48.861198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:48.875743 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7752edda-9bbd-42e4-b81a-0b713ef0917c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 1.175949 Jul 19 20:00:48.876978 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1988/3880] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:47 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:49.071960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:49.080832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5a43cffa-ffd8-453b-8952-095793f016ce tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.372677 Jul 19 20:00:49.090953 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1893/3881] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:48 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:49.237243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:49.238221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:49.252536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.254321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.255668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.256125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.581732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:49.597681 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c202af6-9e5a-4ea5-8eec-0b7d0f3b9cb5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.365748 Jul 19 20:00:49.598315 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1989/3882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:49 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:49.895109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:49.895753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:49.923939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.924488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.938608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.946867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:49.965953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9bcdc301-2d35-4c9e-9174-350a6c5fb9f7 req-b73f9741-7810-4085-ba04-781f2ce32b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "name": "network-vif-plugged", "status": "completed", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:49.990833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9bcdc301-2d35-4c9e-9174-350a6c5fb9f7 req-b73f9741-7810-4085-ba04-781f2ce32b5e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:49.997776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9bcdc301-2d35-4c9e-9174-350a6c5fb9f7 req-b73f9741-7810-4085-ba04-781f2ce32b5e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.037522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9bcdc301-2d35-4c9e-9174-350a6c5fb9f7 req-b73f9741-7810-4085-ba04-781f2ce32b5e service nova] Creating event network-vif-plugged:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h2-843834-3 Jul 19 20:00:50.069421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9bcdc301-2d35-4c9e-9174-350a6c5fb9f7 req-b73f9741-7810-4085-ba04-781f2ce32b5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098813 Jul 19 20:00:50.073505 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1990/3883] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:00:50.100452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:50.101400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:50.123282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.123910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.125371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:50.126047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:50.610110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:51.010242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:51.038349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:51.040074 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c384bdfa-fce1-41ca-a030-cdc85efa123d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 1.149842 Jul 19 20:00:51.042270 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1894/3884] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:49 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:51.052030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19c1c752-77a6-491b-8a3f-fd160007fc45 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1316 microversion: 2.1 time: 0.957673 Jul 19 20:00:51.052644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1991/3885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:50 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1316 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:51.071179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:51.079866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:51.090571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=42 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:51.112648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.117564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.118660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.120914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.336616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4daa0586-fe18-4608-b12a-f64dfde25c89 req-f2d04f9e-5909-420f-93ec-5d425c666a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2511cdf-124c-4bd6-b474-2401ec9ac14c", "tag": "d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:51.356555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4daa0586-fe18-4608-b12a-f64dfde25c89 req-f2d04f9e-5909-420f-93ec-5d425c666a98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:51.360093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4daa0586-fe18-4608-b12a-f64dfde25c89 req-f2d04f9e-5909-420f-93ec-5d425c666a98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:51.387596 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4daa0586-fe18-4608-b12a-f64dfde25c89 req-f2d04f9e-5909-420f-93ec-5d425c666a98 service nova] Creating event network-changed:d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7 for instance d2511cdf-124c-4bd6-b474-2401ec9ac14c on n-h1-843834-3 Jul 19 20:00:51.403806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4daa0586-fe18-4608-b12a-f64dfde25c89 req-f2d04f9e-5909-420f-93ec-5d425c666a98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359479 Jul 19 20:00:51.404444 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1895/3886] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:00:51.509803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-240726490", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c48f38e6-4c8f-4252-a51a-36587fd4e087"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:51.602847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] validate_networks() for [('c48f38e6-4c8f-4252-a51a-36587fd4e087', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:51.773428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:51.789560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa809a47-01f3-42ef-8fab-1cde2dc27607 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.731548 Jul 19 20:00:51.790189 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1992/3887] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:51 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:52.057922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:52.060125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:52.075936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.078738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.080392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.081110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.908953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:52.909463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:52.909938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:52.910353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:52.910764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:52.939187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:52.954967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74350e23-53b6-479e-8ec1-d881557526b7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 0.900493 Jul 19 20:00:52.957091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.957810 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1993/3888] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:52 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:52.967993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:52.969788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:52.975582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.982419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.983022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.983621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.984086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.985508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:52.986209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:52.994070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:53.045884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Getting quotas for project d361c1c918cf4ff284597d40676333b6. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:53.059867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Getting quotas for user 0cf8e936eba046f7b2ab91470709b441 and project d361c1c918cf4ff284597d40676333b6. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:53.087179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Going to run 3 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:53.100847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:53.202234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=36a1ac94-af59-4592-af8b-242fbc00a207,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:53.276491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=6ace1343-db52-48a7-845e-3a1c1b9bcf86,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:53.380254 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-64bd4321-086d-4c79-82eb-17fe66460d1a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973877 Jul 19 20:00:53.381147 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1896/3889] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:53.390824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.391432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:53.403876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.404425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.413802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.414271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.441234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:53.473077 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ea8877cd-78e2-4ed5-a6a8-a77a94489e5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.512964 Jul 19 20:00:53.476196 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1994/3890] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:52 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:53.505900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.534239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:53.536265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:00:53.620190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.622367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.626100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:53.627035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:53.695501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5045303e-7742-4a23-85c6-d1827c7d3ef3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.217295 Jul 19 20:00:53.696443 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1995/3891] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers => generated 1015 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:53.711985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-859e9e84-1052-42d8-a921-f5c61ca9f18b tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:53.712803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-859e9e84-1052-42d8-a921-f5c61ca9f18b tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:53.958468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-859e9e84-1052-42d8-a921-f5c61ca9f18b tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:53.967257 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-859e9e84-1052-42d8-a921-f5c61ca9f18b tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1222 microversion: 2.1 time: 0.259752 Jul 19 20:00:53.979497 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1996/3892] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:00:53.985934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1925783890", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:00:54.237581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] validate_networks() for [('c6df2121-a511-4ff4-b44f-c10d518370e5', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:00:54.301436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:54.311580 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00f2b9b7-f117-4740-86cf-bbd684be8cc6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.929065 Jul 19 20:00:54.323015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1897/3893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:53 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:54.356699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:54.357384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:54.383507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.396860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:54.397950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:54.398417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.186288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:56.199998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-732b2e96-274c-4571-a037-210c91ecc631 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 1.875546 Jul 19 20:00:56.207458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1898/3894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:54 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:56.213040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:56.213688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:56.242516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.243885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.245583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.246210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.742210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:56.776063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e29c6521-bc89-4936-96ee-00e1f514381f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1226 microversion: 2.1 time: 0.565751 Jul 19 20:00:56.780763 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1899/3895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:56 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1226 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:56.825567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:56.830018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:56.869544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.870511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.876792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:56.880330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:56.974608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:57.775233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:00:57.776532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:00:57.777273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:00:57.778026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:00:57.778877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:00:57.798481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.799229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.800830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:57.801753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:57.846679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Getting quotas for project c69549fd54d64e88bfe7aa3ee41223d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:00:57.854792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Getting quotas for user af0a63fe66184144a91ab84dddc628e2 and project c69549fd54d64e88bfe7aa3ee41223d6. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:00:57.877825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:00:57.881358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:00:57.935844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:00:57.993858 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc2e5fff-14d4-49b9-9c92-f989d3b0b258 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.012310 Jul 19 20:00:57.995834 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1997/3896] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:00:58.009644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.012264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.033260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.051356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.052846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.056006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.256296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.268361 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-296cadf5-a165-40dc-90e7-e2577f6f9c81 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 1.486258 Jul 19 20:00:58.284212 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1900/3897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:56 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:58.289570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.290193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.315191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.315654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.316459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:58.316900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:58.562890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.580696 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b30bc6c8-ed13-4791-ae2b-d45221b0ab0f tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1280 microversion: 2.1 time: 0.295087 Jul 19 20:00:58.582542 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1901/3898] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:58.596921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c61a0ffc-9bd9-4702-8a3e-ff735e44c3cf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:58.600447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c61a0ffc-9bd9-4702-8a3e-ff735e44c3cf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:58.792310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c61a0ffc-9bd9-4702-8a3e-ff735e44c3cf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.802537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c61a0ffc-9bd9-4702-8a3e-ff735e44c3cf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1217 microversion: 2.1 time: 0.217395 Jul 19 20:00:58.813167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:58.819209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1902/3899] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:58 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:58.830980 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b71587a-19d4-46c2-b1ec-47366b4ce42c tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 0.832125 Jul 19 20:00:58.832750 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1998/3900] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:57 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:59.287452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:59.288975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:59.305656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.306537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.309908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.310588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.604920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:59.606799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:59.662359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.663132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.668793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.669696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.847189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:59.867652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b39db57-08a2-42da-9c5f-0e24b07e87ee tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1280 microversion: 2.1 time: 0.262781 Jul 19 20:00:59.868564 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 1999/3901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:59 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1280 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:00:59.913000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:00:59.913630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:00:59.920677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.921394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.923301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:00:59.924069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:00:59.970469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:00:59.993228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9475c297-5e89-4cde-bd38-d320b96b5349 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.710063 Jul 19 20:01:00.005698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1903/3902] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:59 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:00.017851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:00.018796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:00.043249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.044009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.045084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.045864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.184191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:00.198803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf5ee4f2-5c41-459d-9b5c-0eba85d34498 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1277 microversion: 2.1 time: 0.329024 Jul 19 20:01:00.200334 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2000/3903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:00:59 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:00.205435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3b2d708d-f0a6-4d51-9a94-539715f87bb8 req-b302ed5f-9840-4e68-b051-d667a798ac40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2511cdf-124c-4bd6-b474-2401ec9ac14c", "name": "network-vif-plugged", "status": "completed", "tag": "d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:00.234627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3b2d708d-f0a6-4d51-9a94-539715f87bb8 req-b302ed5f-9840-4e68-b051-d667a798ac40 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.235276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3b2d708d-f0a6-4d51-9a94-539715f87bb8 req-b302ed5f-9840-4e68-b051-d667a798ac40 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.253078 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3b2d708d-f0a6-4d51-9a94-539715f87bb8 req-b302ed5f-9840-4e68-b051-d667a798ac40 service nova] Creating event network-vif-plugged:d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7 for instance d2511cdf-124c-4bd6-b474-2401ec9ac14c on n-h1-843834-3 Jul 19 20:01:00.260796 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3b2d708d-f0a6-4d51-9a94-539715f87bb8 req-b302ed5f-9840-4e68-b051-d667a798ac40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058975 Jul 19 20:01:00.264805 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2001/3904] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:00.400023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:00.420472 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ad11d0b-0e76-414c-989e-4dc15a7821f0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 0.411211 Jul 19 20:01:00.423998 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1904/3905] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:00 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:00.898561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:00.901325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:00.931835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.933090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:00.936950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:00.938102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.018526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.024663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.049050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.050370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.052282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.053714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.231848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.249714 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6272514-317a-4330-b21f-2918e5953961 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1280 microversion: 2.1 time: 0.367337 Jul 19 20:01:01.263386 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2002/3906] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:00 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.268645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.269293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.286704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.287184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.288182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.288790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.425001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.440676 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2922eb01-b0d5-405a-9570-f39c530dd5f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1275 microversion: 2.1 time: 0.176010 Jul 19 20:01:01.441589 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2003/3907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.450141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.456447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.469350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.473579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.474705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.475355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.553694 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2de8f528-d710-48a8-80fe-9b3fb3137cd6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110682 Jul 19 20:01:01.554595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2004/3908] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:01.571002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.576376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.590784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.594874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.596159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.597387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.634834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:01.689874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34925a03-49e6-4f38-85c5-5d97ea344469 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 0.679953 Jul 19 20:01:01.707550 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1905/3909] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:01.729521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:01.743482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:01.776759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.778040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.781246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:01.781961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:01.860857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:02.062594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11,nova_api:DELETE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:02.087434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-185b381e-a5cd-4ee8-b16d-053c12350dcd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 204 len: 0 microversion: 2.1 time: 0.374968 Jul 19 20:01:02.090333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1906/3910] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:01 2022] DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:02.105912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:02.110582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:02.125365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.126153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.127930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.131433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.208771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:02.239747 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a46ed2c-ae56-4c13-859c-9118c818abf3 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1312 microversion: 2.1 time: 0.683670 Jul 19 20:01:02.242629 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2005/3911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:01 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1312 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:02.267634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:02.268528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:02.289145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.295766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:02.297156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:02.297877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.017906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:03.553972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:03.565746 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59171a5b-fcb9-4453-b5b9-7c451c4c6ec1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 1.302645 Jul 19 20:01:03.567493 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2006/3912] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:02 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:03.575586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:03.577115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:03.586635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.587727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.588562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.589758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.616064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:03.634877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9cfe8ecf-43c2-453a-904b-1c3ffd39f017 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1672 microversion: 2.1 time: 1.538482 Jul 19 20:01:03.648924 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1907/3913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:02 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1672 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:03.655881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:03.657665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:03.668897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.670301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:03.671729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:03.672654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.349498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:04.359700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf3394e6-9cdc-4bc1-a1be-d42f19306564 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 0.790376 Jul 19 20:01:04.361963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2007/3914] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:03 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:04.371966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.375369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.386804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.387648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.389210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.390118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.768238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:04.781285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e0294ad7-1969-4ba5-a401-3b8574f1e97d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 1.130589 Jul 19 20:01:04.782322 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1908/3915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:03 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:04.792151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:04.819703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:04.834697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.835320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:04.836397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:04.844217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.589375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:05.618006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c28b28ad-c3c7-44b3-b14a-c2cd510755d0 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1497 microversion: 2.1 time: 1.254594 Jul 19 20:01:05.619457 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2008/3916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1497 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:05.625206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:05.626057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:05.633488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.634226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.635292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:05.635934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:05.992166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:06.041133 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4237c025-13ca-49cb-a79f-e42fcf9bcbc7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 1.252571 Jul 19 20:01:06.041989 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1909/3917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:04 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:06.052358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.054948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:06.070863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.071344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.074322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.075020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.495132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:06.513912 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1cf9c7f-29c5-4200-bbd9-d0d2fbb26eb9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1672 microversion: 2.1 time: 0.893117 Jul 19 20:01:06.514871 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2009/3918] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:05 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1672 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:06.519742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e2ea66a7-f303-47ac-82bc-997d8e754679 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.562469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_groups [None req-e2ea66a7-f303-47ac-82bc-997d8e754679 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Querying cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) for 1 instances {{(pid=131229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:01:06.568791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ea66a7-f303-47ac-82bc-997d8e754679 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.569589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e2ea66a7-f303-47ac-82bc-997d8e754679 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.611379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e2ea66a7-f303-47ac-82bc-997d8e754679 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c" status: 200 len: 221 microversion: 2.1 time: 0.092681 Jul 19 20:01:06.616447 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2010/3919] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 20:01:06 2022] GET /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c => generated 221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:06.624502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.629638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:06.643335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.644126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.646399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.649724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.688816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:06.705516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04129673-0302-4511-8342-9bc1125a3e7e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 0.662156 Jul 19 20:01:06.728587 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1910/3920] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:06 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:06.735663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0a14c8ef-0951-4d25-bbf9-e3b67798ffd4 req-695963ff-34f4-43a8-b5f6-58c75bea6fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06cf0f38-cb2a-426c-bc07-0c952087121f", "tag": "588c7393-b2ac-4e4a-8c67-ed38a0e9a97c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:06.758707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a14c8ef-0951-4d25-bbf9-e3b67798ffd4 req-695963ff-34f4-43a8-b5f6-58c75bea6fcb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.759485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a14c8ef-0951-4d25-bbf9-e3b67798ffd4 req-695963ff-34f4-43a8-b5f6-58c75bea6fcb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.773261 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0a14c8ef-0951-4d25-bbf9-e3b67798ffd4 req-695963ff-34f4-43a8-b5f6-58c75bea6fcb service nova] Creating event network-changed:588c7393-b2ac-4e4a-8c67-ed38a0e9a97c for instance 06cf0f38-cb2a-426c-bc07-0c952087121f on n-h1-843834-3 Jul 19 20:01:06.789980 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0a14c8ef-0951-4d25-bbf9-e3b67798ffd4 req-695963ff-34f4-43a8-b5f6-58c75bea6fcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059727 Jul 19 20:01:06.792564 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1911/3921] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:06.833206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:06.840847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:06.873212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.873672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.875069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:06.875727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:06.937690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:07.104716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10696557-11e0-47c9-8090-42140f1b1452 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 204 len: 0 microversion: 2.1 time: 0.299445 Jul 19 20:01:07.106023 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1912/3922] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:06 2022] DELETE /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:07.145774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:07.147340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:07.173724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.174143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.175097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:07.175606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:07.827654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:07.869679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:07.924310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:07.949780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2576f7f7-4db4-48a5-83df-1035b7ab01af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1523 microversion: 2.1 time: 1.331314 Jul 19 20:01:07.958334 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2011/3923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:06 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1523 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:07.972249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:07.973735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:07.993376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.001665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ed78229-2823-4276-9c32-4e52868c545e tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 0.893195 Jul 19 20:01:08.002276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1913/3924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:07 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.003717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.004544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.016190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.017488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.055530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c839672b-f78d-42bb-8633-ceecbb3d2d06 req-f21044c9-2d79-4f1c-9fbe-b846018a8761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ace1343-db52-48a7-845e-3a1c1b9bcf86", "tag": "a5752373-8102-4639-8589-ec3d0aab69db"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:08.074677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c839672b-f78d-42bb-8633-ceecbb3d2d06 req-f21044c9-2d79-4f1c-9fbe-b846018a8761 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.075174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c839672b-f78d-42bb-8633-ceecbb3d2d06 req-f21044c9-2d79-4f1c-9fbe-b846018a8761 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.170960 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c839672b-f78d-42bb-8633-ceecbb3d2d06 req-f21044c9-2d79-4f1c-9fbe-b846018a8761 service nova] Creating event network-changed:a5752373-8102-4639-8589-ec3d0aab69db for instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 on n-h1-843834-3 Jul 19 20:01:08.228709 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c839672b-f78d-42bb-8633-ceecbb3d2d06 req-f21044c9-2d79-4f1c-9fbe-b846018a8761 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224610 Jul 19 20:01:08.238329 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1914/3925] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:08.267805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:08.271022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.314375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.315206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.316784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.317828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.784980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:08.797699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9fc0c891-a66c-4564-8423-80cfa0a7ae6f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1503 microversion: 2.1 time: 0.834767 Jul 19 20:01:08.798322 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2012/3926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:07 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1503 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:08.801865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:08.820202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:08.820849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:08.840981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.841994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:08.843050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:08.843664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.443548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:09.466378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-189ca964-754e-4cb9-85f0-d27970af7f2a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1672 microversion: 2.1 time: 1.223313 Jul 19 20:01:09.491741 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1915/3927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1672 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:09.500325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:09.501391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:09.517587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.521460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.522725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.527839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.536831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:09.821058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:09.863219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6fe1fefd-53c9-47a9-b4fd-2e512d746de8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 1.063180 Jul 19 20:01:09.866137 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2013/3928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:08 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:09.876753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:09.885009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:09.910243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.914255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.916445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:09.917544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:09.930962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:10.579236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:10.595414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f840c653-a901-44d4-9c3a-9d095d7d046f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1503 microversion: 2.1 time: 1.100204 Jul 19 20:01:10.609879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1916/3929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:09 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1503 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:10.609879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a7e85446-853f-451a-927c-a161fd5bb751 req-2af0780e-bd65-4e2b-bbde-74d265729035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a1ac94-af59-4592-af8b-242fbc00a207", "tag": "99bb763b-0617-428d-875b-618a389a90e2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:10.625893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a7e85446-853f-451a-927c-a161fd5bb751 req-2af0780e-bd65-4e2b-bbde-74d265729035 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.626561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a7e85446-853f-451a-927c-a161fd5bb751 req-2af0780e-bd65-4e2b-bbde-74d265729035 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.654435 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a7e85446-853f-451a-927c-a161fd5bb751 req-2af0780e-bd65-4e2b-bbde-74d265729035 service nova] Creating event network-changed:99bb763b-0617-428d-875b-618a389a90e2 for instance 36a1ac94-af59-4592-af8b-242fbc00a207 on n-h2-843834-3 Jul 19 20:01:10.667893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a7e85446-853f-451a-927c-a161fd5bb751 req-2af0780e-bd65-4e2b-bbde-74d265729035 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069885 Jul 19 20:01:10.672921 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1917/3930] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:10.698234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:10.699679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:10.732017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.732714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:10.734208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:10.744621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.179470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:11.199744 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0765c56-c437-4e66-aad7-c3479b243c39 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 1.331187 Jul 19 20:01:11.214004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2014/3931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:09 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:11.234969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-300faa32-919a-4fbf-b0fa-db9341a1e770 req-67f4a640-b3b1-4bee-bfec-4eb911a9464c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e", "tag": "01affeba-2252-4924-a21d-84dd2073f0a0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:11.254618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-300faa32-919a-4fbf-b0fa-db9341a1e770 req-67f4a640-b3b1-4bee-bfec-4eb911a9464c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.255481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-300faa32-919a-4fbf-b0fa-db9341a1e770 req-67f4a640-b3b1-4bee-bfec-4eb911a9464c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.288830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-300faa32-919a-4fbf-b0fa-db9341a1e770 req-67f4a640-b3b1-4bee-bfec-4eb911a9464c service nova] Creating event network-changed:01affeba-2252-4924-a21d-84dd2073f0a0 for instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e on n-h2-843834-3 Jul 19 20:01:11.305126 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-300faa32-919a-4fbf-b0fa-db9341a1e770 req-67f4a640-b3b1-4bee-bfec-4eb911a9464c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083449 Jul 19 20:01:11.309938 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2015/3932] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:11.331625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:11.334730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:11.360008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.360899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.363130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.363990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.460590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2627b29b5d42f79809d157063148ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4497fd028147b68c175ba267d73597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:11.475093 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-514ba22b-40d1-4e20-8bab-2ca3d4107e74 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 200 len: 1503 microversion: 2.1 time: 0.804448 Jul 19 20:01:11.476100 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1918/3933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:10 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 1503 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:11.485728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:11.486638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:11.503278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.503926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.504935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:11.505566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:11.945628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:11.959456 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc2bde12-027e-4ed2-a3d1-ec439d8ec504 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 200 len: 1604 microversion: 2.1 time: 0.647390 Jul 19 20:01:11.961739 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2016/3934] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:11 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 1604 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:11.970489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:11.971666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:12.000192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.001237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:12.003039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:12.003747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.272105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.288019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e06f1fec-739e-4508-a31f-bc718ead9efd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1516 microversion: 2.1 time: 1.810050 Jul 19 20:01:13.289003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1919/3935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:11 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1516 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.295408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.296804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.306288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.307232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.308839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.309548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.441780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:13.460801 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0a53206-da68-4eb0-a3a9-47e2b4caf678 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 1.493752 Jul 19 20:01:13.463311 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2017/3936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:11 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:13.491385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.492326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.514959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.515898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.517610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.519298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.542205 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c HTTP/1.1 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'd2511cdf-124c-4bd6-b474-2401ec9ac14c'} Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.545046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:13.550072 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.561143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:13.563541 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3375fcb5-9d1b-47d5-86a6-f6026139e98d tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 404 len: 111 microversion: 2.1 time: 0.096749 Jul 19 20:01:13.564492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2018/3937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:13.577736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.578840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.587735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.588505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.589487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.590094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.612278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 HTTP/1.1 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3'} Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.614785 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:01:13.619729 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.626331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:13.632010 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2df1b211-39a7-45b9-a7f2-8afcb4cc85d6 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 404 len: 111 microversion: 2.1 time: 0.059689 Jul 19 20:01:13.636924 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2019/3938] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:13.642582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3", "name": "network-vif-deleted", "tag": "42a35503-ea87-4fd9-8050-dbd67e2157e6"}, {"server_uuid": "d2511cdf-124c-4bd6-b474-2401ec9ac14c", "name": "network-vif-deleted", "tag": "d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:13.655128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.655931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.683475 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] Creating event network-vif-deleted:42a35503-ea87-4fd9-8050-dbd67e2157e6 for instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 on n-h1-843834-3 Jul 19 20:01:13.684344 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] Creating event network-vif-deleted:d7f7bc55-78a7-4b86-bcf4-fdbcb4b10eb7 for instance d2511cdf-124c-4bd6-b474-2401ec9ac14c on n-h1-843834-3 Jul 19 20:01:13.708861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0fa1f9e7-50c6-4db5-a330-280936883c30 req-4c2345f2-92ca-43e5-bf95-c80225ea55f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070208 Jul 19 20:01:13.710875 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2020/3939] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:13.722397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:13.729009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 4d885224-4f60-40c5-9082-797becc837b0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.739861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/4d885224-4f60-40c5-9082-797becc837b0/action HTTP/1.1 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 14 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: {"rescue": {}} Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '4d885224-4f60-40c5-9082-797becc837b0', 'body': {'rescue': {}}} Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.749824 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. Jul 19 20:01:13.756350 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:13.759893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 404 to user: Instance 4d885224-4f60-40c5-9082-797becc837b0 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:13.766616 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9363dd89-7657-4a67-8812-f4887e1bf5e2 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/4d885224-4f60-40c5-9082-797becc837b0/action" status: 404 len: 111 microversion: 2.1 time: 0.054133 Jul 19 20:01:13.768821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2021/3940] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:13 2022] POST /compute/v2.1/servers/4d885224-4f60-40c5-9082-797becc837b0/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:13.797183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a250e81-7a86-4ed6-9218-450dce1e86e7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.843092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_groups [None req-2a250e81-7a86-4ed6-9218-450dce1e86e7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Querying cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) for 1 instances {{(pid=131229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:01:13.844084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a250e81-7a86-4ed6-9218-450dce1e86e7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.844756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a250e81-7a86-4ed6-9218-450dce1e86e7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.875827 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a250e81-7a86-4ed6-9218-450dce1e86e7 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.105118 Jul 19 20:01:13.885291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2022/3941] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:13.903556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d132cdd-a08f-4caf-8047-333104817643 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '.version_select at 0x7f23ef64a550>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:13.935931 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d132cdd-a08f-4caf-8047-333104817643 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48588254" status: 202 len: 0 microversion: 2.1 time: 0.037448 Jul 19 20:01:13.936939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2023/3942] 10.222.0.23 () {58 vars in 1214 bytes} [Tue Jul 19 20:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48588254 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:13.943281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:13.943858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:13.967129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.967682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:13.968553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:13.969014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.124969 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-558f7c37-454c-48f1-80c2-8c00c544f909 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action" status: 202 len: 0 microversion: 2.1 time: 0.186684 Jul 19 20:01:14.138228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2024/3943] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:13 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:14.150716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96b27b25-c37b-409f-8c77-ced2879595ed tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.191132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_groups [None req-96b27b25-c37b-409f-8c77-ced2879595ed tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Querying cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) for 1 instances {{(pid=131229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 20:01:14.192013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96b27b25-c37b-409f-8c77-ced2879595ed tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.192470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96b27b25-c37b-409f-8c77-ced2879595ed tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.234153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96b27b25-c37b-409f-8c77-ced2879595ed tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c" status: 200 len: 183 microversion: 2.1 time: 0.093937 Jul 19 20:01:14.235410 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2025/3944] 10.222.0.23 () {58 vars in 1262 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:14.252841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:14.254142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:14.275971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.276864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:14.285817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:14.286420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.598399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:15.625192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-209c97a4-c8e1-431d-b9d1-adb2709026af tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1521 microversion: 2.1 time: 1.381847 Jul 19 20:01:15.629372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2026/3945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:14 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1521 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:15.636425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.647347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:15.658977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.664135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.665003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.665437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.691198 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c HTTP/1.1 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'd2511cdf-124c-4bd6-b474-2401ec9ac14c'} Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:15.695405 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.701515 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.705336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:15.706736 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebf31cc7-1175-430d-ad36-c50658a967c8 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 404 len: 111 microversion: 2.1 time: 0.074357 Jul 19 20:01:15.715029 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2027/3946] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:15 2022] DELETE /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:15.721350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.722286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:15.741171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.747746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.749739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.754342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:15.757577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.790742 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-303d99ba-430f-4ea6-a87b-2c7ce5a7dde4 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 2.489381 Jul 19 20:01:15.795705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1920/3947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:13 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:15.807267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.807267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] [instance: d2511cdf-124c-4bd6-b474-2401ec9ac14c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:15.830269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.831116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.832550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:15.833342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:15.884650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c HTTP/1.1 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd2511cdf-124c-4bd6-b474-2401ec9ac14c'} Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.896049 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance d2511cdf-124c-4bd6-b474-2401ec9ac14c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:15.900824 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8723647c-2963-4c5b-a07e-f3e8cbedf2a5 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c" status: 404 len: 111 microversion: 2.1 time: 0.101022 Jul 19 20:01:15.903256 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1921/3948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:15 2022] GET /compute/v2.1/servers/d2511cdf-124c-4bd6-b474-2401ec9ac14c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:15.909549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1409768b-c364-4f61-8aaa-83ae5731865f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.924969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-1409768b-c364-4f61-8aaa-83ae5731865f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1409768b-c364-4f61-8aaa-83ae5731865f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-server-groups/29d536e6-f72a-40bf-96f4-502689d65a18 HTTP/1.1 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '29d536e6-f72a-40bf-96f4-502689d65a18'} Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.940593 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. Jul 19 20:01:15.945031 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.946675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1409768b-c364-4f61-8aaa-83ae5731865f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance group 29d536e6-f72a-40bf-96f4-502689d65a18 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:15.954445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1409768b-c364-4f61-8aaa-83ae5731865f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/29d536e6-f72a-40bf-96f4-502689d65a18" status: 404 len: 117 microversion: 2.1 time: 0.049922 Jul 19 20:01:15.956044 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1922/3949] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:01:15 2022] DELETE /compute/v2.1/os-server-groups/29d536e6-f72a-40bf-96f4-502689d65a18 => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:15.967051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0a63de2-1725-4a80-9fff-fa0c94411e5f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:15.986735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c0a63de2-1725-4a80-9fff-fa0c94411e5f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0a63de2-1725-4a80-9fff-fa0c94411e5f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-server-groups/64a657a1-7c34-4809-9ff3-cc12acb9533c HTTP/1.1 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '64a657a1-7c34-4809-9ff3-cc12acb9533c'} Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.991987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. Jul 19 20:01:15.996570 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:15.998058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0a63de2-1725-4a80-9fff-fa0c94411e5f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance group 64a657a1-7c34-4809-9ff3-cc12acb9533c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:16.000620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0a63de2-1725-4a80-9fff-fa0c94411e5f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/64a657a1-7c34-4809-9ff3-cc12acb9533c" status: 404 len: 117 microversion: 2.1 time: 0.040005 Jul 19 20:01:16.004925 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1923/3950] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:01:15 2022] DELETE /compute/v2.1/os-server-groups/64a657a1-7c34-4809-9ff3-cc12acb9533c => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:01:16.019295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0905ceba-8547-4ab0-945f-422ec1d17962 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.037036 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0905ceba-8547-4ab0-945f-422ec1d17962 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0905ceba-8547-4ab0-945f-422ec1d17962 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-server-groups/b5af4d15-ab49-488f-95f8-52b7424cab34 HTTP/1.1 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b5af4d15-ab49-488f-95f8-52b7424cab34'} Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.044920 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. Jul 19 20:01:16.049522 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.051243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0905ceba-8547-4ab0-945f-422ec1d17962 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance group b5af4d15-ab49-488f-95f8-52b7424cab34 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:16.052622 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0905ceba-8547-4ab0-945f-422ec1d17962 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/b5af4d15-ab49-488f-95f8-52b7424cab34" status: 404 len: 117 microversion: 2.1 time: 0.042950 Jul 19 20:01:16.053694 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1924/3951] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:01:16 2022] DELETE /compute/v2.1/os-server-groups/b5af4d15-ab49-488f-95f8-52b7424cab34 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:16.070662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b70f95f-d4e2-428d-8b36-48336b53ce1f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.083736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0b70f95f-d4e2-428d-8b36-48336b53ce1f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] HTTP exception thrown: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b70f95f-d4e2-428d-8b36-48336b53ce1f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Request method failure captured: Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/os-server-groups/bc21c624-4172-425c-86ae-1bef5a57dd91 HTTP/1.1 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1jS2M1OxWxTCPYjGoL2UMpk-6Rpb-YsgfrKbWxfs8akZ_6zGGy_veCSP3sEaH4IsiJ1Dc0AJriSQMSuKryzPWf2hA5WRBC4M2zrsWfVYuH3aqzEfgBYDzDPik9itO3BVfk7c7ShMj9bA0Rm7uQknRyp1zY_PfSgfd-GMM7ym1qEME Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cc4497fd028147b68c175ba267d73597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cc4497fd028147b68c175ba267d73597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cc4497fd028147b68c175ba267d73597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: cc4497fd028147b68c175ba267d73597 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerGroupTestJSON-87187234 Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0a2627b29b5d42f79809d157063148ba Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerGroupTestJSON-87187234-project Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bc21c624-4172-425c-86ae-1bef5a57dd91'} Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.089229 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. Jul 19 20:01:16.093003 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:16.104068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b70f95f-d4e2-428d-8b36-48336b53ce1f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Returning 404 to user: Instance group bc21c624-4172-425c-86ae-1bef5a57dd91 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:16.105268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b70f95f-d4e2-428d-8b36-48336b53ce1f tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/bc21c624-4172-425c-86ae-1bef5a57dd91" status: 404 len: 117 microversion: 2.1 time: 0.045855 Jul 19 20:01:16.106366 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1925/3952] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:01:16 2022] DELETE /compute/v2.1/os-server-groups/bc21c624-4172-425c-86ae-1bef5a57dd91 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:16.122738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f2def200-1750-4ab6-90a1-4dcc3e774820 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.186557 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f2def200-1750-4ab6-90a1-4dcc3e774820 tempest-ServerGroupTestJSON-87187234 tempest-ServerGroupTestJSON-87187234-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c" status: 204 len: 0 microversion: 2.1 time: 0.074233 Jul 19 20:01:16.187582 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1926/3953] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:01:16 2022] DELETE /compute/v2.1/os-server-groups/fe66ddde-0277-4a9c-b5d6-e67eb850f88c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:01:16.664480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.666303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:16.696132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.697146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.702363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.703285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.781294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:16.796353 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d121b4f0-81fb-4953-a45a-259047a3edc6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 1.074348 Jul 19 20:01:16.798188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2028/3954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:15 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:16.825701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:16.826967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:16.837838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.838294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:16.843505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:16.844450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.609169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:17.624232 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a43db400-feec-4e4d-9e33-62d1e1a580d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1501 microversion: 2.1 time: 0.969471 Jul 19 20:01:17.625733 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1927/3955] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:16 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1501 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:17.642055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-49b97e7c-c991-4202-bdb7-da07c95a6463 req-a2f54e68-023a-4c0c-ac5e-9a71a43f11ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e", "name": "network-vif-plugged", "status": "completed", "tag": "01affeba-2252-4924-a21d-84dd2073f0a0"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:17.667153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-49b97e7c-c991-4202-bdb7-da07c95a6463 req-a2f54e68-023a-4c0c-ac5e-9a71a43f11ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.670321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-49b97e7c-c991-4202-bdb7-da07c95a6463 req-a2f54e68-023a-4c0c-ac5e-9a71a43f11ee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.701336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-49b97e7c-c991-4202-bdb7-da07c95a6463 req-a2f54e68-023a-4c0c-ac5e-9a71a43f11ee service nova] Creating event network-vif-plugged:01affeba-2252-4924-a21d-84dd2073f0a0 for instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e on n-h2-843834-3 Jul 19 20:01:17.721554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-49b97e7c-c991-4202-bdb7-da07c95a6463 req-a2f54e68-023a-4c0c-ac5e-9a71a43f11ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090266 Jul 19 20:01:17.722700 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1928/3956] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:17.739868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:17.741407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:17.763487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.764493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.765774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.767817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.835989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lazy-loading 'flavor' on Instance uuid 8813ef55-e645-4822-8578-e953516d4ade {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:17.862122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Cannot 'rescue' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state paused Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action HTTP/1.1 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 14 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: {"rescue": {}} Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'rescue' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state paused Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8813ef55-e645-4822-8578-e953516d4ade', 'body': {'rescue': {}}} Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8813ef55-e645-4822-8578-e953516d4ade in vm_state paused. Cannot rescue while the instance is in this state. Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state paused Jul 19 20:01:17.868817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state paused Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 409 to user: Cannot 'rescue' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state paused {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:17.872915 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d75fcfa-86fb-4faf-9614-341813c91569 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action" status: 409 len: 144 microversion: 2.1 time: 0.144559 Jul 19 20:01:17.876950 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1929/3957] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:17 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action => generated 144 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:01:17.883200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:17.896240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:17.904051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.904516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.905525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:17.906058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:17.964953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:17.986753 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8964a13-5c4e-49e9-bea8-09b536fc1f85 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 1.162249 Jul 19 20:01:17.988227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2029/3958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:16 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:17.998109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:18.004521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:18.017353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.019693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.025897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.026786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.180597 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3be9ae76-790a-45b5-ac6d-a530a9fe2eef tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action" status: 202 len: 0 microversion: 2.1 time: 0.190374 Jul 19 20:01:18.182465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2030/3959] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:17 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:01:18.196603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:18.200415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:18.220732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.223019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:18.226531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:18.227536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.242645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:19.267490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:19.275390 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e0a4821-53cd-4c38-815a-3112af2d4d08 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 1.396616 Jul 19 20:01:19.278158 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1930/3960] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:17 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:19.278539 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7db88aaf-e4ba-4337-885d-5c6763489e11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1508 microversion: 2.1 time: 1.091483 Jul 19 20:01:19.284205 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2031/3961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:18 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1508 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:19.295849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:19.300914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:19.318406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3fbcce57-3503-4cfd-b25f-6adaedbffee2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: .version_select at 0x7f23ef2c3dc0>, body: {"keypair": {"name": "tempest-keypair-272768013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGu1zUjPOktYmZz3FKNt0SUDfGpw+PRjKaavDLDu6/8WxxHaCRnlQfOeGvv10kkeoxwzHomRBtXAimNu1ZBG7eaqQFXAbgMDZUnQR0/BAoLyJ3yE5VSCzUOKqv8FWvgSw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:19.320248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.321140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.327913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.328743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.380803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3fbcce57-3503-4cfd-b25f-6adaedbffee2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:19.401192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3fbcce57-3503-4cfd-b25f-6adaedbffee2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for user 1079bff73f42419d99533c176b6a7473 and project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:19.487908 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3fbcce57-3503-4cfd-b25f-6adaedbffee2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186837 Jul 19 20:01:19.490445 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1931/3962] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:01:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:19.771094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a1ac94-af59-4592-af8b-242fbc00a207", "name": "network-vif-plugged", "status": "completed", "tag": "99bb763b-0617-428d-875b-618a389a90e2"}, {"server_uuid": "06cf0f38-cb2a-426c-bc07-0c952087121f", "name": "network-vif-plugged", "status": "completed", "tag": "588c7393-b2ac-4e4a-8c67-ed38a0e9a97c"}, {"server_uuid": "6ace1343-db52-48a7-845e-3a1c1b9bcf86", "name": "network-vif-plugged", "status": "completed", "tag": "a5752373-8102-4639-8589-ec3d0aab69db"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:19.801494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:19.802497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:19.845519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Creating event network-vif-plugged:99bb763b-0617-428d-875b-618a389a90e2 for instance 36a1ac94-af59-4592-af8b-242fbc00a207 on n-h2-843834-3 Jul 19 20:01:19.847105 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Creating event network-vif-plugged:588c7393-b2ac-4e4a-8c67-ed38a0e9a97c for instance 06cf0f38-cb2a-426c-bc07-0c952087121f on n-h1-843834-3 Jul 19 20:01:19.848294 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] Creating event network-vif-plugged:a5752373-8102-4639-8589-ec3d0aab69db for instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 on n-h1-843834-3 Jul 19 20:01:19.870461 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7275cfce-dc66-425b-94e6-f7676c04ea04 req-35971fd9-1fb5-4dea-8310-9fb29edd2298 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107368 Jul 19 20:01:19.879126 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1932/3963] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:01:19.905646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:19.917232 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78917074-42a4-443b-9821-0ff3de443673 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1322 microversion: 2.1 time: 0.631485 Jul 19 20:01:19.937052 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2032/3964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:19 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:20.307571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:20.308534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:20.315556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:20.317800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:20.318520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.319019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.319823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.320270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.335124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.335124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.341588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.343807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.816215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:20.831209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4ba6c2e-c38b-413f-bb56-55187a1cc117 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1516 microversion: 2.1 time: 0.527444 Jul 19 20:01:20.831714 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2033/3965] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:20 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:20.838957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:20.862668 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3014b6b-789a-4cef-bc16-3445e4dcebfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1317 microversion: 2.1 time: 0.559711 Jul 19 20:01:20.866141 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1933/3966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:20 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:20.933813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:20.934739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:20.946101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.948435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:20.949482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:20.953054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.326949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:21.341010 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-073af1d1-f525-430f-99f0-7387cb63bd38 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 200 len: 1515 microversion: 2.1 time: 0.410769 Jul 19 20:01:21.341870 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2034/3967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:20 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:21.365539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:21.367075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:21.376639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.382446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.385038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.389560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.889899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:21.891075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:21.903367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.904354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.908008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:21.909349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:21.966252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:22.268466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:22.307496 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-125981c8-715a-402e-a881-f1c9d7f45f3a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1322 microversion: 2.1 time: 0.940931 Jul 19 20:01:22.319506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1934/3968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:21 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1322 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:22.614033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:22.627125 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce5b389e-d5d7-437f-82fe-b7bd50c71cb3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1504 microversion: 2.1 time: 0.740944 Jul 19 20:01:22.627936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2035/3969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:21 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:22.660658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:22.662759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:22.684931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.687161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:22.689821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:22.691174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:22.754289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:23.083931 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f31dd7f-c12b-4e83-9174-91e0b740a9e4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 204 len: 0 microversion: 2.1 time: 0.434785 Jul 19 20:01:23.084636 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1935/3970] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:22 2022] DELETE /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:23.093448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:23.094411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:23.142483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.150714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.153440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.154507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.325432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:23.326143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:23.339224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.339448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:23.340085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:23.340525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.055723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:24.074536 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b151527-6ef0-4144-b77c-4d888a8b941a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1510 microversion: 2.1 time: 0.985017 Jul 19 20:01:24.075890 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2036/3971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:23 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1510 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:24.083296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:24.084617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.097203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.098857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.099990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.100687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.178728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lazy-loading 'flavor' on Instance uuid 8813ef55-e645-4822-8578-e953516d4ade {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:24.336326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4620140-9477-4477-aec9-34c4336d2fcd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action" status: 200 len: 32 microversion: 2.1 time: 0.256285 Jul 19 20:01:24.337081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2037/3972] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:01:24 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:24.351408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:24.352210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.367979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:24.377503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.378711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.380013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.380576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.381746 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e117a4dc-a7df-42b3-aecd-2a48cf871dfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1515 microversion: 2.1 time: 1.060799 Jul 19 20:01:24.382375 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1936/3973] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:23 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1515 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:24.404473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:24.405138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:24.414876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.422840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:24.424172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:24.424843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.468079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.495023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-974a8bab-8f08-4e9e-94a0-6ae7c1176bdf tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.147336 Jul 19 20:01:25.497120 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2038/3974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:24 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:25.520298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.524498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.547900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.549320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.551381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.552765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.652455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:25.692628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-efcf8a8a-7d17-4d55-94ff-03d0d71a1ac5 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 200 len: 1516 microversion: 2.1 time: 1.294564 Jul 19 20:01:25.694704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1937/3975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:24 2022] GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 1516 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:25.722776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.726652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:25.742282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.743693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.745713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:25.747314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:25.796833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:25.870824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:25.963692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:25.974483 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-46dcb6d5-e815-4168-9bfd-2ca02ba47bfc tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 204 len: 0 microversion: 2.1 time: 0.258634 Jul 19 20:01:25.976900 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1938/3976] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:25 2022] DELETE /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:01:25.991437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:25.994814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:26.014127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.015265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.024048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.024794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.472183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.481274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dbcda936-f423-4c72-bf3a-935c6c73dba9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1510 microversion: 2.1 time: 0.981718 Jul 19 20:01:26.482358 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2039/3977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1510 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:26.514499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:26.515243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:26.531450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.533987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.537516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:26.539725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:26.686227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:26.709767 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8d2ac67-dc06-4951-ac18-d5691ffdbd76 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 200 len: 1522 microversion: 2.1 time: 0.725728 Jul 19 20:01:26.713171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1939/3978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:25 2022] GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.142434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.168851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5754eded-108c-443c-93bb-93c87992848e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.649520 Jul 19 20:01:27.171185 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2040/3979] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:26 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:27.521283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.523589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.547225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.548531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.552672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.554060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.759826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:27.764157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:27.839603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.839721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:27.840133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:27.847397 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-53237339-607d-4d7b-a4ce-488262001fbf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 200 len: 1468 microversion: 2.1 time: 0.344888 Jul 19 20:01:27.858179 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1940/3980] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:27.862589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:27.867831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.091990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-237861087", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1be28aa-622f-46a7-810d-5da0d96319c1"}], "security_groups": [{"name": "tempest-securitygroup--1195496698"}], "key_name": "tempest-keypair-272768013", "user_data": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:28.514497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] validate_networks() for [('e1be28aa-622f-46a7-810d-5da0d96319c1', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:01:28.674409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:28.713078 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0f05d3b-77c2-431a-9c90-9a55cd8fb6a9 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 200 len: 1522 microversion: 2.1 time: 0.986457 Jul 19 20:01:28.714784 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2041/3981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:27 2022] GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 1522 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:28.726691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:28.728813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:28.735513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:28.747918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.749500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:28.751183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:28.752142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:29.434088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:29.942796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:29.959385 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28251329-e0e5-41a9-8897-7f0c538dface tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.241142 Jul 19 20:01:29.975870 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2042/3982] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:28 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:29.988965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4f1bb158-1ef6-4e3e-af8b-2a6dd34887c2 req-fa664777-fb2d-42c7-857e-d9d3e1edf7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf0f38-cb2a-426c-bc07-0c952087121f", "name": "network-vif-deleted", "tag": "588c7393-b2ac-4e4a-8c67-ed38a0e9a97c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:30.006089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4f1bb158-1ef6-4e3e-af8b-2a6dd34887c2 req-fa664777-fb2d-42c7-857e-d9d3e1edf7ae service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.007299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4f1bb158-1ef6-4e3e-af8b-2a6dd34887c2 req-fa664777-fb2d-42c7-857e-d9d3e1edf7ae service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.035939 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4f1bb158-1ef6-4e3e-af8b-2a6dd34887c2 req-fa664777-fb2d-42c7-857e-d9d3e1edf7ae service nova] Creating event network-vif-deleted:588c7393-b2ac-4e4a-8c67-ed38a0e9a97c for instance 06cf0f38-cb2a-426c-bc07-0c952087121f on n-h1-843834-3 Jul 19 20:01:30.047878 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4f1bb158-1ef6-4e3e-af8b-2a6dd34887c2 req-fa664777-fb2d-42c7-857e-d9d3e1edf7ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069370 Jul 19 20:01:30.050073 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2043/3983] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:30.060933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:30.064797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:30.089074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.091112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.094409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.095329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.132076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f HTTP/1.1 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '06cf0f38-cb2a-426c-bc07-0c952087121f'} Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:30.139378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.147684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:30.149028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-667296f9-71a5-4fe4-a18f-3b65b9183a8d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 404 len: 111 microversion: 2.1 time: 0.094810 Jul 19 20:01:30.150826 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2044/3984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:30 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:30.160213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9c3799d5-a287-495d-ac63-8901aee90d6b req-13304a9d-bbc8-422a-804d-68e3b147c81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a1ac94-af59-4592-af8b-242fbc00a207", "name": "network-vif-deleted", "tag": "99bb763b-0617-428d-875b-618a389a90e2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:30.178225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9c3799d5-a287-495d-ac63-8901aee90d6b req-13304a9d-bbc8-422a-804d-68e3b147c81f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.179149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9c3799d5-a287-495d-ac63-8901aee90d6b req-13304a9d-bbc8-422a-804d-68e3b147c81f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.218700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9c3799d5-a287-495d-ac63-8901aee90d6b req-13304a9d-bbc8-422a-804d-68e3b147c81f service nova] Creating event network-vif-deleted:99bb763b-0617-428d-875b-618a389a90e2 for instance 36a1ac94-af59-4592-af8b-242fbc00a207 on n-h2-843834-3 Jul 19 20:01:30.229824 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9c3799d5-a287-495d-ac63-8901aee90d6b req-13304a9d-bbc8-422a-804d-68e3b147c81f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077055 Jul 19 20:01:30.232985 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2045/3985] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:30.248822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:30.251091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:30.265538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.266892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.269764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.272053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.294630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] HTTP exception thrown: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 HTTP/1.1 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '36a1ac94-af59-4592-af8b-242fbc00a207'} Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:30.296963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:30.300879 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:30.303450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 404 to user: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:30.304677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31f1d4be-a4d9-4108-b980-da3ecb4b9926 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 404 len: 111 microversion: 2.1 time: 0.069456 Jul 19 20:01:30.312805 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2046/3986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:30 2022] GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:30.321605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:30.323899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:30.332039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.334195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.335353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.336014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.858411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:30.886137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e81f690e-9887-4f50-ae5f-e7ac6a61cf51 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.571036 Jul 19 20:01:30.887226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2047/3987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:30 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:30.908106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:30.912730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:30.914194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:30.926169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.926991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:30.934950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:30.935986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.146954 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba7c6dfe-feb0-436f-bdc5-faa06ec8e9f0 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.250082 Jul 19 20:01:31.159407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2048/3988] 10.222.0.23 () {58 vars in 1229 bytes} [Tue Jul 19 20:01:30 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:31.214438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:31.215201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:31.216308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:31.217298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:31.218325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:31.256514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.260090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.265581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.266970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.316804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:31.338595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Getting quotas for user 1079bff73f42419d99533c176b6a7473 and project ecd079edd40a407dbec0aa9424f91d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:31.367526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:31.373641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:31.483217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0059341e-54db-4ccf-b060-d936f0e331a5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.400748 Jul 19 20:01:31.494656 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1941/3989] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:01:31.509829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:31.513317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:31.517428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2046359302", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:31.529507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.530468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.531373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.531823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.652960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:31.654855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:31.656123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:31.659039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:31.666031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:31.688882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.689983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.692041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:31.693923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:31.745856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Getting quotas for project f036ed6c6bbb4d178de876a3d12f9c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:01:31.760659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Getting quotas for user c4acfb9e176f4400891ee6a8dd9cffd5 and project f036ed6c6bbb4d178de876a3d12f9c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:01:31.795611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:01:31.802877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:01:31.997991 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2a35b1c-0dc7-41d7-8b8d-4f264092cd2d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.836529 Jul 19 20:01:32.008685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2049/3990] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 20:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:01:32.022818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebdf2e08-16a7-48ea-b7e9-e2d1a2482304 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebdf2e08-16a7-48ea-b7e9-e2d1a2482304 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: action_args: {} Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:01:32.030196 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 20:01:32.038573 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.046206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebdf2e08-16a7-48ea-b7e9-e2d1a2482304 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:32.047254 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebdf2e08-16a7-48ea-b7e9-e2d1a2482304 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.034398 Jul 19 20:01:32.057127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2050/3991] 10.222.0.23 () {58 vars in 1181 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:32.080409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.083996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df898b9b-e630-4273-b515-c1c0afc112f3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:32.091748 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-87f395db-1c7b-4e29-8ebf-9f7de21b30e6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.594650 Jul 19 20:01:32.096284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1942/3992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:31 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:32.103698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8a7b9ad-0853-4696-8eeb-628801027afb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df898b9b-e630-4273-b515-c1c0afc112f3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 163 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": 12345, "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 12345 Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:32.103850 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.108462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df898b9b-e630-4273-b515-c1c0afc112f3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:32.109364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df898b9b-e630-4273-b515-c1c0afc112f3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.047231 Jul 19 20:01:32.117157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f8a7b9ad-0853-4696-8eeb-628801027afb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.141207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2051/3993] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:32 2022] POST /compute/v2.1/servers => generated 127 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:32.175832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.181680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.438991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f8a7b9ad-0853-4696-8eeb-628801027afb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.450798 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8a7b9ad-0853-4696-8eeb-628801027afb tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1236 microversion: 2.1 time: 0.347588 Jul 19 20:01:32.458363 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1943/3994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1236 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:32.465145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.476809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.478662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:32.489586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.490254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.491395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.493312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.543088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.556463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.562774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:01:32.563434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.567587 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54911cab-0d90-4925-bd0c-7004573ddd5b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1278 microversion: 2.57 time: 0.413466 Jul 19 20:01:32.569408 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2052/3995] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1278 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:32.587108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.588799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:32.613415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.613883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.614701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.615173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.622777 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-14f99ec0-9e16-47de-b2cf-3b2198c70067 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.161759 Jul 19 20:01:32.624889 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1944/3996] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers => generated 681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:32.641767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.649566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.650841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.servers [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Removing options 'limit' from query {{(pid=131230) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 20:01:32.651863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:32.661073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.661441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.662293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.662816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.730488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:01:32.778641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24d8fd4a-0b11-4003-bb49-d6c16c1446bb tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.146031 Jul 19 20:01:32.784838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1945/3997] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:32.803073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4602243-af60-4446-8c19-8d49a34ae72a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4602243-af60-4446-8c19-8d49a34ae72a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '-1' Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:01:32.819041 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4602243-af60-4446-8c19-8d49a34ae72a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4602243-af60-4446-8c19-8d49a34ae72a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.033769 Jul 19 20:01:32.834886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1946/3998] 10.222.0.23 () {58 vars in 1141 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:32.846971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af47d950-d97a-44c6-b13e-b6e8870315e3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af47d950-d97a-44c6-b13e-b6e8870315e3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: action_args: {} Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi 'testing' Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 20:01:32.851112 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af47d950-d97a-44c6-b13e-b6e8870315e3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af47d950-d97a-44c6-b13e-b6e8870315e3 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012609 Jul 19 20:01:32.867168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1947/3999] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:01:32.881723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-008d6bdf-0884-4a79-b7cf-71936df9ac5c tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.885608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-008d6bdf-0884-4a79-b7cf-71936df9ac5c tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.886560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-008d6bdf-0884-4a79-b7cf-71936df9ac5c tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:32.907502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.servers [None req-008d6bdf-0884-4a79-b7cf-71936df9ac5c tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Flavor 'non_existing_flavor' could not be found {{(pid=131230) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 19 20:01:32.908596 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-008d6bdf-0884-4a79-b7cf-71936df9ac5c tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044345 Jul 19 20:01:32.921408 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1948/4000] 10.222.0.23 () {58 vars in 1177 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:32.939232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:32.945028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:32.946105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:32.960128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.960919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:32.962054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:32.962787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.137982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c7fc664-6089-4fec-b63d-71e0daa3668a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.218038 Jul 19 20:01:33.140158 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1949/4001] 10.222.0.23 () {58 vars in 1173 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:33.148032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:33.149827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:33.168797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.169244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.175658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:33.176427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:33.982628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:33.995170 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5819b08-5d9c-4e96-9bc0-deefe5fe1bbb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.423853 Jul 19 20:01:33.996222 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2053/4002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:32 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:34.001497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.005731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.006817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:34.015107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.016089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.018056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.018797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.136209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-921b2f02-b46f-4ca0-aac2-4d47be521f88 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.138458 Jul 19 20:01:34.137184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2054/4003] 10.222.0.23 () {58 vars in 1183 bytes} [Tue Jul 19 20:01:33 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:34.143053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.143898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.150865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.151598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.152558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.153258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.176445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.185492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3fa5ef4-c2db-4b72-be9b-71bc118e0722 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.043569 Jul 19 20:01:34.196018 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1950/4004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:33 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:34.201532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.202226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.215103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.216521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.217555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.218233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.473952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.486519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.493253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.493573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.495019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6d64393-e93e-4877-b9ae-f2a0f9a1f2bd tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1330 microversion: 2.57 time: 0.297884 Jul 19 20:01:34.495787 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1951/4005] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1330 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:34.512460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.513394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:34.524618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7982b76-c7b8-446e-b0d5-6a2604e0cf1c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1296 microversion: 2.1 time: 0.385760 Jul 19 20:01:34.525251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.525489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2055/4006] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1296 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:34.526059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.527187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.527830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.540944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:34.557365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.564886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:34.584331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.591533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.596913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.597279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:34.650967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:01:34.739208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:34.748149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:34.749067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.038203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.055566 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24be4d29-4c7a-4897-a624-30ffa49369f1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.547119 Jul 19 20:01:35.056628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1952/4007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:35.205995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.207449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:35.220344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.234264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.235782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.238532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.255406 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2a6fe29-c165-4c1d-a417-593dd77e9115 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.718258 Jul 19 20:01:35.270114 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2056/4008] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 20:01:34 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:35.276876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f8e1da1-a1f5-40e3-a074-53d5ed5d7d37 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.284501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f8e1da1-a1f5-40e3-a074-53d5ed5d7d37 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.285580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f8e1da1-a1f5-40e3-a074-53d5ed5d7d37 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014351 Jul 19 20:01:35.297944 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2057/4009] 10.222.0.23 () {58 vars in 1177 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:01:35.320300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.329573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:35.330316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Searching by: {'deleted': False, 'project_id': 'd361c1c918cf4ff284597d40676333b6'} {{(pid=131229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:01:35.356610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.357802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.360749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.362875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.487995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:35.496844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.multi_cell_list [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:01:35.605467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71d8bbdf-0510-41d3-a4cd-626e6ed8bca6 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.303138 Jul 19 20:01:35.606753 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2058/4010] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers => generated 681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:35.617441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:35.620284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:35.644206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.645674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:35.647481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:35.649405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.073283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.086590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.096240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.097830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85ba75b2-d860-4bf3-9e98-30ed95c3081d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1336 microversion: 2.57 time: 0.489686 Jul 19 20:01:36.098602 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2059/4011] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1336 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:36.115112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.116153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.126558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.127453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.140266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.141149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.392379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.407120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c55aebdc-1877-4df0-88dc-c72aa77fd363 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.202322 Jul 19 20:01:36.410461 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1953/4012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:35 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:36.427451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.427964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.435661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.436125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.437085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.437655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.513008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] HTTP exception thrown: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 HTTP/1.1 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '36a1ac94-af59-4592-af8b-242fbc00a207'} Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:36.516712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:36.521139 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:36.529801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 404 to user: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:36.533620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-042effc5-710e-4a45-9550-9f4f5d203579 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 404 len: 111 microversion: 2.1 time: 0.111043 Jul 19 20:01:36.535667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1954/4013] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:36 2022] DELETE /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:36.554596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:36.564973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:36.592127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:36.607839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.611035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.612969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:36.615044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f97594c3-31e7-40fc-b6b4-122746296cd2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1294 microversion: 2.1 time: 0.506595 Jul 19 20:01:36.618987 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2060/4014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:36 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1294 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:36.619872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:36.746684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:37.003335 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20560a12-491d-4745-9510-df4b2d2e4c8a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 204 len: 0 microversion: 2.1 time: 0.462214 Jul 19 20:01:37.009787 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1955/4015] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:36 2022] DELETE /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:01:37.014947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.015464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.024208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.024662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.025471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.025960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.060659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:01:37.164878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.166578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.219634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.221604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.223870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.226023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.230002 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-012fcc9b-6c7c-410b-a413-d8aed1120ca1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 204 len: 0 microversion: 2.1 time: 0.217932 Jul 19 20:01:37.230630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2061/4016] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:01:37 2022] DELETE /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:01:37.245677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.246980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 36a1ac94-af59-4592-af8b-242fbc00a207] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.258450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.259446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.260727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.261438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.303569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] HTTP exception thrown: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 HTTP/1.1 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '36a1ac94-af59-4592-af8b-242fbc00a207'} Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:37.307241 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. Jul 19 20:01:37.311110 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:37.314017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 404 to user: Instance 36a1ac94-af59-4592-af8b-242fbc00a207 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:37.315932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a21f4bd6-a417-4bfb-9300-7c9c37f2d06a tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207" status: 404 len: 111 microversion: 2.1 time: 0.078882 Jul 19 20:01:37.320815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2062/4017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/36a1ac94-af59-4592-af8b-242fbc00a207 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:37.353352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.358688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.382570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.396283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.402703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.403804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.472953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.488044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.490894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.493293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7bae0a1f-a290-4dec-bd60-df008d4ca7e1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1336 microversion: 2.57 time: 0.362447 Jul 19 20:01:37.507180 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1956/4018] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1336 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:37.512759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.514326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.543231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.544430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.545485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.546317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.849965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.868702 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e058877-5acd-4507-b553-3c7088e246fd tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1521 microversion: 2.1 time: 0.544851 Jul 19 20:01:37.871682 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2063/4019] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:37.906578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:37.909108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:37.940664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.953412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.955805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:37.957961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:37.966449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:37.996122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec27a4b7-69d7-4d0e-b1e8-4b7558c4ee06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.486522 Jul 19 20:01:37.998085 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1957/4020] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:38.156125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.165316 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2f95c56-7ca5-4d99-bfd7-1735a87f07ae tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1294 microversion: 2.1 time: 0.287656 Jul 19 20:01:38.167234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2064/4021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:37 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:38.519713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.531992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.545963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.563833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.565487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.584066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.652653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e2a0c0a-f2f2-4b53-97e4-06288ab4ceb9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333244423", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "48b22790-1f4e-4adb-9616-677d2a44da64", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:38.661465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:38.857196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.874286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.885108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:38.888246 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16098cf9-f5c3-42c0-8109-0b8a40dcdb5e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1336 microversion: 2.57 time: 0.377207 Jul 19 20:01:38.895049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1958/4022] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1336 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:38.913573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:38.914658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:38.938324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8e2a0c0a-f2f2-4b53-97e4-06288ab4ceb9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. Jul 19 20:01:38.941171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.941638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.944848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:38.946903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e2a0c0a-f2f2-4b53-97e4-06288ab4ceb9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 358 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333244423", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "48b22790-1f4e-4adb-9616-677d2a44da64", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: exception: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1333244423', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '48b22790-1f4e-4adb-9616-677d2a44da64'}], 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:38.950319 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e2a0c0a-f2f2-4b53-97e4-06288ab4ceb9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Block Device 48b22790-1f4e-4adb-9616-677d2a44da64 is not bootable. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:38.966229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e2a0c0a-f2f2-4b53-97e4-06288ab4ceb9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.315617 Jul 19 20:01:38.971878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2065/4023] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:39.014563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:39.052974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:39.095170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.095958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.097409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.098209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.821935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:39.836544 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e18dba8e-093e-4f98-82d9-f5236a2bafd4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.862694 Jul 19 20:01:39.838090 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2066/4024] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:39.844162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:39.845578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:39.864192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.865264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:39.866585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:39.867382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.146292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:40.161187 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e201f731-53a0-40a1-9f26-e1e41497fa23 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1521 microversion: 2.1 time: 1.251111 Jul 19 20:01:40.162445 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1959/4025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:38 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1521 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:40.168405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:40.169204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:40.176059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.177577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:40.178569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:40.179256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.018173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.050002 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a3bb8a0-870e-401e-aa50-436eb9a57dea tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.209819 Jul 19 20:01:41.052888 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2067/4026] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:39 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:41.065925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:41.067540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.096869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.098717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.100788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.102735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.368677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.382541 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1244678d-010c-4591-ac1e-f935d87a6212 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 1.218268 Jul 19 20:01:41.399346 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1960/4027] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:40 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:41.409589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:41.411147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.422396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.423674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.425427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.426475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.665977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.679041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.683933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.686619 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60ac5baf-c099-4def-a8b9-6736822d129a tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1357 microversion: 2.57 time: 0.284717 Jul 19 20:01:41.688217 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1961/4028] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:41 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:41.696065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:41.696870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.702343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:41.707045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.707871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.709392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.710143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.717325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-02ed7b52-7d12-4a82-ba73-3c21968babd5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.661729 Jul 19 20:01:41.733309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2068/4029] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:41 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:41.742022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:41.745855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:41.762446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.764236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.767896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:41.770335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:41.986252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:01:41.986937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:01:41.989437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:01:41.990062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:01:41.994335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:01:42.211224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.269511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.269989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.270824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.273605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.349688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92e68868-9c5b-453f-a895-315dfe09d935 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "POST /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1/action" status: 202 len: 1138 microversion: 2.57 time: 0.613055 Jul 19 20:01:42.350572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2069/4030] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Jul 19 20:01:41 2022] POST /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1/action => generated 1138 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 20:01:42.356701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.357303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.371297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.374797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.375985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.381092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.451256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:42.726359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:42.753789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-505b34c0-41f3-42e0-9803-262f1884d1f1 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1521 microversion: 2.1 time: 1.063703 Jul 19 20:01:42.771003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1962/4031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:41 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1521 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:42.792744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:42.794672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:42.825726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.826582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:42.829643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:42.832677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.000141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:43.362317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.377742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.381049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.384336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a51dddec-522f-4ed4-8181-3eff928a18d5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.611857 Jul 19 20:01:43.399135 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1963/4032] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:43.413637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.420140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.457759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.467068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.472330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.475955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.566735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:43.595069 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-861b4622-9981-4aee-9ec4-5ba414d8b88d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.242797 Jul 19 20:01:43.607633 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2070/4033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:42 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:43.615658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c6156a08-482a-4d3e-a38f-bc0068c2ca68 req-6e3b9e1c-0b83-42bb-abda-8f1750fb3a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e", "name": "network-vif-deleted", "tag": "01affeba-2252-4924-a21d-84dd2073f0a0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:43.660526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6156a08-482a-4d3e-a38f-bc0068c2ca68 req-6e3b9e1c-0b83-42bb-abda-8f1750fb3a8f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.663059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6156a08-482a-4d3e-a38f-bc0068c2ca68 req-6e3b9e1c-0b83-42bb-abda-8f1750fb3a8f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.721986 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c6156a08-482a-4d3e-a38f-bc0068c2ca68 req-6e3b9e1c-0b83-42bb-abda-8f1750fb3a8f service nova] Creating event network-vif-deleted:01affeba-2252-4924-a21d-84dd2073f0a0 for instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e on n-h2-843834-3 Jul 19 20:01:43.727527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c6156a08-482a-4d3e-a38f-bc0068c2ca68 req-6e3b9e1c-0b83-42bb-abda-8f1750fb3a8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120656 Jul 19 20:01:43.728721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2071/4034] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:43.800214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:43.801313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:43.817111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.817557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.818545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.823329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.890706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:43.895272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:43.895837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lazy-loading 'fault' on Instance uuid 6ace1343-db52-48a7-845e-3a1c1b9bcf86 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:01:44.086972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf8e936eba046f7b2ab91470709b441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd361c1c918cf4ff284597d40676333b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.091204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:44.103817 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6178f4f2-643b-450d-966b-275642ed8978 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 200 len: 1312 microversion: 2.1 time: 0.310677 Jul 19 20:01:44.108083 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2072/4035] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.203443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:44.265859 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c1e1171-9177-4ea3-9128-0d58cfbf4f97 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 0.859888 Jul 19 20:01:44.286335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1964/4036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:43 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:44.441342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.441342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.504548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.516180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.518091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.519319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.620194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:44.629580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:44.683884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.717643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.719676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:44.735386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:44.749796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:45.039199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.069222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.082139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.090823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce493c3b-9aed-4661-ba10-e827beab7c02 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.661551 Jul 19 20:01:45.096605 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2073/4037] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:45.139945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.144842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 6ace1343-db52-48a7-845e-3a1c1b9bcf86] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.186058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.191896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.197992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.198941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.294765 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] HTTP exception thrown: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 HTTP/1.1 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6ace1343-db52-48a7-845e-3a1c1b9bcf86'} Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:45.315253 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 404 to user: Instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49e4dcf3-9edb-4b89-a8f3-9ec6391bbee7 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86" status: 404 len: 111 microversion: 2.1 time: 0.185207 Jul 19 20:01:45.323865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2074/4038] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/6ace1343-db52-48a7-845e-3a1c1b9bcf86 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:01:45.338855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.338855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.346409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.346746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.347610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.348056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.397363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:45.896432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:45.908535 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6083d48d-5492-473b-b9e8-d6db67022cd3 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 1.295815 Jul 19 20:01:45.912525 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1965/4039] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:44 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:45.923039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:45.923667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] [instance: 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:45.941380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.945092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:45.948401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:45.953214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.020142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] HTTP exception thrown: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Request method failure captured: Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e HTTP/1.1 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1ypfoskT-5GSfn8zQOOnhRx2l_O8hHeXopqIgV-hdD7lut8ehPxQ43BkMDPep2ycJQ5WSEBzPsBWN4XmJpoaWPOkDZfM2jCdKEBD6Dwva8AujZsPItuCFKXbGjPimZA6tBTuh06PTlmhYhmgEgfuKQ48VCV-RAOGfwuzBSGcV-4ak Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d361c1c918cf4ff284597d40676333b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d361c1c918cf4ff284597d40676333b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d361c1c918cf4ff284597d40676333b6 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1633264988 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0cf8e936eba046f7b2ab91470709b441 Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ListServersNegativeTestJSON-1633264988-project Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e'} Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:46.023803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. Jul 19 20:01:46.032574 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.038849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] Returning 404 to user: Instance 483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:46.038849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1cfdd776-c73b-49b6-a99c-66478acd2058 tempest-ListServersNegativeTestJSON-1633264988 tempest-ListServersNegativeTestJSON-1633264988-project] 10.222.0.23 "GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e" status: 404 len: 111 microversion: 2.1 time: 0.124074 Jul 19 20:01:46.043603 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1966/4040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/483a0d7c-7ed8-4bb5-9989-d71c4c6ee54e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:01:46.066473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ace1343-db52-48a7-845e-3a1c1b9bcf86", "name": "network-vif-deleted", "tag": "a5752373-8102-4639-8589-ec3d0aab69db"}, {"name": "network-changed", "server_uuid": "1f1ba765-9d80-4daa-8415-904bd6bc380a", "tag": "811a1ae2-b430-4a10-a1c8-af0d5fe0df06"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:46.104819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.105942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.171578 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] Creating event network-vif-deleted:a5752373-8102-4639-8589-ec3d0aab69db for instance 6ace1343-db52-48a7-845e-3a1c1b9bcf86 on n-h1-843834-3 Jul 19 20:01:46.173752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] Creating event network-changed:811a1ae2-b430-4a10-a1c8-af0d5fe0df06 for instance 1f1ba765-9d80-4daa-8415-904bd6bc380a on n-h1-843834-3 Jul 19 20:01:46.191871 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8b8665a9-5007-4e85-907d-1e403ceb41a4 req-b83bb440-34ab-4d69-ab42-02f137ba8a8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.141294 Jul 19 20:01:46.198049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1967/4041] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:46.224982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.226703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.250241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.261051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.263331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.269250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.473970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.499142 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84b3b6d7-9999-458c-a89c-94fd174b8a6c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 1.176817 Jul 19 20:01:46.515790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2075/4042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:45 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:46.536956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-354dc409-00c0-4a96-92ac-31b425bbee4a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2144006911", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "371de3c2-13a8-4290-a544-705d4d9b3f29", "destination_type": "local"}, {"source_type": "volume", "uuid": "3679c771-a8b2-4411-916e-f2a1d88f9c3a", "destination_type": "invalid"}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-354dc409-00c0-4a96-92ac-31b425bbee4a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 495 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2144006911", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "371de3c2-13a8-4290-a544-705d4d9b3f29", "destination_type": "local"}, {"source_type": "volume", "uuid": "3679c771-a8b2-4411-916e-f2a1d88f9c3a", "destination_type": "invalid"}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2144006911', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3679c771-a8b2-4411-916e-f2a1d88f9c3a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:46.551811 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-354dc409-00c0-4a96-92ac-31b425bbee4a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-354dc409-00c0-4a96-92ac-31b425bbee4a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034412 Jul 19 20:01:46.561976 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2076/4043] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:46.583882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.585022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.612342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.613115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.614531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.615351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.746673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.803730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.811807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:46.814394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e54fa46-626f-4b4e-b964-45b571a46d49 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.613850 Jul 19 20:01:46.815514 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1968/4044] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:46.933285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:46.934285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:46.960371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.966633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:46.968609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:46.971287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.357076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.384180 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41e96bbf-7f77-46ef-8298-79dc1d695abc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.815143 Jul 19 20:01:47.390044 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2077/4045] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:47.422497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.423179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.438769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.439182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.440040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.440551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.495990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:47.523098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92d7f3a3-ec6a-4328-8101-cd711e3e4ef1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.596922 Jul 19 20:01:47.539883 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1969/4046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:46 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:47.557539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:47.559240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:47.615528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.617255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.618990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:47.623012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:47.981579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.016194 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32b20c37-f7a6-46d6-aea5-7cbd6abac3ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.598851 Jul 19 20:01:48.037771 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2078/4047] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:48.101078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.102203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.160276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.176753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.186490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.187292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.545713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.594395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.603021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.605245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3c52ed94-7e0c-4f67-bdff-34da7320c7e2 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.565904 Jul 19 20:01:48.607146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2079/4048] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:48.615611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8f56e4e-5430-4828-84d0-acd937a503e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900372956", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8f56e4e-5430-4828-84d0-acd937a503e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 492 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900372956", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1900372956', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 19 20:01:48.624466 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 20:01:48.627732 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:48.644896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e8f56e4e-5430-4828-84d0-acd937a503e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:48.649747 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e8f56e4e-5430-4828-84d0-acd937a503e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.039573 Jul 19 20:01:48.654751 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2080/4049] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:48 2022] POST /compute/v2.1/servers => generated 624 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:48.667722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.672269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.672945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:48.691397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.694834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.696251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.697111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.701575 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfd4b40c-2824-429c-bc88-3c42d99f674c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 1.152053 Jul 19 20:01:48.702844 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1970/4050] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:47 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:48.721769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:48.728273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:48.755719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.756844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:48.758658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:48.759812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.161483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.189343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8f41c04-852f-4036-823b-613e179508d0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.528517 Jul 19 20:01:49.211404 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2081/4051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:49.541125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:49.553432 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b62ebabb-d002-4358-b2c3-80f9a5338760 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.839945 Jul 19 20:01:49.560790 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1971/4052] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:48 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:49.572854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.573538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.585035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:49.590228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.598394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.599370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.599820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.639146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:49.639840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:49.652851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.653306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:49.654105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:49.654546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.619813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.640551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.654702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:50.670074 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e050cd1-5764-4406-98c6-1f6414559aee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 1.034539 Jul 19 20:01:50.688751 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1972/4053] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:01:50.703765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:50.704947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:50.748611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.749434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:50.750310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:50.750972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.338971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:51.384046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-814c92eb-096f-4170-a1cf-dc4afff08cad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.815089 Jul 19 20:01:51.392791 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2082/4054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:49 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:51.446833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:51.453842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:51.461301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.461999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.464868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:51.465646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:51.943033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:51.956483 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-144def24-8007-4aca-94fd-5c6fb0e65ace tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 1.283632 Jul 19 20:01:51.959915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:51.975553 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1973/4055] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:50 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:51.994533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.005327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23681fdd-9330-40d1-85ea-4c4882d204fc tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.607088 Jul 19 20:01:52.005970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2083/4056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:52.019312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.034299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1d08bfc-d510-4dd1-a600-2dbd51a274c0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:52.041766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1d08bfc-d510-4dd1-a600-2dbd51a274c0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 416 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:52.047981 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:01:52.051838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:52.055571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1d08bfc-d510-4dd1-a600-2dbd51a274c0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:52.060493 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1d08bfc-d510-4dd1-a600-2dbd51a274c0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.039863 Jul 19 20:01:52.062512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.063924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.064670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.065687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2084/4057] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:52 2022] POST /compute/v2.1/servers => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:52.083373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.091925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.124423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.131085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.132821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.134765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.363923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.374240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.389118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.390734 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6aaed2d0-aac6-44c8-8042-abb1ac3e30ca tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.413157 Jul 19 20:01:52.391526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1974/4058] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:51 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:52.409478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-47d551b5-2518-428f-9ac8-a275778c2e35 req-492b1580-90eb-488e-a55b-5656f44a5de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1ba765-9d80-4daa-8415-904bd6bc380a", "name": "network-vif-plugged", "status": "completed", "tag": "811a1ae2-b430-4a10-a1c8-af0d5fe0df06"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:52.419896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-47d551b5-2518-428f-9ac8-a275778c2e35 req-492b1580-90eb-488e-a55b-5656f44a5de3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.420761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-47d551b5-2518-428f-9ac8-a275778c2e35 req-492b1580-90eb-488e-a55b-5656f44a5de3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.449341 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-47d551b5-2518-428f-9ac8-a275778c2e35 req-492b1580-90eb-488e-a55b-5656f44a5de3 service nova] Creating event network-vif-plugged:811a1ae2-b430-4a10-a1c8-af0d5fe0df06 for instance 1f1ba765-9d80-4daa-8415-904bd6bc380a on n-h1-843834-3 Jul 19 20:01:52.460908 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-47d551b5-2518-428f-9ac8-a275778c2e35 req-492b1580-90eb-488e-a55b-5656f44a5de3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066661 Jul 19 20:01:52.462429 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1975/4059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:52.711635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:52.721594 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-358e9a8e-7cae-4364-bde4-75df8018e888 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.646490 Jul 19 20:01:52.722194 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2085/4060] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:52.754545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.755826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:52.818817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.829503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.835554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:52.837706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:52.980749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:52.981412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.013125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.016882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.018233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.019236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.547165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.568022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-547025dd-93f4-4436-9c81-8630461611e9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.829678 Jul 19 20:01:53.569102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.569465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1976/4061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:53.594146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.595424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.619711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:53.627058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.627823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.628642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.629625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.641838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:53.682972 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fc9ccd5-41e5-4efe-9bbb-610bce7d8614 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1362 microversion: 2.1 time: 0.672482 Jul 19 20:01:53.684623 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2086/4062] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:52 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1362 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:53.699590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:53.701228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:53.709467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.710164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.711181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:53.711780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:53.837376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.853377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.855025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:53.859865 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b2ac156-0b3c-4230-a163-bdd1b8d0a5a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.173479 Jul 19 20:01:53.871798 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2087/4063] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:53.877978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-824ab9e1-7689-41ea-8c86-6277f8f721c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1975603765", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": -1, "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:53.943376 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-824ab9e1-7689-41ea-8c86-6277f8f721c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Flavor -1 could not be found. Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-824ab9e1-7689-41ea-8c86-6277f8f721c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 206 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1975603765", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": -1, "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: exception: Flavor -1 could not be found. Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1975603765', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': -1, 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:53.951231 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 19 20:01:53.956178 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:53.961715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-824ab9e1-7689-41ea-8c86-6277f8f721c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:53.972155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-824ab9e1-7689-41ea-8c86-6277f8f721c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.096909 Jul 19 20:01:53.977418 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2088/4064] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:01:53.997952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.001162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.023969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:54.029545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.032372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.034644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.035655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.060688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-961ffc17-12d3-4992-a683-910dd6671ec0 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.484556 Jul 19 20:01:54.082667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1977/4065] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:54.902737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:54.916424 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-34a3de0b-2a54-4279-8170-181293e85917 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.933479 Jul 19 20:01:54.937249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2089/4066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:53 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:01:54.942867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:54.950992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:54.985085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.986008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:54.988774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:54.991538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.143776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.162593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.172116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:55.180401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df554071-ecdc-4321-9afc-4bbcc51b7a65 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.234383 Jul 19 20:01:55.190669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2090/4067] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:54 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:55.190669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:55.190669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:55.210168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:55.212185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:55.213984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.214438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.215289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.215737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.232467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.234508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:55.238778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:55.240559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.088021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.096808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-697916b2-47ce-4b6d-bcb2-d1269b902253 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.911825 Jul 19 20:01:56.109068 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2091/4068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:55 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:56.114265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.115168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.152966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.153991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.155995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.159657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.172425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.186607 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f9f4f087-9a20-44c8-a2b5-eb03c1199da7 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1549 microversion: 2.1 time: 1.488660 Jul 19 20:01:56.194076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1978/4069] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:54 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1549 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:56.208584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.213937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.233545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.236148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.237332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.238072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.411674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.436389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.448504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.450335 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0435adec-74b5-45d0-a9fc-f39e792fdef5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.245725 Jul 19 20:01:56.451036 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1979/4070] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:56.469693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.472137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.484919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.495878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.497289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.502010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.779287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:56.816810 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31c7effe-f11c-4385-a79b-b268058d0399 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.705844 Jul 19 20:01:56.818203 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2092/4071] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:56.836206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a020481-43e9-4eda-a304-3d92a502d805 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-955279803", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a020481-43e9-4eda-a304-3d92a502d805 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 172 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-955279803", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-955279803', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi -1 Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:01:56.853798 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a020481-43e9-4eda-a304-3d92a502d805 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:56.861523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a020481-43e9-4eda-a304-3d92a502d805 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.036704 Jul 19 20:01:56.866520 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2093/4072] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:56.895195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:56.896257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:56.923799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.924557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.925994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:56.926770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:56.934688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d096e43-a59a-4bfd-b6ee-46189a03a744 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.482099 Jul 19 20:01:56.936273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1980/4073] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-interface => generated 285 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:01:57.511792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:57.516636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:57.569813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.577055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.587377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:57.597569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:57.945782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.960076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:57.994267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.007190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ddcd7568-44b0-43c5-8fc5-dd04cf079732 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.132397 Jul 19 20:01:58.009793 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2094/4074] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:56 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.017370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.024381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1f207f2-d956-4a4c-afba-f340718041c1 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.529027 Jul 19 20:01:58.031943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.033990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1981/4075] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:01:57 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:01:58.052284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.065340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.069739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.077989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.092988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.098177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.099100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.116871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.118088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.119685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.120672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.135676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:01:58.615856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:01:58.635798 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70db62d1-c5f4-4d2c-8544-f65d22aca427 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.591442 Jul 19 20:01:58.637884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1982/4076] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:01:58.825298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36cd7c2e-bd76-4b68-802d-34542f2c2fe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1961861431", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:01:58.843290 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-36cd7c2e-bd76-4b68-802d-34542f2c2fe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36cd7c2e-bd76-4b68-802d-34542f2c2fe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 216 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1961861431", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1961861431', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:01:58.848990 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36cd7c2e-bd76-4b68-802d-34542f2c2fe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:01:58.857208 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36cd7c2e-bd76-4b68-802d-34542f2c2fe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.038915 Jul 19 20:01:58.859424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1983/4077] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:01:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:01:58.874262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:01:58.891996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:01:58.926905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.937420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:01:58.939390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:01:58.940194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.117564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.132036 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1e6f975-0fb4-40bc-ad7a-37bfd11b257c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1502 microversion: 2.1 time: 2.116264 Jul 19 20:02:00.134061 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2095/4078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1502 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:00.148754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.149937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.166633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.168538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.169642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.170435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.445958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.463347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.476361 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf189160-5959-4a7a-8fb1-cd59383cd874 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.604869 Jul 19 20:02:00.477746 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1984/4079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:01:58 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:00.487133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d8e7d1-a346-4cbf-b360-db03ce1f1d96"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:00.487411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.491326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:00.493121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.495074 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a35651f-e8f6-4005-a578-38d852ab76ee tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.358192 Jul 19 20:02:00.512310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.513242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.514407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.520397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.535682 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2096/4080] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:00.552023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.553579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.561605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.562550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.563612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.564062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.576532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Cannot 'attach_volume' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state rescued Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/os-volume_attachments HTTP/1.1 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 74 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: {"volumeAttachment": {"volumeId": "33d8e7d1-a346-4cbf-b360-db03ce1f1d96"}} Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'attach_volume' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state rescued Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '8813ef55-e645-4822-8578-e953516d4ade', 'body': {'volumeAttachment': {'volumeId': '33d8e7d1-a346-4cbf-b360-db03ce1f1d96'}}} Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8813ef55-e645-4822-8578-e953516d4ade in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 20:02:00.584491 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state rescued Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state rescued Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 409 to user: Cannot 'attach_volume' instance 8813ef55-e645-4822-8578-e953516d4ade while it is in vm_state rescued {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3811822d-92dc-4eff-bbbb-107701bce1c5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107185 Jul 19 20:02:00.593554 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1985/4081] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:00 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:00.600147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:00.605191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.619349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.631299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.632514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.633195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.774459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-593a5d88-fb31-4f96-8d04-e02a5c66c71b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action" status: 202 len: 0 microversion: 2.1 time: 0.181802 Jul 19 20:02:00.780855 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1986/4082] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:00 2022] POST /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:00.794791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:00.796217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:00.822803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.823271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:00.825792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:00.826239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.059598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.090724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-943140e9-5ff7-4487-86f8-ef2954a13cf9 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.540313 Jul 19 20:02:01.093615 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2097/4083] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:01.155337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1105664022", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-key-344162633", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:01.279294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] validate_networks() for [('c6df2121-a511-4ff4-b44f-c10d518370e5', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:01.805244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:01.841930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b01b9dcd-b194-44b0-9204-b3191900531f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1510 microversion: 2.1 time: 1.059174 Jul 19 20:02:01.844919 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1987/4084] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:00 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1510 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:01.868695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:01.872856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:01.910732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.915917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:01.924307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:01.924904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.115887 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Invalid key_name provided. Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 246 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1105664022", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-key-344162633", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid key_name provided. Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1105664022', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'key_name': 'tempest-key-344162633', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-344162633 not found for user af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:02.118764 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:02.124665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid key_name provided. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:02.130956 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f25c414-81fa-4a30-ab7d-81e6e0584f7d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.975086 Jul 19 20:02:02.134933 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2098/4085] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:01 2022] POST /compute/v2.1/servers => generated 70 bytes in 985 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:02:02.140902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:02.147688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.168249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.179238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.180045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.181185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.181820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.182271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.185997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.187651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0febdcaf-e20f-4ef4-8121-242c9916a191 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.337640 Jul 19 20:02:02.188973 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1988/4086] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:01 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:02.509911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:02.553374 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41b099f0-90fa-43ec-98b0-f1c46d95a05c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.414075 Jul 19 20:02:02.558780 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2099/4087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:02 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:02.597051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:02.603117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.617972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.619329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.620272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.621013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.869592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:02.870835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:02.883030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.887177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:02.888621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:02.892670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.221286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.260718 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55878ba9-4020-4b8e-9d9a-6f8b19a493df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.689065 Jul 19 20:02:03.274966 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1989/4088] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:02 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:03.274966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-83c719e5-1852-456d-bd53-b4755124142b req-e86b1147-6d8d-4cd0-afdc-7382edeabced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1ba765-9d80-4daa-8415-904bd6bc380a", "tag": "811a1ae2-b430-4a10-a1c8-af0d5fe0df06"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:03.292009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.304252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-83c719e5-1852-456d-bd53-b4755124142b req-e86b1147-6d8d-4cd0-afdc-7382edeabced service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.305601 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4b7451d3-3e8f-4e29-ba5c-cc8dac9ea44c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1510 microversion: 2.1 time: 0.443947 Jul 19 20:02:03.305963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-83c719e5-1852-456d-bd53-b4755124142b req-e86b1147-6d8d-4cd0-afdc-7382edeabced service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.309277 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2100/4089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:02 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:03.320155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:03.320823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:03.333761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.334671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.335746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.336348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.338004 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-83c719e5-1852-456d-bd53-b4755124142b req-e86b1147-6d8d-4cd0-afdc-7382edeabced service nova] Creating event network-changed:811a1ae2-b430-4a10-a1c8-af0d5fe0df06 for instance 1f1ba765-9d80-4daa-8415-904bd6bc380a on n-h1-843834-3 Jul 19 20:02:03.350085 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-83c719e5-1852-456d-bd53-b4755124142b req-e86b1147-6d8d-4cd0-afdc-7382edeabced service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083354 Jul 19 20:02:03.351938 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1990/4090] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:03.412635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-473846703", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:03.570341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.632100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.643528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:03.651070 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-923c0cb9-cdb8-4818-b0c6-4528173e58ba tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.338545 Jul 19 20:02:03.674839 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2101/4091] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:03 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:03.754073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.security_group_api [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Neutron security group does_not_exist not found {{(pid=131230) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 19 20:02:03.754655 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 257 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-473846703", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-473846703', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 19 20:02:03.768553 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:03.781450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:03.797531 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-267e32c8-f2a5-4ec7-a661-1fddd057fc01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.371547 Jul 19 20:02:03.797531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1991/4092] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:03 2022] POST /compute/v2.1/servers => generated 106 bytes in 374 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:03.806706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:03.808639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:03.821199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.823428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:03.825508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:03.826677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.336419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.337942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.367289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.372580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.374470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.378499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.807450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:04.820375 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-87e676a9-c559-4c60-a1b1-7759177f963c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.034305 Jul 19 20:02:04.829275 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2102/4093] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:03 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:04.854393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:04.856076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:04.874697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.875424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:04.876913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:04.877707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.723175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.743310 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70f1727d-b14d-49c1-83e8-49e7c7d7c217 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1516 microversion: 2.1 time: 1.414321 Jul 19 20:02:05.744016 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1992/4094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1516 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:05.762862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:05.765287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:05.793909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.794400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.796631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:05.799009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:05.939739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.953945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.969384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:05.979522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-693483d6-dace-455f-9b80-dcf417bdd863 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 1.147958 Jul 19 20:02:05.980355 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2103/4095] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:04 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:06.471581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.486527 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47ec7cde-230e-45f2-81ba-7b55d9221cf0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.740621 Jul 19 20:02:06.489705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1993/4096] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:05 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:06.506450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.507135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 79b6e089-85b2-4b91-a37e-d7de7f6b73a0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:06.521770 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/79b6e089-85b2-4b91-a37e-d7de7f6b73a0 HTTP/1.1 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '79b6e089-85b2-4b91-a37e-d7de7f6b73a0'} Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:06.523414 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 79b6e089-85b2-4b91-a37e-d7de7f6b73a0 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:06.528009 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac80a5fc-f570-421e-b0b2-a26168f6c84c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79b6e089-85b2-4b91-a37e-d7de7f6b73a0" status: 404 len: 111 microversion: 2.1 time: 0.026940 Jul 19 20:02:06.528836 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2104/4097] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:02:06 2022] DELETE /compute/v2.1/servers/79b6e089-85b2-4b91-a37e-d7de7f6b73a0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:06.539954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.540752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:06.568096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.569015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.572757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.573822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.875412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:06.891772 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0804e0e-c435-4663-bcff-e2aa6e6eb4b6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.355496 Jul 19 20:02:06.897060 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1994/4098] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:06.918802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:06.919871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:06.945695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.949409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:06.952237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:06.953684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.003146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.004085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.015368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.016145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.017131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.017812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.329888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.351422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.357239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.359179 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2dbddbc3-1b97-4492-9ce9-5743eb59f571 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.361193 Jul 19 20:02:07.363055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1995/4099] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:02:07.589171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:07.625320 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e3e9e9f3-a3ee-4540-b0f3-7d6ff007c32e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.712775 Jul 19 20:02:07.626742 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2105/4100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:06 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:07.642820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.643590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:02:07.644401 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 9223372036854775808 could not be found. Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '9223372036854775808'} Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:07.646260 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:07.651358 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:07.651358 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:07.651358 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:07.651358 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 19 20:02:07.651358 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:07.652815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:07.658214 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ba25b2c-b103-4904-b24c-2460f661a8a2 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017053 Jul 19 20:02:07.659506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1996/4101] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Jul 19 20:02:07 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:07.672084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:07.673224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:07.702371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.713704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:07.715210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:07.715965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.391010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.393765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.411394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.413382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.415487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.416504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.477725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:08.568294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.585793 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-199ab946-123e-426e-902e-bd8658bafee7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.920056 Jul 19 20:02:08.590647 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2106/4102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:07 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:08.601706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.624545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.625425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.635908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.641024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.642353 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-564b9ddd-12c7-4590-803f-647d569ff22d tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.263225 Jul 19 20:02:08.644697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.646114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.647306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.653869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.659192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1997/4103] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:08.727507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d69f1746-5194-4722-9839-069a6124eb61 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: .version_select at 0x7f23ef5d4310>, body: {"keypair": {"name": "tempest-keypair-735897139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpYsV6StaSxR8RPvEjeMRNJoUfnnwdMLWhQ83WqsNkCqTVQv76cVbLOtWslNeOKmv8OePhD2dte7e7X9crVUqJgfUe8XlWrGcAMmfl4CZL3ZaQ3QPbElr89fKmsfUzayA=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:08.754248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d69f1746-5194-4722-9839-069a6124eb61 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:08.766702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d69f1746-5194-4722-9839-069a6124eb61 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for user 0810747a1c58432f9cf6c0731051a2c3 and project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:08.817691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d69f1746-5194-4722-9839-069a6124eb61 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093592 Jul 19 20:02:08.818619 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1998/4104] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:02:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:08.918903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:08.928190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d87dbf2b-48ec-4892-8c37-54746385e4da tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.324345 Jul 19 20:02:08.941452 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2107/4105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:08.947652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.948146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Failed to fetch instance by id -1 {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:02:08.948677 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance -1 could not be found. Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance -1 could not be found. Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '-1'} Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:08.950503 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:08.955230 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-145ce638-47b2-4386-a7c6-c608448cae3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008892 Jul 19 20:02:08.960612 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 1999/4106] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 20:02:08 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:08.969340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:08.970244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:08.976865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.977581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:08.978530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:08.979193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.497225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.520055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-349847e0-d5be-4f4d-91a5-2ee1d190bdad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.548473 Jul 19 20:02:09.521883 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2108/4107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:08 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:09.544834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:09.545677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:09.552353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.552808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.553828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.554437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.667972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:09.669598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:09.688764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.691243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.695278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:09.696119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:09.939714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.952965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.954714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:09.955983 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f2aa5f3-46ab-4c4a-b1a3-7fef9f3de743 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.295479 Jul 19 20:02:09.961588 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2109/4108] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:09 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:02:10.178313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:10.191092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf96e1f7-1978-4eba-ae3d-e4cd2ff11ef7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.655257 Jul 19 20:02:10.208258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:10.212503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2000/4109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:09 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:10.217369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 8c5575a4-4684-463d-99df-980bc93af325] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.228823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/8c5575a4-4684-463d-99df-980bc93af325/action HTTP/1.1 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 19 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: {"forceDelete": {}} Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8c5575a4-4684-463d-99df-980bc93af325', 'body': {'forceDelete': {}}} Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:10.241908 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:10.246455 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:10.246455 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:10.246455 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. Jul 19 20:02:10.246455 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:10.247907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 8c5575a4-4684-463d-99df-980bc93af325 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:10.249137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31dd9f41-6bf0-421d-bfb7-3e16c8b3dfc1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/8c5575a4-4684-463d-99df-980bc93af325/action" status: 404 len: 111 microversion: 2.1 time: 0.045009 Jul 19 20:02:10.250388 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2110/4110] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:10 2022] POST /compute/v2.1/servers/8c5575a4-4684-463d-99df-980bc93af325/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:02:10.258662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.259905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.271039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.271503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.272310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.272759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.915071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:10.929069 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b924835b-83e6-401a-90ad-77d041e51f6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.673870 Jul 19 20:02:10.930829 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2001/4111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:10.951660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.953192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:10.970942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.976214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.981839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:10.982572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:10.991494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:10.992275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.001334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.005109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.006796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.007431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.223142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.234857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.252591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.258239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac12069e-af66-49fd-a93a-aa52d1b0412f tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.270892 Jul 19 20:02:11.260139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2002/4112] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:02:11.376578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.389029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e4daf808-4338-4184-b87c-21b88a2d7bcf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.442986 Jul 19 20:02:11.397051 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2111/4113] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:10 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:11.414761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:11.415879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 6491bcd6-3841-443a-babd-788e31e8bc4b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.425929 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/6491bcd6-3841-443a-babd-788e31e8bc4b/action HTTP/1.1 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 39 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: {"os-getConsoleOutput": {"length": 10}} Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '6491bcd6-3841-443a-babd-788e31e8bc4b', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:11.447846 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:11.452851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 6491bcd6-3841-443a-babd-788e31e8bc4b could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:11.454809 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6dd49280-3f91-4531-9c40-126b378777d7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/6491bcd6-3841-443a-babd-788e31e8bc4b/action" status: 404 len: 111 microversion: 2.1 time: 0.043582 Jul 19 20:02:11.465471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:11.466551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.473014 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2003/4114] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:11 2022] POST /compute/v2.1/servers/6491bcd6-3841-443a-babd-788e31e8bc4b/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:11.477673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.478462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.490375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.493103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.814996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:11.827767 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ae92fbc-d494-4a8a-a817-9610a5351ff0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.367445 Jul 19 20:02:11.834814 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2112/4115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:11 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:11.852234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:11.853598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:11.864905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.870414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:11.872945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:11.874197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.285199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.289066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.313807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.314684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.316188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.316872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.469034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.480512 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91e63c02-6938-4370-883c-af986ab76a99 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.632097 Jul 19 20:02:12.483642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2004/4116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:11 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:12.503639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.504601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.511018 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 HTTP/1.1 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '4931c5fe-c1b7-4ab1-a2d6-6b5005888da8'} Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:12.513079 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:12.517988 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:12.517988 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:12.517988 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:12.517988 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. Jul 19 20:02:12.517988 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:12.519517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:12.520751 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43ac1ac8-6bf6-4340-b441-8cfaf386b173 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/4931c5fe-c1b7-4ab1-a2d6-6b5005888da8" status: 404 len: 111 microversion: 2.1 time: 0.021165 Jul 19 20:02:12.524883 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2005/4117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/4931c5fe-c1b7-4ab1-a2d6-6b5005888da8 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:12.530158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:12.534424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:12.548086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.549789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.553600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.554551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:12.555133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:12.568404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.573166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:12.576318 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89a80edf-b7bd-499e-bb07-44d0b9a8dd51 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.298160 Jul 19 20:02:12.585965 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2113/4118] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:13.413027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.426314 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfbd0f0b-2757-449a-90dc-41d854bec931 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.899327 Jul 19 20:02:13.427548 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2006/4119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:12 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:13.444093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:13.445586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:13.454398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.455100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.456099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.456720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.603893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:13.604772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:13.616712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.617337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.618147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:13.618592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:13.819625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.841162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.844501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.847145 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6930677d-39c6-4b3b-bfcf-0fc2441f45a5 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1366 microversion: 2.57 time: 0.246754 Jul 19 20:02:13.848251 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2007/4120] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:13 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:02:13.990011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:13.993595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:14.013959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16b96307-db82-4a2f-a61e-267b73d12088 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.573772 Jul 19 20:02:14.015002 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2114/4121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:13 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:14.272776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb8666a3-5cc8-4b77-931b-652752354f65 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146698590", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb8666a3-5cc8-4b77-931b-652752354f65 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 238 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146698590", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1146698590', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:02:14.277893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 20:02:14.282346 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:14.284573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb8666a3-5cc8-4b77-931b-652752354f65 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:14.288228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb8666a3-5cc8-4b77-931b-652752354f65 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023039 Jul 19 20:02:14.294715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2008/4122] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:14.298061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.298688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.305707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.306219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.307010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.307459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.545108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:14.560553 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f9492d7-01d7-4eb6-9835-045578127f5e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.261601 Jul 19 20:02:14.564677 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2115/4123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:14.592359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.593770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.627362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.630698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.634207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.637645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.869022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:14.870192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:14.896726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.897457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:14.898551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:14.906962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:15.097919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:15.116177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:15.123730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:15.126323 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-615335e0-9204-4baf-94a1-a7a22504a1df tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1372 microversion: 2.57 time: 0.263124 Jul 19 20:02:15.128068 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2116/4124] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:02:15.192471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:15.206867 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd68e90c-2de9-494b-bc11-6825e2e58355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.621191 Jul 19 20:02:15.207848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2009/4125] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:14 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:15.429789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bef599b4-0cc5-4ba5-82fd-5b86c7a3dfe1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-75990189", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bef599b4-0cc5-4ba5-82fd-5b86c7a3dfe1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 233 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-75990189", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-75990189', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:15.443251 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 20:02:15.448381 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:15.456528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bef599b4-0cc5-4ba5-82fd-5b86c7a3dfe1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:15.461554 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bef599b4-0cc5-4ba5-82fd-5b86c7a3dfe1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.042182 Jul 19 20:02:15.467188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2117/4126] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:15 2022] POST /compute/v2.1/servers => generated 133 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:02:15.474804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:15.474804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:15.485453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:15.486078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:15.488454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:15.489281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:15.642201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1837897415", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fe2528f-13ca-4fb6-a5bc-8f5b968aaf59"}], "security_groups": [{"name": "tempest-securitygroup--1623484664"}], "key_name": "tempest-keypair-735897139", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:15.959864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] validate_networks() for [('0fe2528f-13ca-4fb6-a5bc-8f5b968aaf59', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:15.993780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:16.011871 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e916f9ca-fb44-4743-a227-b7e0faa10dbd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.542181 Jul 19 20:02:16.012825 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2010/4127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:15 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:16.035826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:16.037099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:16.048060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.048854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.050018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.050668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.488367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:16.500566 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5adc4505-065a-483d-91d3-d982484dcd8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.469564 Jul 19 20:02:16.536549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2011/4128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:16 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:16.562564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:16.563234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:16.573393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.574177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.576922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.578350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.776802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:16.790184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:16.791749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:16.792967 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4f5e3ab5-4506-4fd1-9232-ac88b6f9d609 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1372 microversion: 2.57 time: 0.250815 Jul 19 20:02:16.803385 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2012/4129] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:16 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:16.814987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:16.815860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: e237ed99-1adb-45a4-a9b7-b68dd90d047b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:16.825098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/e237ed99-1adb-45a4-a9b7-b68dd90d047b/action HTTP/1.1 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 13 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: {"pause": {}} Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'e237ed99-1adb-45a4-a9b7-b68dd90d047b', 'body': {'pause': {}}} Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:16.833763 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:16.839383 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:16.839383 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:16.839383 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. Jul 19 20:02:16.839383 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:16.840754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance e237ed99-1adb-45a4-a9b7-b68dd90d047b could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:16.842185 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d27851e-2a5d-4e14-b395-4b448364a973 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/e237ed99-1adb-45a4-a9b7-b68dd90d047b/action" status: 404 len: 111 microversion: 2.1 time: 0.037449 Jul 19 20:02:16.842987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2013/4130] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:16 2022] POST /compute/v2.1/servers/e237ed99-1adb-45a4-a9b7-b68dd90d047b/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:16.855396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:16.856442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:16.865847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.866737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:16.867858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:16.869175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.836308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:17.836936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:17.837572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:17.838151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:17.838840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:17.875861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.876998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.898931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:17.900816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:17.980579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:18.003995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Getting quotas for user 0810747a1c58432f9cf6c0731051a2c3 and project d3f9b3fcdb224a3488545c596d4e9746. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:18.046060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:18.055781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:18.159656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.173231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1a137b1f-4944-4cf9-94af-919265d4d838 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.317810 Jul 19 20:02:18.180286 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2014/4131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:16 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:18.193327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.194564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.211488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.212256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.213244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.213832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.239639 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ea490393-b68b-4c15-b481-5623641c821d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.599488 Jul 19 20:02:18.244853 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2118/4132] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:02:18.269764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.271586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.291052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.294898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.299114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.300348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.504504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.521731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.525653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.527006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12e1c219-a1ba-4fd3-9a2e-6de271cea2ac tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1357 microversion: 2.57 time: 0.339338 Jul 19 20:02:18.527594 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2015/4133] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:18 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1357 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:18.544697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0701d8ad-3ad4-4918-bc06-858a1cf21ce1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.545814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0701d8ad-3ad4-4918-bc06-858a1cf21ce1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.740195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0701d8ad-3ad4-4918-bc06-858a1cf21ce1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.758776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0701d8ad-3ad4-4918-bc06-858a1cf21ce1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1245 microversion: 2.1 time: 0.228592 Jul 19 20:02:18.771384 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2016/4134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:18 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1245 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:18.778316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:18.781152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.793471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.795190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.797072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.798325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.883962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:18.898438 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cfd448c0-b8b9-43fb-b549-385d9c13df2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.649072 Jul 19 20:02:18.899276 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2119/4135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:18 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:18.919959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:18.924936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:18.932935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:02:18.958197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.959802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:18.962208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:18.963631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.181689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90445128-44bf-4880-9230-b59111d7e7ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.266392 Jul 19 20:02:19.183476 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2120/4136] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:18 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:02:19.204779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.206847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.216162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.217502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.218484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.219127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.308798 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a21d5003-fdf3-42c3-957d-2f92106b1246 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "DELETE /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 204 len: 0 microversion: 2.57 time: 0.535680 Jul 19 20:02:19.314161 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2017/4137] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 20:02:18 2022] DELETE /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:02:19.337533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.338319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.371426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.371801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.372591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.373115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.715038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.736174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.739001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:19.740274 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8db714dc-cf45-4206-b820-44b875d540da tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1363 microversion: 2.57 time: 0.421135 Jul 19 20:02:19.743316 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2018/4138] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:19 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:19.779993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:19.783088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:19.793893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.795737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.797356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:19.799686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:19.857269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:20.039816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:20.053996 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-054cd48a-ec14-4a2a-88c7-78cf741f31d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1297 microversion: 2.1 time: 0.278081 Jul 19 20:02:20.054677 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2019/4139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:19 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1297 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:20.100932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:20.109397 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7a647c5b-d09a-477e-98d3-3700b106da4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1509 microversion: 2.1 time: 0.921615 Jul 19 20:02:20.110004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2121/4140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:19 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1509 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:20.761799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:20.762655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:20.769930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:20.770394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:20.782149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:20.790610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:20.950098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:20.977234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:20.982852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:20.989623 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3dca93ab-e787-454a-ad8c-c2fdf5212498 tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1363 microversion: 2.57 time: 0.231795 Jul 19 20:02:20.996184 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2020/4141] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:20 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:21.076636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:21.077261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.085038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:21.092664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.093129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.094168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.095237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.127433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:21.128178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.145200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.145699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.146525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.147036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.277861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:21.287237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa2eaf41-d528-4223-99eb-438532bd3405 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1303 microversion: 2.1 time: 0.217710 Jul 19 20:02:21.287861 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2122/4142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:21 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1303 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:21.502810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:21.515108 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b48e480-f852-4e8a-ba54-222ee9b5c4f4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1489 microversion: 2.1 time: 0.391739 Jul 19 20:02:21.516118 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2021/4143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:21 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1489 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:21.535962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:21.537167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.546511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.547433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.549322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.551098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.586420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'pause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state paused Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 13 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: {"pause": {}} Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'pause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state paused Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'pause': {}}} Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state paused. Cannot pause while the instance is in this state. Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state paused Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:21.588910 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:21.593209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:21.593209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:21.593209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:21.593209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state paused Jul 19 20:02:21.593209 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:21.597701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'pause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state paused {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:21.600041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0416a45d-ae20-4c3f-9886-225cdd97518f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 143 microversion: 2.1 time: 0.069201 Jul 19 20:02:21.611326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:21.612393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.618648 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2123/4144] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:21 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 143 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:21.619802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:21.622960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.623668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.624964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.627249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.787547 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88779392-35ae-4c86-a013-f926631d0d89 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.180420 Jul 19 20:02:21.788282 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2022/4145] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:21 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:21.803819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:21.804558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:21.814035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.816339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:21.818684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:21.819502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.083584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c43306a5-0d46-415c-bbe0-748fbd68a391 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: .version_select at 0x7f23ef77aaf0>, body: {"keypair": {"name": "tempest-keypair-1098881101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrdUBRWkQk2YKT2cFyJUZCrCsWJTvwHgBZ2HVD3CJ92FyijK7hm+D3lMwI4Zl9SMJ9+nIKQVW3XZTzSUrDpCEhQra+ytXD7ibuN+G8DvFPaTkwc+Jii4m9n560eZ8pQTA=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:22.142342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c43306a5-0d46-415c-bbe0-748fbd68a391 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:22.177155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c43306a5-0d46-415c-bbe0-748fbd68a391 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:22.238644 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c43306a5-0d46-415c-bbe0-748fbd68a391 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348388 Jul 19 20:02:22.240386 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2023/4146] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:02:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:22.276286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:22.278117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:22.290867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.291750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.292790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.294189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.340343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.341739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.342366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lazy-loading 'fault' on Instance uuid 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:22.512473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.523345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-83383d2c-b108-4543-85ad-e1c10b90c65b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1496 microversion: 2.1 time: 0.730721 Jul 19 20:02:22.527473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2124/4147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:21 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1496 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:22.538555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:22.543881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:22.561291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.561930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.562959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:22.563947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:22.703760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.720192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.721615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4acfb9e176f4400891ee6a8dd9cffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f036ed6c6bbb4d178de876a3d12f9c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.723038 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a32fb2b6-c148-4012-8961-ed3d75b1406b tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 200 len: 1368 microversion: 2.57 time: 0.464770 Jul 19 20:02:22.724118 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2024/4148] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:22 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:02:22.766990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:22.783846 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e7e0bdc-0541-4d40-86e7-bf2da0ae9be1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1303 microversion: 2.1 time: 0.249182 Jul 19 20:02:22.784695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2125/4149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:22 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:23.544973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:23.545832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:23.565116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.572008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.573230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.573678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.742572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:23.743842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] [instance: 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:23.759618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.760345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.761336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.762311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.795633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] HTTP exception thrown: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Request method failure captured: Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 HTTP/1.1 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w2a-MNyQt15hDSFVhM8d1UTlbKwq1Ixl4KL0U4anv5dOx5O4aGdDx3zBxXDkxDoJEQqVyuySU56jj1kXN2p-mZ3zjkp2_g5yNLSKnYzgYyEClBJ-eLN63n5jQjIKDDbXGctLQol7ToD06hdeIocURcdDwkIfgwX0CaFvI937ZxZXM0 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.57 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: f036ed6c6bbb4d178de876a3d12f9c9b Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerShowV257Test-1131702324 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f036ed6c6bbb4d178de876a3d12f9c9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f036ed6c6bbb4d178de876a3d12f9c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f036ed6c6bbb4d178de876a3d12f9c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f036ed6c6bbb4d178de876a3d12f9c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerShowV257Test-1131702324 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: f036ed6c6bbb4d178de876a3d12f9c9b Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerShowV257Test-1131702324 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerShowV257Test-1131702324-project Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: c4acfb9e176f4400891ee6a8dd9cffd5 Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerShowV257Test-1131702324-project Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1'} Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:23.801778 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. Jul 19 20:02:23.806495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:23.808014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] Returning 404 to user: Instance 706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:23.812060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5c5837c-beb7-4bba-8739-0c22e3c7de9e tempest-ServerShowV257Test-1131702324 tempest-ServerShowV257Test-1131702324-project] 10.222.0.23 "GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1" status: 404 len: 111 microversion: 2.57 time: 0.074000 Jul 19 20:02:23.816177 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2126/4150] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:02:23 2022] GET /compute/v2.1/servers/706cf299-7e5f-4a3a-a6ab-1ddf9fa509e1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:02:23.844173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:23.849619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:23.878612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.879721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:23.888715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:23.889514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.483285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:24.493255 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-69eaac22-7351-47a2-bad4-4641a421a854 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.952541 Jul 19 20:02:24.503458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2025/4151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:23 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:24.519986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:24.522220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:24.534825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.541383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:24.542940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:24.543707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.021342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:25.031866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a98e1797-baf5-40df-adb7-4873370d8102 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.515757 Jul 19 20:02:25.032795 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2026/4152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:24 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:25.060933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:25.080239 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bacf04a3-07e4-4d8f-8e20-b7fb70e22c1d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 1.261950 Jul 19 20:02:25.082195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:25.084521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.086498 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2127/4153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:23 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:25.107809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.108866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.114054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.143307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.201452 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action HTTP/1.1 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 28 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: {"reboot": {"type": "SOFT"}} Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '06cf0f38-cb2a-426c-bc07-0c952087121f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:25.209162 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:25.213803 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:25.215905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:25.217075 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85de0df6-340a-4de1-8e7e-bd85826cab8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action" status: 404 len: 111 microversion: 2.1 time: 0.171799 Jul 19 20:02:25.218224 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2027/4154] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:25 2022] POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:25.227535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.229411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.241094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.245130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.248675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.249199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.806071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:25.825596 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33e9204d-1d98-4d87-a857-c722c87c9100 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.602116 Jul 19 20:02:25.828413 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2128/4155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:25.851168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:25.852217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:25.876514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.876966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:25.877731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:25.878166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.104610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.105278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.124655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.125122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.125939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.126385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.296577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:26.307978 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d85e7551-9e29-44ee-a3c1-9eaead9b9006 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.462996 Jul 19 20:02:26.312042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2028/4156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:25 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:26.336854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:26.338378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 94f3c2f1-b22c-4526-a560-6d800fd55427] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.363301 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/94f3c2f1-b22c-4526-a560-6d800fd55427/action HTTP/1.1 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 28 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: {"reboot": {"type": "SOFT"}} Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '94f3c2f1-b22c-4526-a560-6d800fd55427', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. Jul 19 20:02:26.365581 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. Jul 19 20:02:26.369487 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:26.375793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 94f3c2f1-b22c-4526-a560-6d800fd55427 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:26.377001 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35c0e14d-54f2-470d-93f8-2abd7f94d59b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/94f3c2f1-b22c-4526-a560-6d800fd55427/action" status: 404 len: 111 microversion: 2.1 time: 0.046130 Jul 19 20:02:26.385147 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2029/4157] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:26 2022] POST /compute/v2.1/servers/94f3c2f1-b22c-4526-a560-6d800fd55427/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:02:26.394190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.395105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.413816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.418010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.425220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.425691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.807328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:26.816014 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-326cde64-4822-4903-ae3e-078207fc3e06 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 0.715658 Jul 19 20:02:26.816815 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2129/4158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:26.912537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:26.930314 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.543751 Jul 19 20:02:26.943756 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2030/4159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:26.948015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:26.951304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:26.958636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.959362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:26.960339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:26.960938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.335196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.336223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004737 Jul 19 20:02:27.344499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2031/4160] 10.222.0.23 () {56 vars in 885 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 20:02:27.346187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.351160 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001688 Jul 19 20:02:27.359545 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2032/4161] 10.222.0.23 () {54 vars in 1034 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 19 20:02:27.362513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.365739 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003364 Jul 19 20:02:27.366237 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2033/4162] 10.222.0.23 () {54 vars in 1040 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/ => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:27.376359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.381194 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a85ba6c-35aa-4f68-b4e6-757ca4dfc63d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003129 Jul 19 20:02:27.381887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2034/4163] 10.222.0.23 () {56 vars in 885 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 20:02:27.754675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:27.775660 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-847094b2-531d-431f-b70a-23f8bbe3f4c7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.827012 Jul 19 20:02:27.778469 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2130/4164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:26 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:27.795146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:27.797077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.813871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.816185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.820519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.820986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.833686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.834373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.851868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.853690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.858511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.859425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.908203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action HTTP/1.1 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 65 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '06cf0f38-cb2a-426c-bc07-0c952087121f', 'body': {'rebuild': {'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29'}}} Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:02:27.921153 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:27.927841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:27.929599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-795eed09-946d-4b78-8862-9d761b33ba3c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action" status: 404 len: 111 microversion: 2.1 time: 0.138981 Jul 19 20:02:27.936482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2035/4165] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:27 2022] POST /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f/action => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:27.955327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:27.956682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:27.960795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:27.977856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.983445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:27.984362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:27.984847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.022942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:28.332717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:28.341454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d12f9fa9-afd1-4a9a-97f4-338e91d1e706 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.403752 Jul 19 20:02:28.351632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2036/4166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:28.354804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:28.356750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-aab898b1-a8ef-4e80-a320-969105e70b45 req-6d7b7ada-5185-4842-a567-4c9c31531641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:28.372845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-aab898b1-a8ef-4e80-a320-969105e70b45 req-6d7b7ada-5185-4842-a567-4c9c31531641 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.373169 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31e23725-36ab-4cdd-9500-217772b9b026 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 0.543541 Jul 19 20:02:28.373784 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2131/4167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:27 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:28.375780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-aab898b1-a8ef-4e80-a320-969105e70b45 req-6d7b7ada-5185-4842-a567-4c9c31531641 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.390454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.392696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.405122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-aab898b1-a8ef-4e80-a320-969105e70b45 req-6d7b7ada-5185-4842-a567-4c9c31531641 service nova] Creating event network-changed:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:02:28.408834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.410554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.416615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.417496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.431513 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-aab898b1-a8ef-4e80-a320-969105e70b45 req-6d7b7ada-5185-4842-a567-4c9c31531641 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070117 Jul 19 20:02:28.432406 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2037/4168] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:28.688904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:28.699978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91450c7c-4917-4ba0-9a34-5a278a40de72 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.321490 Jul 19 20:02:28.700643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2132/4169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:28.717944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:28.719939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: d4f50513-af30-481f-9444-be4adc78a6af] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.725964 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/d4f50513-af30-481f-9444-be4adc78a6af/action HTTP/1.1 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 65 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd4f50513-af30-481f-9444-be4adc78a6af', 'body': {'rebuild': {'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29'}}} Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 20:02:28.727977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. Jul 19 20:02:28.732627 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:28.740502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance d4f50513-af30-481f-9444-be4adc78a6af could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:28.741591 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b88b3623-a511-4ceb-bc33-3b36d01e3e88 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/d4f50513-af30-481f-9444-be4adc78a6af/action" status: 404 len: 111 microversion: 2.1 time: 0.028989 Jul 19 20:02:28.742701 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2038/4170] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:28 2022] POST /compute/v2.1/servers/d4f50513-af30-481f-9444-be4adc78a6af/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:28.751667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.752718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:28.762016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.763556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.764767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:28.765578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:28.786798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:28.991074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:28.991575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.009469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.009986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.011179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.011477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.076730 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5d4ba4d-18f2-4fe6-9218-72db1d26fb75 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/ips" status: 200 len: 146 microversion: 2.1 time: 0.092160 Jul 19 20:02:29.084505 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2039/4171] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/ips => generated 146 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:29.118073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.157252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3d25465-473f-49a5-ab79-19fdf786db1d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.409725 Jul 19 20:02:29.160092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2133/4172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:28 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:29.180345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:29.181263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.194387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.194855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.196270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.198737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.391771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:29.392441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.407746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.408506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.411271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.411885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.869414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.873521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:29.884755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3cfe9219-de08-499c-95ec-e4cf614bb749 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.711006 Jul 19 20:02:29.887225 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e7ec36e-a736-4e72-aded-d892dbc5a92d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 0.500206 Jul 19 20:02:29.889016 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2040/4173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:29 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:29.902999 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2134/4174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:29 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:29.925876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:29.929666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: eaae6778-946c-419a-811d-52884a95a4d0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.947903 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/eaae6778-946c-419a-811d-52884a95a4d0/action HTTP/1.1 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 15 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: {"restore": {}} Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'eaae6778-946c-419a-811d-52884a95a4d0', 'body': {'restore': {}}} Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:29.958768 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:29.965109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:29.965109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:29.965109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. Jul 19 20:02:29.965109 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:29.966671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance eaae6778-946c-419a-811d-52884a95a4d0 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:29.967768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd846cc9-dc5b-4e4b-a2ab-53da651f927f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/eaae6778-946c-419a-811d-52884a95a4d0/action" status: 404 len: 111 microversion: 2.1 time: 0.065021 Jul 19 20:02:29.975457 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2041/4175] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:29 2022] POST /compute/v2.1/servers/eaae6778-946c-419a-811d-52884a95a4d0/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:29.980398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:29.981728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:29.994575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.996188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:29.997166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:29.997660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:30.884061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-726359679", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e5d8cfc-4319-48ca-95d7-3aa27f475ae1"}], "security_groups": [{"name": "tempest-securitygroup--469305989"}], "key_name": "tempest-keypair-1098881101", "user_data": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:31.004012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.016654 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b2f3a6d-cc1a-4aee-83a0-9be9bcdb7d1b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.041324 Jul 19 20:02:31.028547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2135/4176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:29 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:31.037877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:31.038502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:31.059086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.059553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.060401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.073450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.261403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] validate_networks() for [('1e5d8cfc-4319-48ca-95d7-3aa27f475ae1', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:02:31.639888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:31.652012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-672f8f29-8281-456d-8eb2-402b00f64ed7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 0.627766 Jul 19 20:02:31.666833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2136/4177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:31 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:31.682445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:31.683122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:31.702420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.702897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:31.703725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:31.704167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.204000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:32.418896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:02:32.419353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:02:32.419910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:02:32.420321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:02:32.420735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:02:32.438833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.439314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.440127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.440564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.482022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:02:32.504445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:02:32.521711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:02:32.525058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:02:32.610459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e967fdd7-d188-48f2-a2d1-fb140ae1d3ad tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.732600 Jul 19 20:02:32.612030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2042/4178] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:02:32.624213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2c57b95-3294-4a69-8c3a-2d6780a28d52"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:32.627507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:32.647773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.650148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:32.651614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:32.652454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.174119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:33.191774 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12c5a328-3bbf-4012-a80c-ee12a3000501 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.515258 Jul 19 20:02:33.194948 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2137/4179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:31 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:33.204360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7354789e-872e-442c-9adb-51436f0485cb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.208951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7354789e-872e-442c-9adb-51436f0485cb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.291514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aeadbc36-7749-4a0d-bd56-06863326e3e4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677900 Jul 19 20:02:33.298534 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2043/4180] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:32 2022] POST /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:33.313677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.319094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.342872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.343777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.345112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.345896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.355034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:33.509699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7354789e-872e-442c-9adb-51436f0485cb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:33.517958 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7354789e-872e-442c-9adb-51436f0485cb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1238 microversion: 2.1 time: 0.321629 Jul 19 20:02:33.539048 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2138/4181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1238 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:33.561419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:33.562328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.598613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.601921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.603306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.615491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.720630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'restore' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: {"restore": {}} Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'restore' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'restore': {}}} Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state active. Cannot restore while the instance is in this state. Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:33.732865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:33.737648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:33.737648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:33.737648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:33.737648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:33.737648 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:33.739958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'restore' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:33.741975 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdefcc8a-bdde-4436-aabf-41d45f02cc4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 145 microversion: 2.1 time: 0.201473 Jul 19 20:02:33.747229 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2139/4182] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:33 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 145 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:33.755491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:33.756492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:33.777973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.778882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:33.779976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:33.780827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:34.440308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:34.455787 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-813c27b0-a800-4e74-9e71-6a254a732eed tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 1.150362 Jul 19 20:02:34.457452 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2044/4183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:34.541476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:34.547595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:34.571328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:34.589343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-386c0773-2d4d-4f91-8e88-9a44ad655650 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.837550 Jul 19 20:02:34.595130 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2140/4184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:33 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:34.610427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:34.611629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:34.620873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:34.623343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:34.646052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:34.652602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:34.697539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:34.698234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:34.703004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:34.703727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.130134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:35.143196 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc1f1448-04b3-4804-9563-4189acb28164 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1298 microversion: 2.1 time: 0.608863 Jul 19 20:02:35.143807 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2045/4185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:34 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1298 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:35.377417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:35.390852 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-806b1f4e-c890-446c-9aba-00c13f7b99be tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.774834 Jul 19 20:02:35.392873 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2141/4186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:34 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:35.408946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:35.409776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: d2792353-f77c-41ca-a825-7056fb194ed2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:35.417293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/d2792353-f77c-41ca-a825-7056fb194ed2/action HTTP/1.1 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 14 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: {"resume": {}} Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'd2792353-f77c-41ca-a825-7056fb194ed2', 'body': {'resume': {}}} Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:35.426160 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance d2792353-f77c-41ca-a825-7056fb194ed2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:35.431070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cae872c-4019-4325-8977-beff92d7d19b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/d2792353-f77c-41ca-a825-7056fb194ed2/action" status: 404 len: 111 microversion: 2.1 time: 0.022973 Jul 19 20:02:35.434350 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2046/4187] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:35 2022] POST /compute/v2.1/servers/d2792353-f77c-41ca-a825-7056fb194ed2/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:35.438318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:35.439206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:35.457131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.457599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.458404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.458939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.474762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:35.476131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:35.488713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.503667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:35.504760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:35.506222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.275152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:36.287990 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33d22fa0-64a6-40df-ad93-36792972a472 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.851476 Jul 19 20:02:36.289068 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2142/4188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:35 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:36.308263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:36.308263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:36.331679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.333768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.334761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.336642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.606705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:36.616620 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5c07b00-fc0d-4ed5-988a-2801b34b8765 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1296 microversion: 2.1 time: 0.324351 Jul 19 20:02:36.620934 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2143/4189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:36 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1296 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:36.641960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:36.645039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:36.666748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.672291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.675190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.675190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.698692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:36.718982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-141364a0-e0af-47b9-9443-e608fbf760d4 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 1.244446 Jul 19 20:02:36.722139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2047/4190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:35 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:36.892784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f15d8a1c-bf72-44a5-9e52-d10d8ce47d91 req-93e36888-c202-4b9e-be56-11915dc68df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "name": "network-vif-plugged", "status": "completed", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:36.925024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f15d8a1c-bf72-44a5-9e52-d10d8ce47d91 req-93e36888-c202-4b9e-be56-11915dc68df5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:36.927517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f15d8a1c-bf72-44a5-9e52-d10d8ce47d91 req-93e36888-c202-4b9e-be56-11915dc68df5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:36.974302 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f15d8a1c-bf72-44a5-9e52-d10d8ce47d91 req-93e36888-c202-4b9e-be56-11915dc68df5 service nova] Creating event network-vif-plugged:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:02:36.990316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f15d8a1c-bf72-44a5-9e52-d10d8ce47d91 req-93e36888-c202-4b9e-be56-11915dc68df5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102980 Jul 19 20:02:36.991192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2048/4191] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:37.379245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:37.394803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-604a7ce7-6d73-4680-a2fb-49b348da9c6b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.770056 Jul 19 20:02:37.395995 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2144/4192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:36 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:37.428552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:37.431712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.452661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.453126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.453942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.454381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.510273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'resume' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 14 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: {"resume": {}} Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'resume' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'resume': {}}} Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state active. Cannot resume while the instance is in this state. Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:37.511958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'resume' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:37.516507 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-adac77e4-4496-4579-bdae-98c1406a5355 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 144 microversion: 2.1 time: 0.097036 Jul 19 20:02:37.527518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.528156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.533478 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2049/4193] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:37 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 144 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:02:37.535568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.536033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.536868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.537315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.648397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:37.649342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:37.657231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.657946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.659363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:37.659966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:37.973575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:37.990755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41a0d65a-8a1c-4fed-b5ea-f48449feb9e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1296 microversion: 2.1 time: 0.347414 Jul 19 20:02:37.996030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2050/4194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1296 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:38.010641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:38.011845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:38.021089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:38.021984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:38.023275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:38.024019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:38.263608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:38.275360 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ac95b04-de58-485e-96b2-ae3b0b8dbfd7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.755744 Jul 19 20:02:38.290129 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2145/4195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:38.299778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:38.300790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:38.313838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:38.314987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:38.316076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:38.316732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:38.385845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:38.394086 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43a975ef-bf6e-4bcb-bf31-550c4ef8f549 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1371 microversion: 2.1 time: 0.396572 Jul 19 20:02:38.394689 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2051/4196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:37 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:38.922537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:38.932628 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e1face5e-7e9a-49b4-8334-be18f4e34b52 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.640423 Jul 19 20:02:38.937515 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2146/4197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:38 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:39.013905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:39.014579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:39.040023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.040489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.049062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.049552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.214750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0e6bed9-9121-4a4a-b177-146daccd79b4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0e6bed9-9121-4a4a-b177-146daccd79b4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 160 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c6df2121-a511-4ff4-b44f-c10d518370e5"}]}} Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'body': {'server': {'name': '', 'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29', 'flavorRef': '452', 'networks': [{'uuid': 'c6df2121-a511-4ff4-b44f-c10d518370e5'}]}}} Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi '' Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:02:39.217992 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:02:39.221967 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:02:39.224846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0e6bed9-9121-4a4a-b177-146daccd79b4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:39.234831 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0e6bed9-9121-4a4a-b177-146daccd79b4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.028095 Jul 19 20:02:39.235740 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2147/4198] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:02:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:02:39.247063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:39.248152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:39.264840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.266065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:39.267162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:39.269982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.053770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:40.075142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-564cb973-4283-4e00-acd4-2ea548e78c6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 1.066694 Jul 19 20:02:40.076641 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2052/4199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:39 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:40.090502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:40.091246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:40.110248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.110960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.111887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.112350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.530069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:40.542296 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-268a6ea3-fdd1-421a-b0e5-2cd597ad2ca6 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.300244 Jul 19 20:02:40.543426 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2148/4200] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:39 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:40.563244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:40.564029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:40.572015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.576384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:40.579532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:40.583495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.470739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:41.489921 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80df1246-c664-44a4-b0e1-9e82828e0b11 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1565 microversion: 2.1 time: 1.411838 Jul 19 20:02:41.499614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2053/4201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:40 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1565 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:41.513402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:41.515818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:41.533493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.535493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.539738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:41.540449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:41.969568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:41.982772 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0a85789-2805-4f7f-9079-84eaf60839e5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.423568 Jul 19 20:02:41.983474 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2149/4202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:40 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:42.012707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:42.014699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:42.033258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.036695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.041021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.042331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.151240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:42.165921 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c341ea17-9f6e-4855-b448-f17e6f7a39cf tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.664937 Jul 19 20:02:42.180287 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2054/4203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:41 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:42.197622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:42.201796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 34efe231-6131-4c59-86a8-6bf832bb9212] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:42.221970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/34efe231-6131-4c59-86a8-6bf832bb9212/action HTTP/1.1 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 14 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: {"shelve": {}} Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '34efe231-6131-4c59-86a8-6bf832bb9212', 'body': {'shelve': {}}} Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:02:42.227747 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 34efe231-6131-4c59-86a8-6bf832bb9212 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:02:42.235520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-902ef1ea-3f10-4351-a785-30aa4c838101 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/34efe231-6131-4c59-86a8-6bf832bb9212/action" status: 404 len: 111 microversion: 2.1 time: 0.049283 Jul 19 20:02:42.238191 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2055/4204] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:42 2022] POST /compute/v2.1/servers/34efe231-6131-4c59-86a8-6bf832bb9212/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:02:42.249752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:42.254696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:42.257629 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c130d999-caa4-404f-b14d-7441cd81bf10 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249243 Jul 19 20:02:42.264801 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2150/4205] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:02:41 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:42.272496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.272987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.278020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.278946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.460592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:42.511488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:42.765129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a3fb16f9-6bd3-44f0-96d2-69e92b2359b7 req-fd040501-438b-469f-993b-9450a4e39cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:42.775123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a3fb16f9-6bd3-44f0-96d2-69e92b2359b7 req-fd040501-438b-469f-993b-9450a4e39cd4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:42.782360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a3fb16f9-6bd3-44f0-96d2-69e92b2359b7 req-fd040501-438b-469f-993b-9450a4e39cd4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:42.811801 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a3fb16f9-6bd3-44f0-96d2-69e92b2359b7 req-fd040501-438b-469f-993b-9450a4e39cd4 service nova] Creating event network-changed:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:02:42.827851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a3fb16f9-6bd3-44f0-96d2-69e92b2359b7 req-fd040501-438b-469f-993b-9450a4e39cd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080508 Jul 19 20:02:42.828763 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2151/4206] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 19 20:02:43.189838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.191322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.191949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:43.202480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3a694cc-eede-4b12-b5c9-ab6ddcb20a5a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.961694 Jul 19 20:02:43.203918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.208228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.211600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.215693 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2056/4207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:42 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:43.221250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:43.222125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:43.225310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.231896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.232693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.235110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:43.236542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:43.519874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:44.669876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:44.680272 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-673850bc-be9a-43c0-9dc8-8dcce4edfd01 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.462997 Jul 19 20:02:44.699584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2057/4208] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:44.718566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:44.725949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:44.730364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:44.734975 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d589286-e6f7-4878-a3fe-47bbdb65028b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 1.549965 Jul 19 20:02:44.742705 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2152/4209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:43 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:44.751273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:44.769190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:44.779315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:44.779898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:44.839940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lazy-loading 'flavor' on Instance uuid 0169c16b-f283-4726-a5c8-d94fca5bbcb6 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:02:45.349081 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fec2bae7-3bf1-41dc-8bbe-2b1df7c86987 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.647824 Jul 19 20:02:45.364298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:45.365189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:45.371554 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2058/4210] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:02:44 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:02:45.381884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.382436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.386684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.387302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.399873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:45.761574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:45.762280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:45.786012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.786851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:45.788309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:45.789013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.062430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:46.085169 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cabc1ac1-d22d-4674-b4ba-93cd70010654 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.725227 Jul 19 20:02:46.086591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2153/4211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:45 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:46.098464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2de6872c-e070-4096-87fd-6a54658e6f58 req-06f3700a-bcfc-4824-a0cf-92c2df9c7f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:46.121142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2de6872c-e070-4096-87fd-6a54658e6f58 req-06f3700a-bcfc-4824-a0cf-92c2df9c7f41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:46.123887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2de6872c-e070-4096-87fd-6a54658e6f58 req-06f3700a-bcfc-4824-a0cf-92c2df9c7f41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:46.147083 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2de6872c-e070-4096-87fd-6a54658e6f58 req-06f3700a-bcfc-4824-a0cf-92c2df9c7f41 service nova] Creating event network-changed:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:02:46.154224 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2de6872c-e070-4096-87fd-6a54658e6f58 req-06f3700a-bcfc-4824-a0cf-92c2df9c7f41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064621 Jul 19 20:02:46.155363 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2154/4212] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:46.599964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:46.612018 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49805742-7b53-4485-8940-3c2024bd6cec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.854711 Jul 19 20:02:46.614982 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2059/4213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:45 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:02:47.106077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:47.106934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:47.128283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.129368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.135701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.142155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.471339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:47.491393 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84de0ac0-825c-47a6-a84b-b11e661c9e74 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.392063 Jul 19 20:02:47.496778 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2155/4214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:47 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:47.630501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:47.631801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:47.646391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.647423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:47.651794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:47.653625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.226790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:48.240018 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f31f556-59f2-49e9-af26-8e7163ac78ea tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.614113 Jul 19 20:02:48.242297 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2060/4215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:47 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:48.513417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:48.514328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:48.526227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.527103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:48.529260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:48.529980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.159600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:49.184062 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-653828c9-0526-4103-9833-b8d9c5339755 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.674381 Jul 19 20:02:49.187045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2156/4216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:48 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:49.273174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:49.279134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:49.336047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.338311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.356309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:49.357655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:49.825837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:49.846328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:49.849832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ef474bd-3a24-4434-9f0e-a2bc4ea046dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.595506 Jul 19 20:02:49.853825 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2061/4217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:49 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:50.206351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.207753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.224583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.228108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.230163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.233718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.497643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.501301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.509371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:50.518451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.519468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.521375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.522139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.558826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:50.587246 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97ec2a43-ece6-4f31-9596-39cb4761678c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.388803 Jul 19 20:02:50.587409 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56a98350-2312-49ab-80c1-d07c09d05c67 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100270 Jul 19 20:02:50.588255 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2062/4218] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:50.599014 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2157/4219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:50.599370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.600069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.606945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.607673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.608738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.609465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.667869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4cc3950-d6be-4f07-a474-1e994a453efd tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52" status: 200 len: 194 microversion: 2.1 time: 0.073062 Jul 19 20:02:50.677204 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2063/4220] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:50.870076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:50.870699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:50.880434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.880899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:50.881749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:50.882201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.084644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-49f3e967-ad8c-4caf-a856-9c8995c69867 req-fc7f5c17-4c18-4651-8cb8-744ab56a320e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-plugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:51.118499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-49f3e967-ad8c-4caf-a856-9c8995c69867 req-fc7f5c17-4c18-4651-8cb8-744ab56a320e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.119053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-49f3e967-ad8c-4caf-a856-9c8995c69867 req-fc7f5c17-4c18-4651-8cb8-744ab56a320e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.171382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-49f3e967-ad8c-4caf-a856-9c8995c69867 req-fc7f5c17-4c18-4651-8cb8-744ab56a320e service nova] Creating event network-vif-plugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:02:51.199348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-49f3e967-ad8c-4caf-a856-9c8995c69867 req-fc7f5c17-4c18-4651-8cb8-744ab56a320e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118342 Jul 19 20:02:51.218122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2064/4221] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:51.488172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:51.501607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b02efcb5-68dd-4567-b76d-88bc0a23f1da tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.634194 Jul 19 20:02:51.514819 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2158/4222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:50 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:51.617247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:51.618298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:51.633415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.635555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:51.636765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:51.638010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.092293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:52.103552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ac00b70-d698-4321-afdb-714a03e2e71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.492725 Jul 19 20:02:52.107593 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2065/4223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:51 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:52.522841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:52.524514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:52.544620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=74 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:02:52.548420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.550694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.553865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:52.556918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:52.946548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:52.972753 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e3efc88c-3cfa-4bbe-b1e3-ea5cdee17dcd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1363 microversion: 2.1 time: 0.454536 Jul 19 20:02:52.978879 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2159/4224] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:52 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1363 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:53.145542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:53.146640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:53.156737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.161728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.163221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.163926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.398436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:53.406803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fda288ba-1d89-409d-8aa5-d8eb9889e9a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.275914 Jul 19 20:02:53.408584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2066/4225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:53 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:53.535045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01ef046d-19e8-47e3-8bb3-3e873c47f8fa"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:53.536103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:53.543525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.544069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.544912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:53.545357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:53.968145 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8b67313-254a-4683-b846-934f2c9cf7a2 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "POST /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437210 Jul 19 20:02:53.969809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2160/4226] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:02:53 2022] POST /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:53.992718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:53.993542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.003935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.006470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.009053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.009618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.403654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:54.418090 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8ee6104-71f5-4303-9aca-3342dac960dc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1550 microversion: 2.1 time: 0.429191 Jul 19 20:02:54.419584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2067/4227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:53 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1550 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:54.426887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:54.427773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.468436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.472833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:54.475027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.475727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:54.476941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.482010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.497235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.498126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.500537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:54.501157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:54.745482 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd9fd168-2842-4acf-806b-5bb33b8b091a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309751 Jul 19 20:02:54.747967 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2068/4228] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:02:54 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:02:54.843208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:54.854394 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a29e105a-78ec-454b-8e3a-1e4a851af5c5 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 0.433072 Jul 19 20:02:54.864384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2161/4229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:54 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:55.875462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:55.876146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:55.889443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.894558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:55.895744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:55.896702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:56.219017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:56.236065 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fc0dd11-db7c-49d7-9c21-c86584483450 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1531 microversion: 2.1 time: 0.367361 Jul 19 20:02:56.237643 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2069/4230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:55 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1531 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.256686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:57.257934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:57.271423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.271778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.272639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.279080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.492650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:57.504000 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f7b71de-e71f-432e-9f03-cda731d0c02f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1531 microversion: 2.1 time: 0.252663 Jul 19 20:02:57.505213 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2162/4231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:57 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1531 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:02:57.790105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-63af1b66-2930-467a-bb0c-fc728589505e req-77fbd48d-6365-427d-b80d-f3f78c74481e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:02:57.802438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-63af1b66-2930-467a-bb0c-fc728589505e req-77fbd48d-6365-427d-b80d-f3f78c74481e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:57.803247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-63af1b66-2930-467a-bb0c-fc728589505e req-77fbd48d-6365-427d-b80d-f3f78c74481e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:57.824122 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-63af1b66-2930-467a-bb0c-fc728589505e req-77fbd48d-6365-427d-b80d-f3f78c74481e service nova] Creating event network-changed:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:02:57.832115 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-63af1b66-2930-467a-bb0c-fc728589505e req-77fbd48d-6365-427d-b80d-f3f78c74481e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046147 Jul 19 20:02:57.833564 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2070/4232] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:02:58.527366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:02:58.528578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:02:58.568069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.569647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:58.577709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:02:58.578523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:02:59.192131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:02:59.210214 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f77fe60-200c-4f74-a4f1-bcd0e6a09d2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1531 microversion: 2.1 time: 0.691559 Jul 19 20:02:59.219754 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2163/4233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:02:58 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1531 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:00.242399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:00.243775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:00.263777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.264924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.268636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:00.269410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:00.579609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:00.589521 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b52ceeb-0156-48f8-8c32-dee49fb50405 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.355599 Jul 19 20:03:00.604336 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2071/4234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:00 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:01.609143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:01.610398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:01.624814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.625478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.628163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:01.630891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:01.876366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:01.891346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0aab4c3-adaa-4783-8ced-519bc8bfae4c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.285729 Jul 19 20:03:01.893603 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2164/4235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:01 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:02.857868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8605a2a7-9219-4fc8-81c6-ca9604ca15f6 req-26cd08d3-1820-4e21-b99d-8a385f7de78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "name": "network-vif-plugged", "status": "completed", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:02.874965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8605a2a7-9219-4fc8-81c6-ca9604ca15f6 req-26cd08d3-1820-4e21-b99d-8a385f7de78e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.875726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8605a2a7-9219-4fc8-81c6-ca9604ca15f6 req-26cd08d3-1820-4e21-b99d-8a385f7de78e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.909788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:02.911582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:02.914287 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8605a2a7-9219-4fc8-81c6-ca9604ca15f6 req-26cd08d3-1820-4e21-b99d-8a385f7de78e service nova] Creating event network-vif-plugged:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h2-843834-3 Jul 19 20:03:02.922474 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8605a2a7-9219-4fc8-81c6-ca9604ca15f6 req-26cd08d3-1820-4e21-b99d-8a385f7de78e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069665 Jul 19 20:03:02.924739 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2072/4236] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:02.931637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.932354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:02.950272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:02.951727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:03.272900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:03.293574 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ddf22ff-d66b-4984-9667-41ca33b27bf7 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.388258 Jul 19 20:03:03.299138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2165/4237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:02 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:04.317087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:04.319461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:04.332283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.333063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.334083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:04.334722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:04.942294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:04.965169 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85ee8319-a925-44fd-aae0-660f963ac330 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.653300 Jul 19 20:03:04.980049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2073/4238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:04 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:05.986388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:05.987512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:06.026010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.026701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.028015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:06.028742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:06.819065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:06.839378 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f6faae7-bce4-43ff-a81d-148eb239e81d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.852561 Jul 19 20:03:06.843300 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2166/4239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:05 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:07.866006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:07.872719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:07.920970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:07.927795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:07.929909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:07.930641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:09.493071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:09.508090 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70d28b10-d8b7-4a73-9647-aea6a1ece94c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 1.651732 Jul 19 20:03:09.533838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2074/4240] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:07 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:10.530006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:10.539051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:10.540873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.542120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.567752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.569435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.570323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.572546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.573999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.577565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.578402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.581996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.723573 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff4d19bf-5387-43ed-802f-bd594d81efed tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.187306 Jul 19 20:03:10.725041 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2075/4241] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:03:10 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:10.865132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:10.866835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:10.884622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.886536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.889039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:10.890034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:10.995209 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e9d7aadd-1a5d-4a44-9b0e-6613346c3804 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52" status: 200 len: 194 microversion: 2.1 time: 0.134203 Jul 19 20:03:11.000075 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2076/4242] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 19 20:03:10 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52 => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:03:11.016569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:11.017611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:11.040427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.042967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.058491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:11.061307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:11.360816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lazy-loading 'services' on Instance uuid 1f1ba765-9d80-4daa-8415-904bd6bc380a {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:11.409519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:11.418438 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8f78e7b-7d13-42c3-adb8-54709743bf32 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.892438 Jul 19 20:03:11.433947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2167/4243] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:10 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:11.560997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23423680-39af-40a8-af91-6f228e6e104a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52" status: 202 len: 0 microversion: 2.1 time: 0.552297 Jul 19 20:03:11.563642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2077/4244] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:03:11 2022] DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/f2c57b95-3294-4a69-8c3a-2d6780a28d52 => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:12.436662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:12.438101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:12.459681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.460295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:12.461333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:12.461843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:13.057685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:13.069430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c32adcff-51f8-45d8-a625-e9e72c93c4bf tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.637347 Jul 19 20:03:13.071060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2168/4245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:12 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:14.090788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:14.092449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:14.117125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.117859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:14.123342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:14.125115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:15.353389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:15.373773 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b824120-9f46-46b9-af3f-1b96a3c6ae03 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 1.289222 Jul 19 20:03:15.374794 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2078/4246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:14 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:16.400401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:16.401022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:16.435177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:16.435995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:16.437196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:16.437957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:16.451641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:17.751128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:17.762241 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc362239-b55c-412c-9441-3adbea71770d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 1.365767 Jul 19 20:03:17.771047 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2169/4247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:16 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:18.791227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:18.795105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:18.831471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.837126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:18.848302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:18.848817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:19.970863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:19.983147 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b08481f0-754f-435c-a7b7-e3b0ba5b33ba tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 1.197992 Jul 19 20:03:19.995319 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2079/4248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:18 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:20.579424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.580946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.600176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.600641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.601445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.601896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.689530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21e856dd-bd36-42ee-89bc-56d3007b122c"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:20.698545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.724793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=36 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:20.733955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.739335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.740741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.743904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.748985 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-21bd255e-fa45-4737-b603-92ceaccee9e9 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/01ef046d-19e8-47e3-8bb3-3e873c47f8fa" status: 200 len: 194 microversion: 2.1 time: 0.173109 Jul 19 20:03:20.750069 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2170/4249] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 19 20:03:20 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/01ef046d-19e8-47e3-8bb3-3e873c47f8fa => generated 194 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:20.755417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:20.780966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:20.784523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:20.814375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.816424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:20.818643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:20.823578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.046137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lazy-loading 'services' on Instance uuid 1f1ba765-9d80-4daa-8415-904bd6bc380a {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:21.249205 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6da2881-8513-46e5-a1b2-2eaf94f1c89b tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/01ef046d-19e8-47e3-8bb3-3e873c47f8fa" status: 202 len: 0 microversion: 2.1 time: 0.490949 Jul 19 20:03:21.249844 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2171/4250] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:03:20 2022] DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments/01ef046d-19e8-47e3-8bb3-3e873c47f8fa => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:21.264941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:21.267693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:21.283698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.291471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.298179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:21.298747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:21.355274 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07052cbf-7c89-4652-9bad-11291364ff35 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667964 Jul 19 20:03:21.360008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2080/4251] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:03:20 2022] POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:21.738523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:21.762533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1421867803", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "995a5af9-ccb8-49a2-9c3c-8d8770d9b71a"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:21.770588 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9dce37b3-7459-433f-a6b6-f537615202df tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.515691 Jul 19 20:03:21.776884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2172/4252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:21 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:21.876570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] validate_networks() for [('995a5af9-ccb8-49a2-9c3c-8d8770d9b71a', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:03:22.800971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:22.803280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:22.811300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=28 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:22.840418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.844692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:22.847690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:22.849370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:23.105952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:23.116961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7ef454b-336c-4ac8-93d4-306bd784301a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.323093 Jul 19 20:03:23.121117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2173/4253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:22 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:23.967012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:03:23.967488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:03:23.967963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:03:23.968565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:03:23.969299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:03:24.002360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.004225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.006524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.013209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.093140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Getting quotas for project 162869f4e0c54f87a130ace33172c733. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:03:24.104193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Getting quotas for user 6c167927213f434a9f86e276869985f9 and project 162869f4e0c54f87a130ace33172c733. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:03:24.130228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:03:24.138217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:24.139570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:24.152033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:03:24.159837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.160735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.161798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:24.163287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:24.304162 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-26c0966a-d975-4c37-86da-5602f567e8ab tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.939568 Jul 19 20:03:24.307737 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2081/4254] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:03:24.318523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-107edf42-fd70-46c5-b472-84956ad683c7 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:24.320357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-107edf42-fd70-46c5-b472-84956ad683c7 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:24.445051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-107edf42-fd70-46c5-b472-84956ad683c7 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:24.455956 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-107edf42-fd70-46c5-b472-84956ad683c7 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1214 microversion: 2.1 time: 0.141363 Jul 19 20:03:24.460313 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2082/4255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:24 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:24.575912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:24.587875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14f82269-bc1a-4a5c-8acb-c4e591daa71c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.454593 Jul 19 20:03:24.591415 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2174/4256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:24 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:25.475964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:25.477411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.499949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.503410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.508090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.511751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.607925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:25.608553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:25.631819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.632285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.633147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:25.633596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:25.829890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:25.839898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-345aa410-fdb5-4cf0-bb88-751f38b8e17b tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1210 microversion: 2.1 time: 0.367987 Jul 19 20:03:25.847561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2083/4257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:25 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1210 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:26.333974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:26.350442 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eab5c781-fec0-4026-a51b-bd74d5494936 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.742529 Jul 19 20:03:26.350833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2175/4258] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:25 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:26.874232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:26.881769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:26.899955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.903819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:26.907246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:26.910144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.095060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.112273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b99a954-be16-46c1-9445-183d671054f4 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1272 microversion: 2.1 time: 0.251989 Jul 19 20:03:27.114200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2084/4259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:26 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:27.368566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:27.369187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:27.386607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.388583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.390652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:27.391165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:27.935513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:27.956402 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43d2183d-eaff-46ab-9036-cc87f08b1091 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.591625 Jul 19 20:03:27.958079 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2176/4260] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:27 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.131629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.133141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.144034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.152817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.154784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:28.157475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:28.333526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:28.347044 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ab53e9a-c8a6-4267-a7db-9f253f724629 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1272 microversion: 2.1 time: 0.215612 Jul 19 20:03:28.348374 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2085/4261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:28.973740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:28.976277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:28.998208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.000284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.001298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.001988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.365516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.366948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.378051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.379405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.381821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.382449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.451269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:29.471797 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-746616de-8fcf-44da-8c8e-a7a3180b173f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1526 microversion: 2.1 time: 0.501707 Jul 19 20:03:29.479645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2177/4262] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:28 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1526 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:29.495255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:29.496341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:29.504673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.505541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:29.507882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:29.508562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.358945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.374723 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a378f562-d890-4d24-bc5b-c9658fe3ec49 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.889667 Jul 19 20:03:30.375372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2178/4263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:30.390825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.391891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:30.409666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:30.410792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.411310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.412116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.412563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.422243 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4fedbe86-788f-4c15-b35f-753ebc46d62e tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 1.060764 Jul 19 20:03:30.423985 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2086/4264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:29 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:30.436144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.438082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:30.459006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.462767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.464990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.467225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.471559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc81563d-6794-4f37-9ddf-7ff845f787b5 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094953 Jul 19 20:03:30.477098 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2179/4265] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:30.488856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:30.489728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:30.506696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.507192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:30.507995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:30.508440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.214047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.226709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b263e941-29bc-4e43-8b33-a880a9dd27a3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1508 microversion: 2.1 time: 0.740331 Jul 19 20:03:31.229053 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2180/4266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.235816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3049a458-8546-4e47-8a04-cf2a9d4b2fab req-96770f91-c4be-4ec1-a910-6bedbfbba2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811f2297-8c98-4267-a392-2217ebe4cd87", "tag": "aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:31.249298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.249847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3049a458-8546-4e47-8a04-cf2a9d4b2fab req-96770f91-c4be-4ec1-a910-6bedbfbba2f9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.250470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3049a458-8546-4e47-8a04-cf2a9d4b2fab req-96770f91-c4be-4ec1-a910-6bedbfbba2f9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.260799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5642ba33-12cc-4b10-8518-d432da4e12e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.833291 Jul 19 20:03:31.266573 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2087/4267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:30 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.271099 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3049a458-8546-4e47-8a04-cf2a9d4b2fab req-96770f91-c4be-4ec1-a910-6bedbfbba2f9 service nova] Creating event network-changed:aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5 for instance 811f2297-8c98-4267-a392-2217ebe4cd87 on n-h2-843834-3 Jul 19 20:03:31.271948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.279545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.281902 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3049a458-8546-4e47-8a04-cf2a9d4b2fab req-96770f91-c4be-4ec1-a910-6bedbfbba2f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050165 Jul 19 20:03:31.283332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2181/4268] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:31.294940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.295570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.297294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.297876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.352894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3712d60-e635-4181-a257-77863aef2190 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084841 Jul 19 20:03:31.353865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2088/4269] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:03:31.358833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.359683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.367447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.368086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.369205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.370292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.529951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Calling method '.version_select at 0x7f23ef80b820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.531196 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:03:31.531196 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:03:31.532678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.533253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.550648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.551257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.567036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.567870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.577430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-da024eed-f35f-4f1b-a048-45040284a635 tempest-PortsAdminExtendedAttrsTestJSON-25309654 tempest-PortsAdminExtendedAttrsTestJSON-25309654-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.292133 Jul 19 20:03:31.578564 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2182/4270] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:31.584069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.585194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.592240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.593012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.594127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.594802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.686078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.703752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d125f08f-b110-4348-8b83-c15a6105fe0e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.348641 Jul 19 20:03:31.706186 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2089/4271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.721993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.722705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.748805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.750544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.752840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.754042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.816428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:31.946364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:31.953342 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dda8b5a6-4040-49d0-a3f0-74c9e8234de0 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 204 len: 0 microversion: 2.1 time: 0.245532 Jul 19 20:03:31.954374 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2090/4272] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:31 2022] DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:03:31.961856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1378088193"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:31.962427 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-897d4d0d-6a37-4ae2-8241-69d4f8df1204 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 0.381509 Jul 19 20:03:31.963690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.963984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2183/4273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:31.977702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:31.983040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.983819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.983936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:31.984924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.985932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:31.997154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:31.999032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.000061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.002523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.464629 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f051bb9-23ee-44f0-9c79-e1b49f0981be tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.508507 Jul 19 20:03:32.469048 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2091/4274] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:31 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 20:03:32.484274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.488824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.504400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.509782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.511215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.511864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.824383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:32.833878 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8120586d-c952-4141-923a-cbb0cc8a057c tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1673 microversion: 2.1 time: 0.866169 Jul 19 20:03:32.849711 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2184/4275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:31 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1673 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:32.983056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:32.983772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:32.994259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.994905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:32.995828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:32.997264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.053133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.066791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe058ba2-7494-4a64-b09b-e549aa4edf6a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1508 microversion: 2.1 time: 0.596991 Jul 19 20:03:33.073988 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2092/4276] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1508 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.131740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-07b0c97b-1d4b-4971-a7e0-921fdaa9dda4 req-6e13c594-b716-4b34-ab4f-9edceb303cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "name": "network-vif-unplugged", "status": "completed", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:33.142595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07b0c97b-1d4b-4971-a7e0-921fdaa9dda4 req-6e13c594-b716-4b34-ab4f-9edceb303cf0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.143402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-07b0c97b-1d4b-4971-a7e0-921fdaa9dda4 req-6e13c594-b716-4b34-ab4f-9edceb303cf0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.173706 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-07b0c97b-1d4b-4971-a7e0-921fdaa9dda4 req-6e13c594-b716-4b34-ab4f-9edceb303cf0 service nova] Creating event network-vif-unplugged:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h2-843834-3 Jul 19 20:03:33.188394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-07b0c97b-1d4b-4971-a7e0-921fdaa9dda4 req-6e13c594-b716-4b34-ab4f-9edceb303cf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061089 Jul 19 20:03:33.189514 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2093/4277] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:33.378808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:33.381655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:33.391977 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cee051b9-b338-485c-9668-fcc11bd21ded tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 0.415167 Jul 19 20:03:33.401507 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2185/4278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:32 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:33.860553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:33.861494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:33.879141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.884440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:33.885672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:33.886363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.043256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:34.091709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.093103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.129545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.130733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.132975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.135151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.455036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:34.864109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:34.866800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:34.878882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5f6b00d-7c29-4561-8417-2e5d481016d4 tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1673 microversion: 2.1 time: 1.022514 Jul 19 20:03:34.879797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2094/4279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:33 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1673 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:34.884710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:34.891402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:34.912151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.916115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:34.917262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:34.922083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.234805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:35.247229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ccda1777-ff84-484b-915c-8607ed38de68 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1508 microversion: 2.1 time: 1.161278 Jul 19 20:03:35.252516 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2186/4280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1508 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:35.792491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:35.802237 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3ac73b46-70a4-41e5-a466-6f537e8c470d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 0.921167 Jul 19 20:03:35.815721 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2095/4281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:34 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:35.896711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:35.897356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:35.912535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.912817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:35.913789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:35.914407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.222154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:36.237679 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac75797c-830c-4957-ad71-d15a9a27f97e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1673 microversion: 2.1 time: 0.344101 Jul 19 20:03:36.239466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2187/4282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:35 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1673 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:36.272047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.274034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.283380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.283963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.284831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.285339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.763447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:36.785431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be2f2eae-27ee-4281-9691-62f3d8a93148 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1451 microversion: 2.1 time: 0.520265 Jul 19 20:03:36.790298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2096/4283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1451 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:36.808321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.809555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.824870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.826510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.829589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.830437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.832147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:36.832924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:36.851104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.851956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:36.852899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:36.853344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.355865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.373968 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b43178c-4e5e-4ff9-811e-cb3142a28ae1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1451 microversion: 2.1 time: 0.571604 Jul 19 20:03:37.379993 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2188/4284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1451 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:37.400684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:37.401460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.422326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.423650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.426351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.427026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.555042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.565792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb5a8028-4508-4af3-8a67-d0febd352269 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 0.747803 Jul 19 20:03:37.582774 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2097/4285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:36 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:37.587983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1079bff73f42419d99533c176b6a7473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd079edd40a407dbec0aa9424f91d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:37.605129 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0509e2fd-a393-4f3d-8875-d317c5b68a0e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 200 len: 1605 microversion: 2.1 time: 0.223817 Jul 19 20:03:37.608517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2189/4286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:37 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:37.625425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:37.626484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.649071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4e1facee-a0d1-4810-8120-a75a164e712d req-173e95da-f5ad-4e59-bc9b-f95470683ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1ba765-9d80-4daa-8415-904bd6bc380a", "name": "network-vif-deleted", "tag": "811a1ae2-b430-4a10-a1c8-af0d5fe0df06"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:37.677427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.681795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.703043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.704813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.736069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e1facee-a0d1-4810-8120-a75a164e712d req-173e95da-f5ad-4e59-bc9b-f95470683ff9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.741374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4e1facee-a0d1-4810-8120-a75a164e712d req-173e95da-f5ad-4e59-bc9b-f95470683ff9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.775805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4e1facee-a0d1-4810-8120-a75a164e712d req-173e95da-f5ad-4e59-bc9b-f95470683ff9 service nova] Creating event network-vif-deleted:811a1ae2-b430-4a10-a1c8-af0d5fe0df06 for instance 1f1ba765-9d80-4daa-8415-904bd6bc380a on n-h1-843834-3 Jul 19 20:03:37.785244 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4e1facee-a0d1-4810-8120-a75a164e712d req-173e95da-f5ad-4e59-bc9b-f95470683ff9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144261 Jul 19 20:03:37.790426 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2190/4287] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:37.847694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lazy-loading 'flavor' on Instance uuid 0169c16b-f283-4726-a5c8-d94fca5bbcb6 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:37.894830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'shelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state shelved_offloaded Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 14 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: {"shelve": {}} Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'shelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state shelved_offloaded Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'shelve': {}}} Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 19 20:03:37.896765 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state shelved_offloaded Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state shelved_offloaded Jul 19 20:03:37.902111 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:03:37.909984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'shelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state shelved_offloaded {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:37.910965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-79555b0c-133f-45d2-adf4-d147dd77ab6d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 155 microversion: 2.1 time: 0.326818 Jul 19 20:03:37.920800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:37.921474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:37.929962 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2098/4288] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:37 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 155 bytes in 345 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:03:37.940031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.940502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:37.941315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:37.947508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.331616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e741efff-47a2-4e18-a3b2-72328ea6da2a req-6624b66e-db0d-4f82-9c9e-9ea292d7088e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f2297-8c98-4267-a392-2217ebe4cd87", "name": "network-vif-plugged", "status": "completed", "tag": "aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:38.362252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e741efff-47a2-4e18-a3b2-72328ea6da2a req-6624b66e-db0d-4f82-9c9e-9ea292d7088e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.362710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e741efff-47a2-4e18-a3b2-72328ea6da2a req-6624b66e-db0d-4f82-9c9e-9ea292d7088e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.410470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e741efff-47a2-4e18-a3b2-72328ea6da2a req-6624b66e-db0d-4f82-9c9e-9ea292d7088e service nova] Creating event network-vif-plugged:aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5 for instance 811f2297-8c98-4267-a392-2217ebe4cd87 on n-h2-843834-3 Jul 19 20:03:38.418954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e741efff-47a2-4e18-a3b2-72328ea6da2a req-6624b66e-db0d-4f82-9c9e-9ea292d7088e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099844 Jul 19 20:03:38.422529 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2099/4289] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:38.591648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.592768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.608830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.610371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.611403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.613367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.689410 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54810187-3edb-4c24-9138-5ea834549b4e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.767071 Jul 19 20:03:38.690277 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2191/4290] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:37 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:38.702939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.710410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.761854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.763876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.779919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.780542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.850985 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a HTTP/1.1 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1f1ba765-9d80-4daa-8415-904bd6bc380a'} Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:03:38.860759 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:03:38.865936 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:03:38.868400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:03:38.872874 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06ddb0a5-d042-459c-903b-3dfcf121bf4f tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 404 len: 111 microversion: 2.1 time: 0.181133 Jul 19 20:03:38.876466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2192/4291] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:03:38.887041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:38.890064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:38.910428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.911038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:38.911906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:38.912373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:39.392239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.406467 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2ee060b-5025-484a-b8c2-1c6fde9f65e8 tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 0.820220 Jul 19 20:03:39.407482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2100/4292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:39.420987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e30226fa-4de7-4a69-8826-8ec4c8b5d2bf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '.version_select at 0x7f2400a5b0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:39.464716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e30226fa-4de7-4a69-8826-8ec4c8b5d2bf tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272768013" status: 202 len: 0 microversion: 2.1 time: 0.048956 Jul 19 20:03:39.469710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2101/4293] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272768013 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:03:39.506804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:39.524435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97006a3d-a575-46a7-808a-1a7b077479c8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1459 microversion: 2.1 time: 0.645420 Jul 19 20:03:39.528279 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2193/4294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:38 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1459 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:40.433093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:40.433801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:40.460814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.461282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.464256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.465483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.544806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:40.545471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:40.571974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.579789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:40.587714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:40.588664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.275800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:42.294762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2392577b-a911-4cbd-a5b3-583bb43c252f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1459 microversion: 2.1 time: 1.755328 Jul 19 20:03:42.295943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2194/4295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:40 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1459 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:42.441798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:42.442832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:42.448226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:42.462386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d37804ec-a7b1-4ada-ae8d-04ac69741a8f tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1314 microversion: 2.1 time: 2.043075 Jul 19 20:03:42.467539 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2102/4296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:40 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1314 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:42.483030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.483780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.484662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.485120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.532613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lazy-loading 'flavor' on Instance uuid f2ff0246-0ae3-473a-841a-a4587b9b4043 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:03:42.880308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45eda124-f3de-4e8b-84e1-5fbb5d913f2a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/action" status: 200 len: 32 microversion: 2.1 time: 0.443910 Jul 19 20:03:42.881790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2195/4297] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:03:42 2022] POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:03:42.892587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:42.893370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:42.910701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.914720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:42.920171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:42.920676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.319289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:43.320034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:43.353281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.357147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:43.360540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:43.361045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.656200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:44.672553 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-feb2135e-2592-432e-8bd3-87ca0b7cb268 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.361114 Jul 19 20:03:44.673767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2196/4298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:43 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:44.684992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:44.685950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:44.704188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:44.705722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.706677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:44.712503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.866336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:44.882786 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ffd2b5f5-88de-4019-a368-7d46974f1ea5 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.994179 Jul 19 20:03:44.891246 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2103/4299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:42 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:44.905797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-391a7147-ff0d-45b4-963e-c4e2e64251b1 req-23e026b8-6b65-47a2-8594-35312ba5241a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-plugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:44.933969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-391a7147-ff0d-45b4-963e-c4e2e64251b1 req-23e026b8-6b65-47a2-8594-35312ba5241a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:44.934802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-391a7147-ff0d-45b4-963e-c4e2e64251b1 req-23e026b8-6b65-47a2-8594-35312ba5241a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:44.967594 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-391a7147-ff0d-45b4-963e-c4e2e64251b1 req-23e026b8-6b65-47a2-8594-35312ba5241a service nova] Creating event network-vif-plugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:03:44.978790 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-391a7147-ff0d-45b4-963e-c4e2e64251b1 req-23e026b8-6b65-47a2-8594-35312ba5241a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085454 Jul 19 20:03:44.983904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2104/4300] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:45.584742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:45.612961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ccbc2add-3337-47bf-bf63-959400d196bf tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1497 microversion: 2.1 time: 0.937790 Jul 19 20:03:45.614032 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2197/4301] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:44 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1497 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:45.695624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:45.696149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:45.710863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.712068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.713313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.714134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.910364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:45.912689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:45.924377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.928654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:45.937045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:45.939430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:46.356000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:46.395413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8514d111-3c8b-4803-ab16-3217bcca92dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 0.702600 Jul 19 20:03:46.401684 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2105/4302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:45 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:46.907092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:46.925454 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8fd572a-8f1a-4ace-82d5-31d642bed483 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.020504 Jul 19 20:03:46.932201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2198/4303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:45 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:47.419318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:47.419868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:47.431659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:47.443405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:47.444502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:47.444964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:47.905629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a72f66cd-9c95-48fa-a00b-32d263ba8760 req-df9ab421-3aea-4e0e-afc8-586c1ee3cef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:47.961646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a72f66cd-9c95-48fa-a00b-32d263ba8760 req-df9ab421-3aea-4e0e-afc8-586c1ee3cef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:47.964750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a72f66cd-9c95-48fa-a00b-32d263ba8760 req-df9ab421-3aea-4e0e-afc8-586c1ee3cef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.027252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a72f66cd-9c95-48fa-a00b-32d263ba8760 req-df9ab421-3aea-4e0e-afc8-586c1ee3cef1 service nova] Creating event network-changed:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h1-843834-3 Jul 19 20:03:48.055375 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a72f66cd-9c95-48fa-a00b-32d263ba8760 req-df9ab421-3aea-4e0e-afc8-586c1ee3cef1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153707 Jul 19 20:03:48.064265 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2199/4304] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:48.084822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:48.086082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:48.107698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.108707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.111182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:48.113098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:48.871432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:48.889217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba1aa419-6a66-4c19-9ada-eb56fcd88dd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.474160 Jul 19 20:03:48.892067 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2106/4305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:47 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:49.427391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:49.452226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa98fd9c-c30a-404c-b706-54930dd92b8d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.373708 Jul 19 20:03:49.452946 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2200/4306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:48 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:49.911575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:49.913023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:49.927046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:49.927534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:49.951905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:49.952534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.472163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:50.472908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:50.514367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:50.516171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.518743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:50.519236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:50.602450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:52.113501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:52.131676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a72aa614-5045-419f-b0ed-9f988c970c2e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 2.221856 Jul 19 20:03:52.136068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2107/4307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:49 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:52.705994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:52.707461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:52.717915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:52.720333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:52.723715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:52.725225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:52.726363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:52.756278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:52.786666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:03:52.787617 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d1f8e90-001d-401f-a984-f71dbddc40e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 2.316195 Jul 19 20:03:52.788503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2201/4308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:50 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:53.018239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a5b14b6-4627-4b42-914b-dc4ca4a781af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "DELETE /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 204 len: 0 microversion: 2.1 time: 0.317022 Jul 19 20:03:53.021835 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2108/4309] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:03:52 2022] DELETE /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:03:53.031211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:53.033964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:53.039113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=62 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:53.053094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.054117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.055043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.055502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.154022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:53.154746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:53.171839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.172251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.173054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.173493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.773455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:53.784962 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0441c1b4-5eec-47c0-948c-587f91f3180c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1503 microversion: 2.1 time: 0.759919 Jul 19 20:03:53.786776 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2202/4310] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:53 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1503 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:53.808501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:53.809621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:53.818642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.827929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:53.829264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:53.829952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.330156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:54.352777 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-59d0c8f2-2b87-43fe-a05c-e540dadafd1c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.203283 Jul 19 20:03:54.365601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2109/4311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:53 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:54.809730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:54.810358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:54.821892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.822694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.827197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:54.830424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:54.927985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:54.945318 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1d0d5ed-cf67-45ae-81c2-24844858485d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.144015 Jul 19 20:03:54.947432 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2203/4312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:53 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:55.371800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.372707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.385490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.388295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.398952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.402184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.518676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:55.529696 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a16bdfc4-88dc-4ad8-85cf-98e3740e3b3c tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1503 microversion: 2.1 time: 0.728036 Jul 19 20:03:55.535259 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2110/4313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:54 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1503 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:55.964921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:55.965728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:55.994051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.994852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:55.996419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:55.997079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:57.539030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:57.549153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8824af9-3115-4124-bacf-c1d2f332939f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 2.182060 Jul 19 20:03:57.556649 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2204/4314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:03:57.576469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:57.577290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:57.593828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:57.599597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:57.609707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:57.610701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.031698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:58.042489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae0aa4da-70bb-4aa9-9365-ee6edeecada1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 2.081833 Jul 19 20:03:58.055600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c167927213f434a9f86e276869985f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162869f4e0c54f87a130ace33172c733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:58.063800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2111/4315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:55 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:58.069406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-941492c4-0ede-428d-a693-4b33b8632b41 req-37851680-bf5e-4c77-a8a0-1c2698df897e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f2297-8c98-4267-a392-2217ebe4cd87", "name": "network-vif-deleted", "tag": "aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:03:58.074326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c243ff4b-a45e-4051-bbea-1bafdaff034d tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 200 len: 1461 microversion: 2.1 time: 0.516165 Jul 19 20:03:58.075748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2205/4316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:57 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 1461 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:58.090174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-941492c4-0ede-428d-a693-4b33b8632b41 req-37851680-bf5e-4c77-a8a0-1c2698df897e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:58.103773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-941492c4-0ede-428d-a693-4b33b8632b41 req-37851680-bf5e-4c77-a8a0-1c2698df897e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.125864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:03:58.128795 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-941492c4-0ede-428d-a693-4b33b8632b41 req-37851680-bf5e-4c77-a8a0-1c2698df897e service nova] Creating event network-vif-deleted:aa0b2742-f5d3-444d-8c2f-cf9d747a6fa5 for instance 811f2297-8c98-4267-a392-2217ebe4cd87 on n-h2-843834-3 Jul 19 20:03:58.150767 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-941492c4-0ede-428d-a693-4b33b8632b41 req-37851680-bf5e-4c77-a8a0-1c2698df897e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079020 Jul 19 20:03:58.154871 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2112/4317] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:03:58.575548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:58.576551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:58.599113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:58.599695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:58.600689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:58.601193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.081485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:59.082167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:59.121311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.129189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.136610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.137497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.871162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:59.884341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3d96978-6523-430c-bf8b-0fed16d9a02d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.313044 Jul 19 20:03:59.908300 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2206/4318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:58 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:03:59.920454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:03:59.939290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] [instance: 811f2297-8c98-4267-a392-2217ebe4cd87] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:03:59.948002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:03:59.965450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.978237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:03:59.980219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:03:59.982289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.011287 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9aaae2a9-3318-456b-923e-f51ada06fa0a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 0.935282 Jul 19 20:04:00.027137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] HTTP exception thrown: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Request method failure captured: Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 HTTP/1.1 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w4BvSIxEp2a9-fPJvpYlvCNPMFxiKM7QnyaOxqrlhcTBcaIVcb14wpU1Sb5ufNt9zLgXbuw5eM_NQSLJWhMhmA4DfiEKmZBBr3DOkZLAZRzrA66gRTQ29lF3_V1PvXT7JZY7Itw3tmO75HTli95u0vd5cwY7mAR2JxEeH5gtRcezMY Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 162869f4e0c54f87a130ace33172c733 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesActionsTest-1119747913 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/162869f4e0c54f87a130ace33172c733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/162869f4e0c54f87a130ace33172c733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_162869f4e0c54f87a130ace33172c733"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/162869f4e0c54f87a130ace33172c733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesActionsTest-1119747913 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 162869f4e0c54f87a130ace33172c733 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesActionsTest-1119747913 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesActionsTest-1119747913-project Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6c167927213f434a9f86e276869985f9 Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesActionsTest-1119747913-project Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '811f2297-8c98-4267-a392-2217ebe4cd87'} Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:00.029598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. Jul 19 20:04:00.034682 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:00.035450 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2113/4319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:59 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:00.043509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] Returning 404 to user: Instance 811f2297-8c98-4267-a392-2217ebe4cd87 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:00.054095 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4893c3cf-317c-49ba-9d0f-90d3210ed6af tempest-VolumesActionsTest-1119747913 tempest-VolumesActionsTest-1119747913-project] 10.222.0.23 "GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87" status: 404 len: 111 microversion: 2.1 time: 0.142739 Jul 19 20:04:00.057248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2207/4320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:03:59 2022] GET /compute/v2.1/servers/811f2297-8c98-4267-a392-2217ebe4cd87 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:00.921721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:00.927141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:00.981357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:00.984810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:00.989476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:01.003396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:01.043162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:01.044223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:01.096390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:01.096390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:01.097434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:01.100035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:02.135865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:02.145637 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb23abc9-a981-4ff6-b4d2-d6b1b2cf4ed6 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.106913 Jul 19 20:04:02.146248 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2208/4321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:01 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:02.178873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:02.216802 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5abdd4a-e576-4c6b-8232-afc8fac85f60 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.308379 Jul 19 20:04:02.217667 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2114/4322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:00 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:03.178760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:03.180528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:03.205391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.205701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.215825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.223375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.240248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:03.241074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:03.257284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.257904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:03.258890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:03.259414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.788544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:04.807029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d4ae092-5ce2-4022-9a87-c2bb67695443 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.570726 Jul 19 20:04:04.831181 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2115/4323] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:03 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:04.849473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:04.855245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:04.881455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.883642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.886870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.889883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.932353 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a HTTP/1.1 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1f1ba765-9d80-4daa-8415-904bd6bc380a'} Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:04.939172 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:04.947352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:04.952403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe3dd9d6-dc75-42ce-823f-4c465b6cd24e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 404 len: 111 microversion: 2.1 time: 0.119464 Jul 19 20:04:04.961666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2116/4324] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:04 2022] DELETE /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:04.971694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:04.979130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 1f1ba765-9d80-4daa-8415-904bd6bc380a] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:04.994393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:04.995027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:04.996048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.002354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.041760 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a HTTP/1.1 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1f1ba765-9d80-4daa-8415-904bd6bc380a'} Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:05.044087 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 1f1ba765-9d80-4daa-8415-904bd6bc380a could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3258d84-c901-4a6a-bba8-7450ec72ea9e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a" status: 404 len: 111 microversion: 2.1 time: 0.085350 Jul 19 20:04:05.061865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2117/4325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:04 2022] GET /compute/v2.1/servers/1f1ba765-9d80-4daa-8415-904bd6bc380a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:05.183564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:05.230981 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb4e2d06-197a-443c-94c5-d7f4bc1847e1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 2.065171 Jul 19 20:04:05.259719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2209/4326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:03 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:05.548684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:05.549624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:05.575121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.575964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.577036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.579782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.844147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:05.851120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:05.904159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.907257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:05.916593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:05.919954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.473467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.482799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b1efcc6-3491-424c-ba2d-00de6f4e7b23 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.940780 Jul 19 20:04:06.488690 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2118/4327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:05 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:06.495476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:06.507949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:06.546472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:06.555148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.556518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:06.560592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:06.867561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:06.910181 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eca795c0-bd67-4a8e-ae09-fe10eed15848 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.075352 Jul 19 20:04:06.927582 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2210/4328] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:05 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:07.509916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:07.515308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:07.556735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.558196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.561392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:07.562624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:07.942886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:07.980567 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c38cca1-4961-4e17-beaf-a113cd2e2c8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1735 microversion: 2.1 time: 1.487577 Jul 19 20:04:07.984008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2119/4329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:06 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1735 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:08.007645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:08.011653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:08.046074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.051756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.068709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.075913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.263280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:08.280840 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d9c1a79-eb6e-4227-9c5e-968bf0c14289 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.779891 Jul 19 20:04:08.281774 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2211/4330] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:08.300938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1195544126"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:08.302537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:08.336909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.337257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:08.341899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:08.342767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.277400 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:04:09.284860 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action (ip 10.222.0.23) !!! Jul 19 20:04:09.295736 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc67ba60-f9da-4240-b2d8-50be24a4fa5f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.989908 Jul 19 20:04:09.310244 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2212/4331] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:08 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 20:04:09.343766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:09.350519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:09.376773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.377707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.382992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:09.383859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:09.593946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:09.607077 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30557fa9-e85b-41f5-b947-572ee775d059 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.618458 Jul 19 20:04:09.612375 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2120/4332] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:07 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:10.381597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:10.422464 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e0cd18b-3eb7-4d96-a5bb-175997c8eb8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1715 microversion: 2.1 time: 1.093700 Jul 19 20:04:10.423792 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2213/4333] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:09 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1715 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:10.644271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.645218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.666859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.671142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.677762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.685043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.816927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:10.823675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:10.839552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.843717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:10.844813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:10.845419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.169519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Cannot 'detach_volume' instance f2ff0246-0ae3-473a-841a-a4587b9b4043 while it is in vm_state rescued Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments/21e856dd-bd36-42ee-89bc-56d3007b122c HTTP/1.1 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'detach_volume' instance f2ff0246-0ae3-473a-841a-a4587b9b4043 while it is in vm_state rescued Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': 'f2ff0246-0ae3-473a-841a-a4587b9b4043', 'id': '21e856dd-bd36-42ee-89bc-56d3007b122c'} Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f2ff0246-0ae3-473a-841a-a4587b9b4043 while it is in vm_state rescued Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:11.171186 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f2ff0246-0ae3-473a-841a-a4587b9b4043 while it is in vm_state rescued Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 409 to user: Cannot 'detach_volume' instance f2ff0246-0ae3-473a-841a-a4587b9b4043 while it is in vm_state rescued {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ec63f11-7594-43d4-a651-4ff929d7bc86 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments/21e856dd-bd36-42ee-89bc-56d3007b122c" status: 409 len: 152 microversion: 2.1 time: 0.363777 Jul 19 20:04:11.175966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2214/4334] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:04:10 2022] DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments/21e856dd-bd36-42ee-89bc-56d3007b122c => generated 152 bytes in 365 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:04:11.192485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:11.209294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:11.274391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.282708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.292999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.294088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.360458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:11.386789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f930edf8-a9e3-4982-b8e1-e3beec6fa672 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 0.747509 Jul 19 20:04:11.387698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2121/4335] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:10 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:11.807110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31d8e182-d5b2-4905-894b-193d7e004495 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/action" status: 202 len: 0 microversion: 2.1 time: 0.609588 Jul 19 20:04:11.817074 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2215/4336] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:11 2022] POST /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:11.823082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:11.823806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:11.845643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.846572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:11.852167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:11.854722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.028137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-858a662e-cdf0-45bf-9ca7-82601c27aeb5 req-a9b6cd96-d68b-488e-9f3b-06c8175e07c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:12.053248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-858a662e-cdf0-45bf-9ca7-82601c27aeb5 req-a9b6cd96-d68b-488e-9f3b-06c8175e07c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.053811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-858a662e-cdf0-45bf-9ca7-82601c27aeb5 req-a9b6cd96-d68b-488e-9f3b-06c8175e07c4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.098654 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-858a662e-cdf0-45bf-9ca7-82601c27aeb5 req-a9b6cd96-d68b-488e-9f3b-06c8175e07c4 service nova] Creating event network-vif-unplugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:04:12.140573 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-858a662e-cdf0-45bf-9ca7-82601c27aeb5 req-a9b6cd96-d68b-488e-9f3b-06c8175e07c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117136 Jul 19 20:04:12.142059 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2216/4337] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:12.408121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:12.409205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:12.423860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.427652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.430851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:12.433274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:12.460225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:13.307122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.318361 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3eff152-56ab-4a13-b84a-aaae5915c828 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1723 microversion: 2.1 time: 1.503026 Jul 19 20:04:13.324076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2122/4338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:11 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1723 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:13.636619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:13.647743 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f44b6ef4-cdf2-4e0e-bf3f-7e17a1c06232 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.245337 Jul 19 20:04:13.653261 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2217/4339] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:12 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:14.349526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.351869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.372813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.378314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.383879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.390001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.667909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:14.669384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:14.716374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.717425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:14.719248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:14.720438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:15.236170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.257883 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c42d65b0-ce57-480b-bd24-ae779c3dfa15 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 0.595618 Jul 19 20:04:15.263280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2218/4340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:15.341072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:15.350285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fecb6ef-8b93-4f41-a255-13bdf80a7030 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1723 microversion: 2.1 time: 1.005003 Jul 19 20:04:15.350896 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2123/4341] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:14 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1723 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:16.154971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.156360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.169394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.169886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.170784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.171301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.245340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 HTTP/1.1 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3'} Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:16.260067 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.265223 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.273257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:16.277873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c3849a7-363b-4ef3-9c51-501b0822666e tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 404 len: 111 microversion: 2.1 time: 0.126713 Jul 19 20:04:16.280336 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2219/4342] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:04:16 2022] DELETE /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:16.283916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.285781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.330586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.332098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] [instance: 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.332853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.335875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.337168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.340651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.376584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.380944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.387377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.390793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.491396 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] HTTP exception thrown: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Request method failure captured: Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 HTTP/1.1 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1wyFkd10BSmBPVBI5RNHwM3jcDjESBryZC-mH-P-ebzq79leVcTfNQASQAUruEkxFPchrPqppVVelRJ2Wcb6DYVhqkclyldOmLPxSf1fRmmYuBQ9-LuR9tumYZVZmYZYRAieSX2hIqIJ2XRE78pzcOBtnogC6LHjE4-ahlBtYaxNkgw Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd079edd40a407dbec0aa9424f91d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: ecd079edd40a407dbec0aa9424f91d2b Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-838549140 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1079bff73f42419d99533c176b6a7473 Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeTestJSON-838549140-project Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3'} Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:16.495355 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. Jul 19 20:04:16.499963 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:16.521524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] Returning 404 to user: Instance 8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:16.525148 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6d25adb-631e-4a7b-b5fd-aba93a26589a tempest-AttachVolumeTestJSON-838549140 tempest-AttachVolumeTestJSON-838549140-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3" status: 404 len: 111 microversion: 2.1 time: 0.233521 Jul 19 20:04:16.532179 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2220/4343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/8ec697f0-0c6d-4170-bdaf-97ffa16cb1b3 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:16.542093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:16.548727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:16.598647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.600664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:16.606612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:16.609995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:17.239434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.257022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-86d9509a-d2a9-4c1b-babb-3b1cc8016736 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 0.980267 Jul 19 20:04:17.271302 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2124/4344] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:17.895741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:17.942977 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5bf87963-f871-40e0-b8e1-b31f7eb3c4bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1723 microversion: 2.1 time: 1.408831 Jul 19 20:04:17.951943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2221/4345] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:16 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1723 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:18.286144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:18.297507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.335623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.337335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.342303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:18.343449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:18.970840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:18.973885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:18.996915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.014487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:19.017170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:19.026255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.579479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.588988 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-054fa0a7-0ef4-4a2b-af41-730921450196 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 2.312323 Jul 19 20:04:20.600096 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2125/4346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:18 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:20.685286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:20.703534 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-feb40872-ae7c-4071-96ab-b8c1fed52d23 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1729 microversion: 2.1 time: 1.737577 Jul 19 20:04:20.728326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:20.728955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:20.732336 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2222/4347] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:18 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1729 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:20.742057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.747226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.748451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:20.749061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:20.906597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2bef2d1d-cefa-4297-a65b-53492db7825f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182353 Jul 19 20:04:20.907497 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2126/4348] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:04:20 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:21.629464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:21.630081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:21.647468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.647468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:21.647468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:21.647468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:23.559292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:23.574779 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a9ed190-3a94-46ec-a6f4-43c086dcda8c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.949178 Jul 19 20:04:23.584100 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2223/4349] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:21 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:24.616597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:24.617193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:24.669446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:24.687987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.688450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.689300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.689742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.867835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-24aef8c2-6d01-438c-9c55-410935443e6c req-5b2a5bbb-af5d-4db5-bb8c-e0ee803900fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-plugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:24.914394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=44 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:24.941844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-24aef8c2-6d01-438c-9c55-410935443e6c req-5b2a5bbb-af5d-4db5-bb8c-e0ee803900fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:24.943849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-24aef8c2-6d01-438c-9c55-410935443e6c req-5b2a5bbb-af5d-4db5-bb8c-e0ee803900fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:24.980425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-24aef8c2-6d01-438c-9c55-410935443e6c req-5b2a5bbb-af5d-4db5-bb8c-e0ee803900fd service nova] Creating event network-vif-plugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:04:25.000211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-24aef8c2-6d01-438c-9c55-410935443e6c req-5b2a5bbb-af5d-4db5-bb8c-e0ee803900fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138250 Jul 19 20:04:25.000898 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2224/4350] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:28.254724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:28.285773 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4832cecb-aed1-4128-9d5a-c45955d1ee54 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 3.673423 Jul 19 20:04:28.286468 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2127/4351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:24 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 3675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:28.402588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d065505f-70e4-4752-9de1-2486eb83f6eb req-b7db6bc5-51b7-49f4-93be-525e60ab0408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "name": "network-vif-plugged", "status": "completed", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:28.483509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d065505f-70e4-4752-9de1-2486eb83f6eb req-b7db6bc5-51b7-49f4-93be-525e60ab0408 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.484120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d065505f-70e4-4752-9de1-2486eb83f6eb req-b7db6bc5-51b7-49f4-93be-525e60ab0408 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.526731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ddb60150-ffd5-4af2-99db-16cd29a1235e req-37cab321-8873-4263-9d8b-00828602b443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:28.553091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d065505f-70e4-4752-9de1-2486eb83f6eb req-b7db6bc5-51b7-49f4-93be-525e60ab0408 service nova] Creating event network-vif-plugged:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h1-843834-3 Jul 19 20:04:28.559404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ddb60150-ffd5-4af2-99db-16cd29a1235e req-37cab321-8873-4263-9d8b-00828602b443 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:28.565193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ddb60150-ffd5-4af2-99db-16cd29a1235e req-37cab321-8873-4263-9d8b-00828602b443 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:28.577970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d065505f-70e4-4752-9de1-2486eb83f6eb req-b7db6bc5-51b7-49f4-93be-525e60ab0408 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190818 Jul 19 20:04:28.579058 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2225/4352] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:28.611489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ddb60150-ffd5-4af2-99db-16cd29a1235e req-37cab321-8873-4263-9d8b-00828602b443 service nova] Creating event network-changed:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:04:28.626406 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ddb60150-ffd5-4af2-99db-16cd29a1235e req-37cab321-8873-4263-9d8b-00828602b443 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104808 Jul 19 20:04:28.631274 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2128/4353] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:29.312930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:29.314556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:29.334285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.335518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:29.339133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:29.343650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:30.863758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-884339b1-0a59-40e0-a893-890cf09f9e26 req-c67cba9e-02f6-4157-9d4a-5f66431db2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:30.896372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-884339b1-0a59-40e0-a893-890cf09f9e26 req-c67cba9e-02f6-4157-9d4a-5f66431db2b7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:30.896849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-884339b1-0a59-40e0-a893-890cf09f9e26 req-c67cba9e-02f6-4157-9d4a-5f66431db2b7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:30.928059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=84 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:30.952767 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-884339b1-0a59-40e0-a893-890cf09f9e26 req-c67cba9e-02f6-4157-9d4a-5f66431db2b7 service nova] Creating event network-changed:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:04:30.977594 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-884339b1-0a59-40e0-a893-890cf09f9e26 req-c67cba9e-02f6-4157-9d4a-5f66431db2b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120308 Jul 19 20:04:30.984213 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2129/4354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:30.996452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:31.015363 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91cdb4da-c617-488d-ac7a-da4103232359 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 1.714856 Jul 19 20:04:31.019785 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2226/4355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:29 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:32.039590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:32.040433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:32.067268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.067734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.081013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:32.086597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:32.796842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:32.806964 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cbd980f-1e2a-47f5-a5e8-fdc4d187d981 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1517 microversion: 2.1 time: 0.772670 Jul 19 20:04:32.807687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2130/4356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:32 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1517 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:33.827294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:33.828661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:33.842681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.847145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:33.848458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:33.855524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:34.492115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:34.500926 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b7fe119-6b0d-4f87-99cd-37dbe271289b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.680028 Jul 19 20:04:34.501531 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2227/4357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:33 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:34.517086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:34.517743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:34.545080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:34.545564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:34.546388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:34.546833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:35.136762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:35.149702 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9708073-7e4e-4265-9f2f-2b309416a184 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.632675 Jul 19 20:04:35.152348 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2131/4358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:34 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:35.182758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:35.187889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:35.200029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.205850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:35.207082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.219243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:35.717247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:35.734717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b95781d2-10d3-425e-8d0a-14beb4f41cfe tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.556401 Jul 19 20:04:35.750510 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2228/4359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:35 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:35.760970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-93098eb1-522f-48ce-8779-0e76bdee4c42 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:35.779865 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-93098eb1-522f-48ce-8779-0e76bdee4c42 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-93098eb1-522f-48ce-8779-0e76bdee4c42 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/df126cd5-d19f-4afb-a184-77798cd1ed99/action HTTP/1.1 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 15 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: {"os-stop": {}} Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'df126cd5-d19f-4afb-a184-77798cd1ed99', 'body': {'os-stop': {}}} Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:35.808547 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-93098eb1-522f-48ce-8779-0e76bdee4c42 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance df126cd5-d19f-4afb-a184-77798cd1ed99 has no mapping to a cell. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:35.814772 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-93098eb1-522f-48ce-8779-0e76bdee4c42 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/df126cd5-d19f-4afb-a184-77798cd1ed99/action" status: 404 len: 117 microversion: 2.1 time: 0.058901 Jul 19 20:04:35.820380 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2132/4360] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:35 2022] POST /compute/v2.1/servers/df126cd5-d19f-4afb-a184-77798cd1ed99/action => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:04:35.827522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:35.828326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:35.846852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.858121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:35.863575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:35.864249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:36.652731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:36.665903 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a8d6d38-8100-4b0a-860e-05a36e260c31 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.844797 Jul 19 20:04:36.680489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2229/4361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:35 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:36.698640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:36.704441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:36.728184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:36.729112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:36.731574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:36.734536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.172952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:38.181112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80e42e44-a5d8-4a01-bc47-42fad4b94967 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.486858 Jul 19 20:04:38.194358 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2133/4362] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:36 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:38.199226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:38.199760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 49b23e31-9ee9-451a-966f-9cc660e267cb] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:38.231203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/49b23e31-9ee9-451a-966f-9cc660e267cb/action HTTP/1.1 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: {"suspend": {}} Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '49b23e31-9ee9-451a-966f-9cc660e267cb', 'body': {'suspend': {}}} Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:38.241248 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:38.248542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:38.248542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:38.248542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. Jul 19 20:04:38.248542 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:38.269626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 49b23e31-9ee9-451a-966f-9cc660e267cb could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:38.279014 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d68e975d-5a0d-488e-a0bf-595178253c2f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/49b23e31-9ee9-451a-966f-9cc660e267cb/action" status: 404 len: 111 microversion: 2.1 time: 0.076067 Jul 19 20:04:38.286371 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2230/4363] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:38 2022] POST /compute/v2.1/servers/49b23e31-9ee9-451a-966f-9cc660e267cb/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:38.292245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:38.292879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:38.302147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.302649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.303498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.303936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.619227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:38.627923 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bac7903c-bcb7-4b92-9956-3a736a24b3b0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.340256 Jul 19 20:04:38.638955 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2134/4364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:38 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:38.647826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:38.649149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:38.658287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.659165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.660270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.661507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.932332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:38.946832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5aabf029-4a26-4a52-9c93-eb6d977b721f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.302902 Jul 19 20:04:38.948776 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2231/4365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:38 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:38.968886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:38.969684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:38.991423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.991892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:38.992716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:38.993161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.043627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lazy-loading 'flavor' on Instance uuid 0169c16b-f283-4726-a5c8-d94fca5bbcb6 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:39.165837 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d6ee8b3-9d4f-4ed5-a6e4-0cfd23e96111 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.202101 Jul 19 20:04:39.167961 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2135/4366] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:38 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:39.177905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:39.178986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:39.187391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:39.188408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.189670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:39.190508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:39.390688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:39.399602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-941202b0-fec3-4caf-9655-6e9f6aba8662 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1512 microversion: 2.1 time: 0.225784 Jul 19 20:04:39.404928 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2232/4367] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:39 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:40.432309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:40.433310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:40.441525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.442399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.443519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.444124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:40.933611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:40.943831 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-584138d8-932b-43f6-95fe-ac84885dcf2a tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1495 microversion: 2.1 time: 0.523353 Jul 19 20:04:40.948330 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2136/4368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:40 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1495 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:40.978386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:40.979972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:40.994838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:40.997799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.001630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.002093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.080249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lazy-loading 'flavor' on Instance uuid 0169c16b-f283-4726-a5c8-d94fca5bbcb6 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:41.113631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'suspend' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state suspended Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: {"suspend": {}} Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'suspend' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state suspended Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'suspend': {}}} Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 19 20:04:41.125561 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state suspended Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state suspended Jul 19 20:04:41.130288 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:41.141705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'suspend' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state suspended {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:41.142884 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8ac949f-64c5-4246-b37d-c6ee80a1d14d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 148 microversion: 2.1 time: 0.177224 Jul 19 20:04:41.144001 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2233/4369] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:40 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 148 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:04:41.153147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:41.153696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:41.163116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.163854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.164583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.165031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.435887 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-50ba5c5f-d5f1-4283-a396-82181d07735f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 202 len: 0 microversion: 2.1 time: 0.287260 Jul 19 20:04:41.436930 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2137/4370] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:41 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:41.445719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:41.446730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:41.463821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.490767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:41.504318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:41.513060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:42.341228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:42.351731 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-694bd8d1-7ca5-49c6-88a5-d90b3eb89f8b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1501 microversion: 2.1 time: 0.910240 Jul 19 20:04:42.364500 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2234/4371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:41 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1501 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:43.159092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5ba41f9-cd7a-4645-94b4-6e02753c8c08 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Action: 'create', calling method: .version_select at 0x7f23eea3f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2100081686"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:43.403852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:43.404733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:43.418156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.418715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.423327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:43.424195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:43.432961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=86 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:43.928894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5ba41f9-cd7a-4645-94b4-6e02753c8c08 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.688628 Jul 19 20:04:43.929586 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2138/4372] 10.222.0.23 () {60 vars in 1154 bytes} [Tue Jul 19 20:04:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1690 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 19 20:04:43.941652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af97ccec-7721-4a30-91af-cfae3f24f0be tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efd18a60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:44.032360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af97ccec-7721-4a30-91af-cfae3f24f0be tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.094834 Jul 19 20:04:44.033661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2139/4373] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:43 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:44.411815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:44.431471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-662c9bb8-8ae8-4814-aaad-8d83e46d6a3d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1501 microversion: 2.1 time: 1.030988 Jul 19 20:04:44.434005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2235/4374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:43 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1501 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:45.053660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76e3f07e-ffaa-4011-85d8-726433149c2a tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efd1f820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:45.231255 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76e3f07e-ffaa-4011-85d8-726433149c2a tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.188310 Jul 19 20:04:45.232113 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2140/4375] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:45 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:45.461108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:45.462285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:45.508749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:45.515526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:45.516442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:45.516905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.244676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18aa2d72-2041-4a61-ba68-d67b5e0536cc tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efce0b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:46.374771 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-18aa2d72-2041-4a61-ba68-d67b5e0536cc tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 346 microversion: 2.1 time: 0.134202 Jul 19 20:04:46.375549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2141/4376] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:46 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:46.387405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43f7909c-b0cf-4f63-b395-70bc469aba3e tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Action: 'create', calling method: .version_select at 0x7f23efce0430>, body: {"snapshot": {"volume_id": "8643189a-07c3-431e-8cac-69cfba4badbb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-881257915"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:46.812157 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43f7909c-b0cf-4f63-b395-70bc469aba3e tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.429202 Jul 19 20:04:46.812761 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2142/4377] 10.222.0.23 () {60 vars in 1161 bytes} [Tue Jul 19 20:04:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:46.829769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72b0532c-7bc3-47b8-bdfd-b06b33b872f9 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ee9ed0d0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:46.839196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:46.854289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0f5bb6f-55b5-423e-95b9-58f816120da4 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.408203 Jul 19 20:04:46.858271 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2236/4378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:45 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:46.877967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:46.879472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:46.894705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:46.897063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.898221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:46.902469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:46.925427 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72b0532c-7bc3-47b8-bdfd-b06b33b872f9 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.106231 Jul 19 20:04:46.926459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2143/4379] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:46 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:46.936543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-390fc63e-28c5-46d1-b45a-8e9fa61c4cbf tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23eeab4670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:47.056406 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-390fc63e-28c5-46d1-b45a-8e9fa61c4cbf tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.124276 Jul 19 20:04:47.059290 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2144/4380] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 19 20:04:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:47.071134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8dc40f6a-814f-45d4-af57-9b9aa0af4cc3 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ee9edc10>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:47.144091 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8dc40f6a-814f-45d4-af57-9b9aa0af4cc3 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.078703 Jul 19 20:04:47.145278 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2145/4381] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:47 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:47.338415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:47.357208 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bce2f03-e01a-403b-86e3-1734659921c1 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.484046 Jul 19 20:04:47.376670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:47.377335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: b6170c48-1ada-4391-b602-d2eef8f0c13e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:47.388326 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2237/4382] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:46 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:47.393745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/b6170c48-1ada-4391-b602-d2eef8f0c13e/action HTTP/1.1 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 15 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: {"unpause": {}} Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'b6170c48-1ada-4391-b602-d2eef8f0c13e', 'body': {'unpause': {}}} Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:47.396179 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:47.403505 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:47.403505 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:47.403505 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. Jul 19 20:04:47.403505 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:47.405018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance b6170c48-1ada-4391-b602-d2eef8f0c13e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:47.406009 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68e753e2-9201-4d52-9dee-12ad4bd5190b tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/b6170c48-1ada-4391-b602-d2eef8f0c13e/action" status: 404 len: 111 microversion: 2.1 time: 0.034450 Jul 19 20:04:47.406629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2146/4383] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:47 2022] POST /compute/v2.1/servers/b6170c48-1ada-4391-b602-d2eef8f0c13e/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:47.417448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:47.418332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:47.449912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:47.451443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:47.452542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:47.453150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:48.157704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-263c2e5c-81f5-43ec-b8df-6398f77eb3a5 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef6c5670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:48.219875 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-263c2e5c-81f5-43ec-b8df-6398f77eb3a5 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.066996 Jul 19 20:04:48.220461 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2147/4384] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:48 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:48.457411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:48.468831 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-552c9744-8afe-4801-ad0a-63d5da0d525e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 1.055897 Jul 19 20:04:48.503397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2238/4385] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:47 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:48.508362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:48.509163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:48.529576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:48.544801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:48.546327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:48.547070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:48.967080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:48.979231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9436be26-df4e-4b7a-9791-700da055d043 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.475713 Jul 19 20:04:48.989221 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2148/4386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:48 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:49.004137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:49.004939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:49.015670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.016532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.017617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.018553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.063231 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'unpause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: {"unpause": {}} Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: exception: Cannot 'unpause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'unpause': {}}} Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state active. Cannot unpause while the instance is in this state. Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:49.065740 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:49.071818 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:49.071818 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:49.071818 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:49.071818 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:49.071818 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:49.074747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'unpause' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:49.075863 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb007993-5d49-4513-847e-247abd4d894c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 145 microversion: 2.1 time: 0.079526 Jul 19 20:04:49.089053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:49.089053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:49.091217 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2239/4387] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:48 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:04:49.111023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.114813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.115930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.118174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.239969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9dbf936-d25a-4ca2-8ac6-823b838998c0 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23fe109700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:49.317026 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9dbf936-d25a-4ca2-8ac6-823b838998c0 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.087096 Jul 19 20:04:49.322628 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2240/4388] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:49 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:49.575664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:49.576455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:49.616661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.621456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.623585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.624348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.679693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:49.712321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56cdd487-2c76-43b8-8d71-29405908a9e8 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.630354 Jul 19 20:04:49.713630 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2149/4389] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:49 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:49.741292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:49.748794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:49.768887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.771744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:49.772908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:49.777625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.174744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.182515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.183957 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5142e65d-ea8c-4696-8412-fa98dc804e02 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.453609 Jul 19 20:04:50.184672 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2150/4390] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:49 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:50.196116 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0e0737a-f895-4c42-a1d4-66d4e26f2f0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.625567 Jul 19 20:04:50.197534 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2241/4391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:49 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:50.204275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:50.207691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 54322fe6-074d-4821-a589-b81017e27b28] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.217436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. Jul 19 20:04:50.219308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1995289891"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:50.220777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/54322fe6-074d-4821-a589-b81017e27b28/action HTTP/1.1 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 18 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: {"unshelve": null} Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '54322fe6-074d-4821-a589-b81017e27b28', 'body': {'unshelve': None}} Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:50.221688 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:50.226986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 54322fe6-074d-4821-a589-b81017e27b28 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:50.231506 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ef5b654-1c2f-409b-b319-2dcb9a425267 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/54322fe6-074d-4821-a589-b81017e27b28/action" status: 404 len: 111 microversion: 2.1 time: 0.035249 Jul 19 20:04:50.232596 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2151/4392] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:50 2022] POST /compute/v2.1/servers/54322fe6-074d-4821-a589-b81017e27b28/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:50.240429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.242405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.244919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.245306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.246278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.246523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.256622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.257225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.258115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.258648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.533815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:50.541714 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5cc1573-a741-4944-a530-04ae9125d0ab tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.305229 Jul 19 20:04:50.545481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2152/4393] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:50 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:04:50.551918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3177878-e8ec-4560-8ad3-f9139683e5b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f2400a1b820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.606882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3177878-e8ec-4560-8ad3-f9139683e5b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 287 microversion: 2.1 time: 0.058951 Jul 19 20:04:50.613199 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2153/4394] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:50 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:50.627654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.628359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.639888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.644176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.645432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.647444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.717978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-022b2086-3619-4f5e-9d7d-27dce9ced843 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.504175 Jul 19 20:04:50.719459 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2242/4395] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:50 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 20:04:50.731099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8e79bbf-5e29-4a7d-b458-e188c797b1c7 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef8495e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.899402 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8e79bbf-5e29-4a7d-b458-e188c797b1c7 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 202 len: 0 microversion: 2.1 time: 0.178210 Jul 19 20:04:50.904500 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2243/4396] 10.222.0.23 () {58 vars in 1253 bytes} [Tue Jul 19 20:04:50 2022] DELETE /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:50.911077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:50.913737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:50.922262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.923064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:50.924123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:50.924853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.243118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:51.261773 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0fa2e2e5-8648-42ea-b5e4-bdd541c4da8e tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.640728 Jul 19 20:04:51.276695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2154/4397] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:50 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:51.287967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f93cbbd8-7c06-40d2-a678-aea33f4719a2 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef2e1040>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:51.368863 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f93cbbd8-7c06-40d2-a678-aea33f4719a2 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.089432 Jul 19 20:04:51.370160 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2155/4398] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:51 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:51.372107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:51.380908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:51.381162 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f4cfb8a-5326-4550-892e-1c88f18cc76f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.475214 Jul 19 20:04:51.381673 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2244/4399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:50 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:51.384396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:51.406602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:51.409814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:51.419826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.421593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.424029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.425307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.425778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.426566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.427055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.427263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.578685 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Cannot 'unshelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action HTTP/1.1 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 18 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: {"unshelve": null} Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'unshelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'unshelve': None}} Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 in vm_state active. Cannot unshelve while the instance is in this state. Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:51.581194 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 409 to user: Cannot 'unshelve' instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 while it is in vm_state active {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be29efb2-bc74-4354-b94d-9512eacdc2dd tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action" status: 409 len: 146 microversion: 2.1 time: 0.207605 Jul 19 20:04:51.585793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2156/4400] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:04:51 2022] POST /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6/action => generated 146 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:04:51.598301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:51.607283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:51.620411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.620711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.621496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.621926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.678763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lazy-loading 'services' on Instance uuid f2ff0246-0ae3-473a-841a-a4587b9b4043 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:04:51.882067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2651f996-17c4-4f4e-9efe-5374a953dc88 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments/21e856dd-bd36-42ee-89bc-56d3007b122c" status: 202 len: 0 microversion: 2.1 time: 0.481570 Jul 19 20:04:51.900849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2245/4401] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:04:51 2022] DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments/21e856dd-bd36-42ee-89bc-56d3007b122c => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:51.915509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c7f6c98f-0902-4789-8216-925d170df757 req-47cea64e-03b1-45d0-bd82-c1d76036ef47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:51.926016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c7f6c98f-0902-4789-8216-925d170df757 req-47cea64e-03b1-45d0-bd82-c1d76036ef47 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.926575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c7f6c98f-0902-4789-8216-925d170df757 req-47cea64e-03b1-45d0-bd82-c1d76036ef47 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.958120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c7f6c98f-0902-4789-8216-925d170df757 req-47cea64e-03b1-45d0-bd82-c1d76036ef47 service nova] Creating event network-vif-unplugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:04:51.963822 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c7f6c98f-0902-4789-8216-925d170df757 req-47cea64e-03b1-45d0-bd82-c1d76036ef47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053931 Jul 19 20:04:51.969777 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2246/4402] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:51.977368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:51.980092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:51.989815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.993237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:51.994366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:51.996256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.075719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e70ae0c1-65b4-4fbc-b325-e30d5b68febd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104374 Jul 19 20:04:52.076804 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2247/4403] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:51 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:52.318059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:52.327951 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2766879e-5da6-4251-bbe3-cb499a39fa5d tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.734501 Jul 19 20:04:52.341358 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2157/4404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:51 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:52.347090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:52.347720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:52.354957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.357942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.358717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.359179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.381799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aed10913-a512-4911-bd7f-c08179a1af06 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23eea0b700>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:52.421628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aed10913-a512-4911-bd7f-c08179a1af06 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.043599 Jul 19 20:04:52.426520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2158/4405] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:52 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:52.431652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:52.436469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:52.452831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.453591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.454561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:52.455213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:52.466024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:53.181175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:53.196168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6aaff1e3-5fd9-4b72-9f3f-f3757c5aab34 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1686 microversion: 2.1 time: 0.765291 Jul 19 20:04:53.200310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2159/4406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:52 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1686 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:53.213677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:53.218097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:53.231537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:53.239611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.241416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:53.244509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.246400 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9861dbb7-24ba-46ea-ad1d-aa446719d8ed tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.902308 Jul 19 20:04:53.247057 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2248/4407] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:52 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:53.257409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:53.269397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702314020_updated"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:53.279343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 67b88ed7-c3b2-4180-adea-29882ccfb5ae] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:53.293494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/servers/67b88ed7-c3b2-4180-adea-29882ccfb5ae HTTP/1.1 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 81 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702314020_updated"}} Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '67b88ed7-c3b2-4180-adea-29882ccfb5ae', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1702314020_updated'}}} Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 20:04:53.301768 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. Jul 19 20:04:53.306843 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:53.310761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 67b88ed7-c3b2-4180-adea-29882ccfb5ae could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:53.313118 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-157c7ba5-e5e4-46da-bf5c-d680a723ec0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "PUT /compute/v2.1/servers/67b88ed7-c3b2-4180-adea-29882ccfb5ae" status: 404 len: 111 microversion: 2.1 time: 0.054559 Jul 19 20:04:53.313724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2249/4408] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:04:53 2022] PUT /compute/v2.1/servers/67b88ed7-c3b2-4180-adea-29882ccfb5ae => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:04:53.333633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:53.340235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:53.342202 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c7bd5c8-da66-42b8-bf50-1e5a762eb9fd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139425 Jul 19 20:04:53.344450 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2160/4409] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:53 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:53.366820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.371381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:53.376722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.377101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:53.434113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-91bcdf87-7304-4ded-83cb-1e1e934f962c tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f2400a1bca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:53.482220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-91bcdf87-7304-4ded-83cb-1e1e934f962c tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 200 len: 286 microversion: 2.1 time: 0.052379 Jul 19 20:04:53.486440 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2161/4410] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:53 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:53.913357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:53.928788 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8a675a2-858b-42f1-b52e-eeaba69cffd3 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.608665 Jul 19 20:04:53.937433 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2250/4411] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:53 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:53.956675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:53.961307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:53.981338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.987115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:53.989504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:53.991500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.218171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:54.219674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:54.235473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.236804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.237949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.240017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.727127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:54.737217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-94c14d22-a83b-4522-9367-e217b4d4f7db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1686 microversion: 2.1 time: 0.523626 Jul 19 20:04:54.744997 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2251/4412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:54 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1686 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:54.771676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:54.774676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:54.818370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.822581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.831781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:54.834363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:54.903339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:54.919955 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a379c934-8951-424a-8e6f-d55af6903958 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.972732 Jul 19 20:04:54.921491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2162/4413] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:53 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:54.937555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ace7f5e4-a398-40d5-be98-3da7e55d04e1 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f2400a59280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.000557 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76ff86a3-e4ac-493b-a244-0cd41f520101 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251125 Jul 19 20:04:55.002772 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2252/4414] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:54 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:55.020791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ace7f5e4-a398-40d5-be98-3da7e55d04e1 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] HTTP exception thrown: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ace7f5e4-a398-40d5-be98-3da7e55d04e1 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Request method failure captured: Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f HTTP/1.1 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w5aaQQnLlHK2VK6CiIXrsy3QmVC-ZI6EeSBbXLaPdPYKuw0HfMSnHBLiImi-wD4vq4wwT7rPxVAnQB-V3Z_OBrttxjfD1WBEil3PqjALlN9IIh3SA_vp313V7n23gXXW0fedR91QzGZcunDH6y1Rrt6efcu_R9I7dTNjzeovxbeXEQ Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a1c4d426824bd99264b399a954198d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a1c4d426824bd99264b399a954198d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0586c79b8e82407fa7aa6f5a1e764690 Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: method: Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: exception: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '09160045-14ce-4571-bcaf-4fe44d877b3f'} Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. (HTTP 404) (Request-ID: req-cb7fb0a2-4636-4426-8cf6-8d97e99ce2c7) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:04:55.028555 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. Jul 19 20:04:55.033540 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.038035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ace7f5e4-a398-40d5-be98-3da7e55d04e1 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Returning 404 to user: Snapshot 09160045-14ce-4571-bcaf-4fe44d877b3f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:55.038709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46ecb0e4-d9a6-4138-b0f6-041ca3773239 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:55.039558 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ace7f5e4-a398-40d5-be98-3da7e55d04e1 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f" status: 404 len: 111 microversion: 2.1 time: 0.116855 Jul 19 20:04:55.040346 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2163/4415] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:04:54 2022] GET /compute/v2.1/os-snapshots/09160045-14ce-4571-bcaf-4fe44d877b3f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46ecb0e4-d9a6-4138-b0f6-041ca3773239 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: request: PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 HTTP/1.1 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 280 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.048894 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46ecb0e4-d9a6-4138-b0f6-041ca3773239 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:55.053151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46ecb0e4-d9a6-4138-b0f6-041ca3773239 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 400 len: 619 microversion: 2.1 time: 0.041512 Jul 19 20:04:55.058134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f2abb3f-7ca7-4e15-a667-6ae00815adf4 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efce0b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.063015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2253/4416] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Jul 19 20:04:55 2022] PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:04:55.084892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.088992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:55.106118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:55.116497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.120474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.128261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.132400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.298263 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f2abb3f-7ca7-4e15-a667-6ae00815adf4 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 202 len: 0 microversion: 2.1 time: 0.239470 Jul 19 20:04:55.305882 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2164/4417] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:04:55 2022] DELETE /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:04:55.334522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-13cfc0f5-9144-4a5b-a3a6-befb31226b5c tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f2400a598b0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.537403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-13cfc0f5-9144-4a5b-a3a6-befb31226b5c tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.206925 Jul 19 20:04:55.544927 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2165/4418] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:55 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:55.581434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:55.588035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:55.613568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b9a1671-5dfa-422e-bf80-dddfa5bb0ffc tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.538786 Jul 19 20:04:55.613568 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2254/4419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:55 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:55.638864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.639809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:55.653378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=46 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:04:55.655797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.658737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.659937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.663313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.762769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:55.763704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:55.793141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.802105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:55.803838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:55.819974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:57.930855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:57.947855 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3663ff39-3e7b-4ff0-8c52-5665c9058346 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 2.318518 Jul 19 20:04:57.955099 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2166/4420] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:55 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:57.975733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:57.977009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:57.981319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:57.989693 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6a77e45-8599-4e67-81f9-d32cb3c58df5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 2.232130 Jul 19 20:04:57.994508 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2255/4421] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:55 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:58.009056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a88e7bba-2ce7-49ae-b565-a41a9759ab21 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef6915e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:58.013621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.031936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.033237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.033877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.157203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e900535a-c727-4b9c-8a68-ecf05ecb8b4d tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200816 Jul 19 20:04:58.191320 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2167/4422] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:57 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:58.197323 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a88e7bba-2ce7-49ae-b565-a41a9759ab21 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.200107 Jul 19 20:04:58.198412 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2256/4423] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:57 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:58.203413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-86c28c80-bc14-4f99-9b31-a770df595d06 req-bee9d416-d1ba-45c6-997e-184b732d00ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-plugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:58.216353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c205c178-937c-4dff-b4f6-6da34bfa19ac tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c205c178-937c-4dff-b4f6-6da34bfa19ac tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 HTTP/1.1 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 24 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": ""}} Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6', 'body': {'server': {'name': ''}}} Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi '' Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:04:58.233191 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 20:04:58.238137 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:04:58.241434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-86c28c80-bc14-4f99-9b31-a770df595d06 req-bee9d416-d1ba-45c6-997e-184b732d00ba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.243373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c205c178-937c-4dff-b4f6-6da34bfa19ac tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:04:58.246729 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c205c178-937c-4dff-b4f6-6da34bfa19ac tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 400 len: 108 microversion: 2.1 time: 0.053932 Jul 19 20:04:58.247677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-86c28c80-bc14-4f99-9b31-a770df595d06 req-bee9d416-d1ba-45c6-997e-184b732d00ba service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.251149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2168/4424] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:04:58 2022] PUT /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 108 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:04:58.275528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:58.286393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:58.315964 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-86c28c80-bc14-4f99-9b31-a770df595d06 req-bee9d416-d1ba-45c6-997e-184b732d00ba service nova] Creating event network-vif-plugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:04:58.328348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.342174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.343072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:58.343953 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-86c28c80-bc14-4f99-9b31-a770df595d06 req-bee9d416-d1ba-45c6-997e-184b732d00ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133613 Jul 19 20:04:58.344960 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2257/4425] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:04:58.347761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:58.739029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:04:58.753646 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23409010-ddc7-4e28-8933-7a2d75c781ad tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1504 microversion: 2.1 time: 0.498296 Jul 19 20:04:58.754882 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2169/4426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:58 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:04:59.013479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:59.014310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:59.047182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.064220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.067085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.069320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.171176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:59.173280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:04:59.194338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.205520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.216774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:04:59.217382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:04:59.385653 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a1d0e5c-62b1-4fad-a995-b9ca3205eb68 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219639 Jul 19 20:04:59.392053 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2170/4427] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:04:59 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:04:59.407914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e688a1e9-ba97-492f-8546-b8b9b6079cf2 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efce0430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:04:59.797363 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e688a1e9-ba97-492f-8546-b8b9b6079cf2 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.404116 Jul 19 20:04:59.798574 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2171/4428] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:04:59 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:00.018828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:00.045902 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70b8ee43-be5a-490b-854f-fdfbeee0e6a8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.037720 Jul 19 20:05:00.060004 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2258/4429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:04:59 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:00.399934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:00.400922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:00.436948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.437412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.438238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:00.438683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:00.696134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40bd93f1-01d6-4743-bd3a-f81709278867 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.290451 Jul 19 20:05:00.698058 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2172/4430] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:00 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:00.812265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5579fca-30ad-4231-a400-6a22b348a2c6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23efd3a670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:01.080625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:01.081344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:01.117211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.120769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.129191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.136610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.149137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5579fca-30ad-4231-a400-6a22b348a2c6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 200 len: 345 microversion: 2.1 time: 0.341237 Jul 19 20:05:01.149887 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2259/4431] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:05:00 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:01.714970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:01.716060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:01.760085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.761109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.768706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:01.769638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:01.909590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bf1686af-acab-44c6-98be-280ab49b29e7 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200887 Jul 19 20:05:01.913695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2260/4432] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:01 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:02.168221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c481bfc-f300-4940-b86d-de4a100b16b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23eeffbe50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.471177 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-3c481bfc-f300-4940-b86d-de4a100b16b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] HTTP exception thrown: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c481bfc-f300-4940-b86d-de4a100b16b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Request method failure captured: Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb HTTP/1.1 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w5aaQQnLlHK2VK6CiIXrsy3QmVC-ZI6EeSBbXLaPdPYKuw0HfMSnHBLiImi-wD4vq4wwT7rPxVAnQB-V3Z_OBrttxjfD1WBEil3PqjALlN9IIh3SA_vp313V7n23gXXW0fedR91QzGZcunDH6y1Rrt6efcu_R9I7dTNjzeovxbeXEQ Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a1c4d426824bd99264b399a954198d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a1c4d426824bd99264b399a954198d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0586c79b8e82407fa7aa6f5a1e764690 Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8643189a-07c3-431e-8cac-69cfba4badbb'} Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. (HTTP 404) (Request-ID: req-0170ce44-1887-434d-b618-36207345c34a) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:05:02.473919 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c481bfc-f300-4940-b86d-de4a100b16b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Returning 404 to user: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3c481bfc-f300-4940-b86d-de4a100b16b6 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 404 len: 109 microversion: 2.1 time: 0.319116 Jul 19 20:05:02.479226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2261/4433] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:05:02 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:05:02.505492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a7ec9d4-442b-423d-acee-4f5594320c3b tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef966940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.605348 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-1a7ec9d4-442b-423d-acee-4f5594320c3b tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] HTTP exception thrown: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a7ec9d4-442b-423d-acee-4f5594320c3b tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Request method failure captured: Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb HTTP/1.1 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w5aaQQnLlHK2VK6CiIXrsy3QmVC-ZI6EeSBbXLaPdPYKuw0HfMSnHBLiImi-wD4vq4wwT7rPxVAnQB-V3Z_OBrttxjfD1WBEil3PqjALlN9IIh3SA_vp313V7n23gXXW0fedR91QzGZcunDH6y1Rrt6efcu_R9I7dTNjzeovxbeXEQ Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a1c4d426824bd99264b399a954198d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a1c4d426824bd99264b399a954198d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0586c79b8e82407fa7aa6f5a1e764690 Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8643189a-07c3-431e-8cac-69cfba4badbb'} Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. (HTTP 404) (Request-ID: req-ad395a03-7c30-481c-8c73-c15108f3fa52) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:05:02.608116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a7ec9d4-442b-423d-acee-4f5594320c3b tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Returning 404 to user: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1a7ec9d4-442b-423d-acee-4f5594320c3b tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 404 len: 109 microversion: 2.1 time: 0.124112 Jul 19 20:05:02.613483 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2262/4434] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:05:02 2022] DELETE /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:02.620862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e098bd49-817e-431c-b746-95c5a81b2087 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Calling method '.version_select at 0x7f23ef99a5e0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.639232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:02.657989 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc8b7411-a66f-44cc-be25-d1013965d4ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.583403 Jul 19 20:05:02.669170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2173/4435] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:01 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:02.734678 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-e098bd49-817e-431c-b746-95c5a81b2087 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] HTTP exception thrown: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e098bd49-817e-431c-b746-95c5a81b2087 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Request method failure captured: Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb HTTP/1.1 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w5aaQQnLlHK2VK6CiIXrsy3QmVC-ZI6EeSBbXLaPdPYKuw0HfMSnHBLiImi-wD4vq4wwT7rPxVAnQB-V3Z_OBrttxjfD1WBEil3PqjALlN9IIh3SA_vp313V7n23gXXW0fedR91QzGZcunDH6y1Rrt6efcu_R9I7dTNjzeovxbeXEQ Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a1c4d426824bd99264b399a954198d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a1c4d426824bd99264b399a954198d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a1c4d426824bd99264b399a954198d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 23a1c4d426824bd99264b399a954198d Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575295864 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 0586c79b8e82407fa7aa6f5a1e764690 Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575295864-project Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: method: Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: exception: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8643189a-07c3-431e-8cac-69cfba4badbb'} Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. (HTTP 404) (Request-ID: req-77a3da7a-dc0f-4e84-829a-e5ad7fbcb988) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:05:02.737106 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. Jul 19 20:05:02.742721 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:05:02.747500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e098bd49-817e-431c-b746-95c5a81b2087 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] Returning 404 to user: Volume 8643189a-07c3-431e-8cac-69cfba4badbb could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:02.748761 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e098bd49-817e-431c-b746-95c5a81b2087 tempest-VolumesSnapshotsTestJSON-1575295864 tempest-VolumesSnapshotsTestJSON-1575295864-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb" status: 404 len: 109 microversion: 2.1 time: 0.132833 Jul 19 20:05:02.749899 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2263/4436] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 19 20:05:02 2022] GET /compute/v2.1/os-volumes/8643189a-07c3-431e-8cac-69cfba4badbb => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:02.929498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:02.931070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:02.953150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.955328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:02.960288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:02.961993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:03.078163 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-985e9051-a584-4e33-9f55-7963777bcd3f tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154905 Jul 19 20:05:03.087443 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2174/4437] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:02 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:03.700132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:03.700790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:03.729718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:03.733064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:03.736046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:03.742252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:04.098356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:04.100347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:04.141541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:04.146426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:04.150879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:04.155801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:04.322666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef0e491b-9446-4459-abd6-c9a73def1889 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228907 Jul 19 20:05:04.331624 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2175/4438] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:04 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:04.389238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:04.410218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5bbd5e62-c992-4e59-bd73-57c2f2449076 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.711601 Jul 19 20:05:04.415666 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2264/4439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:03 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:05.342054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:05.343068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:05.377054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.377702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.383954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.386756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.434686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:05.435488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:05.461616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.462096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.474362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:05.482362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:05.561838 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad36a3b0-ad73-45e0-a26e-65377994b2e9 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224560 Jul 19 20:05:05.574521 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2176/4440] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:05 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:05.975760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:06.004273 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01f94c56-2d4b-4c07-8d65-742d47367d6a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.574326 Jul 19 20:05:06.005003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2265/4441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:05 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:06.578700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:06.579525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:06.601672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:06.608366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:06.625860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:06.632135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:06.786804 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f5f5233-d0e2-4e94-bbbb-8148d0aab141 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213537 Jul 19 20:05:06.802020 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2177/4442] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:06 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:07.028933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:07.031184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:07.059975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.061205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.062774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.067414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.636016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:07.654271 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5e8029d1-eede-41d3-9b4f-2c8c4793d09e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.631127 Jul 19 20:05:07.661597 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2266/4443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:07 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:07.808742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:07.810789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:07.825662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.826485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.827650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:07.829284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:07.921345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e9ee41f4-d7e6-4fdd-a5a3-58711d53b208 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123982 Jul 19 20:05:07.923971 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2178/4444] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:07 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:08.674548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:08.675988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:08.705821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.706556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.713298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.715527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.938259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:08.940985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:08.979906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.981760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:08.982819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:08.986630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.048027 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4f12a98-5bc8-48fb-95eb-7eeabe2eecb1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114601 Jul 19 20:05:09.049403 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2179/4445] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:05:08 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:05:09.279682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:09.281243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:09.300354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.312703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.318401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.325635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.430248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Cannot 'reboot' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action HTTP/1.1 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 28 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: {"reboot": {"type": "HARD"}} Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'reboot' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '978eae6a-ef19-414a-afdb-571544ed0fed', 'body': {'reboot': {'type': 'HARD'}}} Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 978eae6a-ef19-414a-afdb-571544ed0fed in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:05:09.432329 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 409 to user: Cannot 'reboot' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:09.437438 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65fafb97-622d-4068-9cee-45ee273f0694 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action" status: 409 len: 145 microversion: 2.1 time: 0.158750 Jul 19 20:05:09.438483 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2180/4446] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:09 2022] POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action => generated 145 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:05:09.454553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:09.457711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:09.478407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.479892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.481163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.481615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.589688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Cannot 'rebuild' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action HTTP/1.1 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 65 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: exception: Cannot 'rebuild' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '978eae6a-ef19-414a-afdb-571544ed0fed', 'body': {'rebuild': {'imageRef': '371de3c2-13a8-4290-a544-705d4d9b3f29'}}} Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 978eae6a-ef19-414a-afdb-571544ed0fed in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:05:09.592026 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued Jul 19 20:05:09.597091 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:09.606694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 409 to user: Cannot 'rebuild' instance 978eae6a-ef19-414a-afdb-571544ed0fed while it is in vm_state rescued {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:09.612051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c74548ed-c78d-4efa-a3c7-699d5852c9ab tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action" status: 409 len: 146 microversion: 2.1 time: 0.163365 Jul 19 20:05:09.615936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2181/4447] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:09 2022] POST /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed/action => generated 146 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:05:09.645966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:09.646525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:09.676104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.676565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.687084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:09.693087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:09.760726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:09.766491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:09.786780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cf5eda6-0ab8-45e8-ba02-2149bd00709c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.109613 Jul 19 20:05:09.794700 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2267/4448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:08 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:09.818290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:05:10.142888 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d09fee6-ba92-4f4c-8675-4365050667aa tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 204 len: 0 microversion: 2.1 time: 0.522206 Jul 19 20:05:10.152409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2182/4449] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:09 2022] DELETE /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:10.162243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:10.163588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:10.171325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.181281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:10.185064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.187170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:10.763183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:10.782864 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2266cdb2-b8fc-4c51-8e0b-5a0d93038355 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1689 microversion: 2.1 time: 0.624487 Jul 19 20:05:10.795043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2268/4450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:10 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1689 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:10.812963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:10.813701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:10.835465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.835935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:10.836751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:10.843539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:11.815063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:11.815794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:11.848284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:11.848964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:11.849983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:11.850469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:11.891962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:11.942445 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4cc31f2a-eecd-4d50-a09b-638b81f7ef1f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.125413 Jul 19 20:05:11.963809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2183/4451] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:10 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:12.964186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:12.966295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:12.982356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:12.983264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:12.984305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:12.986444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:13.065071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:13.090574 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8d00237-9bca-4e54-9a9d-62d23a123679 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1689 microversion: 2.1 time: 1.277194 Jul 19 20:05:13.094678 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2269/4452] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:11 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1689 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:13.795793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:13.812381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a44f1978-e44f-4fb8-8038-c6e5521e787e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.853781 Jul 19 20:05:13.813008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2184/4453] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:12 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:14.111494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:14.112116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:14.137985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.139049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.140099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.140775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.249243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:14.249788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:14.268961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.269425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.270218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.270661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.346536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f HTTP/1.1 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '06cf0f38-cb2a-426c-bc07-0c952087121f'} Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:14.352417 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.359864 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.373135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:14.374530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48027bf3-3422-4ae6-9203-6276ee6fabe0 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 404 len: 111 microversion: 2.1 time: 0.129178 Jul 19 20:05:14.377630 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2185/4454] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:14 2022] DELETE /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:14.392148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:14.397056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 06cf0f38-cb2a-426c-bc07-0c952087121f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:14.431674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.432809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.434244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.436166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.468029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f HTTP/1.1 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '06cf0f38-cb2a-426c-bc07-0c952087121f'} Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:14.474275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. Jul 19 20:05:14.478739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:14.484686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 06cf0f38-cb2a-426c-bc07-0c952087121f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:14.489116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb4152f2-8cd8-482a-8947-11c7829cdfea tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f" status: 404 len: 111 microversion: 2.1 time: 0.105121 Jul 19 20:05:14.492163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2186/4455] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:14 2022] GET /compute/v2.1/servers/06cf0f38-cb2a-426c-bc07-0c952087121f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:14.519882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:14.521804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:14.539133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.541757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.545104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.545802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.635043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:05:14.897572 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-14ea5796-3001-4991-82be-9fae2efe0322 tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 204 len: 0 microversion: 2.1 time: 0.389438 Jul 19 20:05:14.900921 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2187/4456] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:14 2022] DELETE /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:14.924890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:14.927629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:14.956510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.959394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:14.962311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:14.965040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:16.275067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:16.292379 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-048735bc-526f-4620-b9af-a183ad22d3c4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.382714 Jul 19 20:05:16.305830 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2188/4457] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:14 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:16.305830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:16.306380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:16.346436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.346893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:16.355821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:16.356696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.848032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:17.857663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd5399c2-3699-4e0d-8b0e-3dd3cdd5930c tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1689 microversion: 2.1 time: 3.751174 Jul 19 20:05:17.868082 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2270/4458] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:14 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1689 bytes in 3752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:17.885150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:17.885798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:17.930265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.933640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:17.934650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:17.938484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:18.491784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:18.535874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-06321221-42f6-4ef4-aaaa-c0c54e8f0a7c tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 2.235994 Jul 19 20:05:18.542707 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2189/4459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:16 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:18.876929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:18.877553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:18.898836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:18.899830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:18.900110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:18.907306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:18.909958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:18.917808 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8e7fcc5-442d-48d8-9473-2799226ba45f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.053584 Jul 19 20:05:18.918684 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2271/4460] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:17 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:19.221365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:19.262973 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-13974367-fa65-437c-ba87-8c9a0193356a tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 200 len: 1621 microversion: 2.1 time: 0.388057 Jul 19 20:05:19.288431 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2190/4461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:18 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 1621 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:19.561094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:19.563283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:19.597304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.598282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.599480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.600112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.641631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0612066e-f0b4-4649-9d59-1c42482509fa req-ce5b60e3-7155-4c40-b222-cc47767fc0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ff0246-0ae3-473a-841a-a4587b9b4043", "name": "network-vif-deleted", "tag": "d3d25924-84f5-4775-846d-169ac6fbbde1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:19.680392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0612066e-f0b4-4649-9d59-1c42482509fa req-ce5b60e3-7155-4c40-b222-cc47767fc0a2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.681138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0612066e-f0b4-4649-9d59-1c42482509fa req-ce5b60e3-7155-4c40-b222-cc47767fc0a2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.731852 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0612066e-f0b4-4649-9d59-1c42482509fa req-ce5b60e3-7155-4c40-b222-cc47767fc0a2 service nova] Creating event network-vif-deleted:d3d25924-84f5-4775-846d-169ac6fbbde1 for instance f2ff0246-0ae3-473a-841a-a4587b9b4043 on n-h2-843834-3 Jul 19 20:05:19.757262 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0612066e-f0b4-4649-9d59-1c42482509fa req-ce5b60e3-7155-4c40-b222-cc47767fc0a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.690930 Jul 19 20:05:19.768170 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2272/4462] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:19.940042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:19.941605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:19.955793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.958523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:19.972932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:19.973685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:20.740345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0a63fe66184144a91ab84dddc628e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69549fd54d64e88bfe7aa3ee41223d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:20.758378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9651efa3-a92a-47ec-ab3b-9c9db76a32cb tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 200 len: 1510 microversion: 2.1 time: 1.204388 Jul 19 20:05:20.775052 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2191/4463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:19 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 1510 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:20.793751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:20.799489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: f2ff0246-0ae3-473a-841a-a4587b9b4043] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:20.859463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:20.876752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:20.885253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:20.885970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:20.973672 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 HTTP/1.1 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'f2ff0246-0ae3-473a-841a-a4587b9b4043'} Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:20.984738 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. Jul 19 20:05:20.990817 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.009711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 404 to user: Instance f2ff0246-0ae3-473a-841a-a4587b9b4043 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:21.009711 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfc33f72-7a9f-4a90-894e-a05299841573 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043" status: 404 len: 111 microversion: 2.1 time: 0.232554 Jul 19 20:05:21.014744 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2192/4464] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:20 2022] GET /compute/v2.1/servers/f2ff0246-0ae3-473a-841a-a4587b9b4043 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:21.053934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e0c3704-9447-445f-bc7c-b70fde76b809 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '.version_select at 0x7f23ef2e1af0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:21.147745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e0c3704-9447-445f-bc7c-b70fde76b809 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735897139" status: 202 len: 0 microversion: 2.1 time: 0.130904 Jul 19 20:05:21.149373 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2193/4465] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735897139 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:21.604640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:21.626063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc1632ac-a0de-4d9a-a801-d06c8dce5962 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.691309 Jul 19 20:05:21.633340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2273/4466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:19 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:21.783051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:21.785857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] [instance: 0169c16b-f283-4726-a5c8-d94fca5bbcb6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:21.803620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:21.813000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:21.818748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:21.819777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:21.883031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] HTTP exception thrown: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. Jul 19 20:05:21.889135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3fcf5acb-d197-4c97-aa6e-58f26d20f21d req-dbc40e89-a7ec-4079-8e6a-0f2740c7cfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0169c16b-f283-4726-a5c8-d94fca5bbcb6", "name": "network-vif-deleted", "tag": "da82cde7-bf7c-4d4a-8fe1-193e153bc368"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Request method failure captured: Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 HTTP/1.1 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w1cZf16vic9afLXjFhYYrP88aooZUFyg8tPGo3dGg_0XIEWP9zXlb0cULLTQGCC-_mWKxzDeLAg9wx7yMWNPEF68ySAV-V3sttt1_hsDsldFhQ5BJkp96kA4jUnVNntwPKMJzvtaEFoe76OBPAN4PbeWo81KUO7Rmx3oz7p13rICjc Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c69549fd54d64e88bfe7aa3ee41223d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c69549fd54d64e88bfe7aa3ee41223d6 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-584400930 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: af0a63fe66184144a91ab84dddc628e2 Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-584400930-project Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '0169c16b-f283-4726-a5c8-d94fca5bbcb6'} Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:21.898423 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] Returning 404 to user: Instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:21.905415 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4254ee8e-81c4-4f39-bbe9-3341b29f9c0f tempest-ServersNegativeTestJSON-584400930 tempest-ServersNegativeTestJSON-584400930-project] 10.222.0.23 "GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6" status: 404 len: 111 microversion: 2.1 time: 0.124745 Jul 19 20:05:21.909189 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2194/4467] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:21 2022] GET /compute/v2.1/servers/0169c16b-f283-4726-a5c8-d94fca5bbcb6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:21.922724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3fcf5acb-d197-4c97-aa6e-58f26d20f21d req-dbc40e89-a7ec-4079-8e6a-0f2740c7cfd4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:21.924824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3fcf5acb-d197-4c97-aa6e-58f26d20f21d req-dbc40e89-a7ec-4079-8e6a-0f2740c7cfd4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:21.974551 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3fcf5acb-d197-4c97-aa6e-58f26d20f21d req-dbc40e89-a7ec-4079-8e6a-0f2740c7cfd4 service nova] Creating event network-vif-deleted:da82cde7-bf7c-4d4a-8fe1-193e153bc368 for instance 0169c16b-f283-4726-a5c8-d94fca5bbcb6 on n-h1-843834-3 Jul 19 20:05:21.995038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3fcf5acb-d197-4c97-aa6e-58f26d20f21d req-dbc40e89-a7ec-4079-8e6a-0f2740c7cfd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109839 Jul 19 20:05:22.002673 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2274/4468] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:22.650498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:22.651190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:22.663696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:22.664160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:22.664961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:22.665474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:23.499333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:23.537859 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb28e3d9-b24e-4d92-a2d7-e6fd01c39f1d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.891826 Jul 19 20:05:23.540985 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2195/4469] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:22 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:24.558879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:24.560218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:24.589855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:24.592038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:24.594079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:24.597278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:25.536748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:25.577023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b32c1268-402e-4c71-b7ee-9328442a4d7a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.022885 Jul 19 20:05:25.580045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2275/4470] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:24 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:26.605128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:26.606683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:26.643471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:26.656083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:26.658880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:26.660516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:26.661137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:29.517888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:29.545233 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-153d9d3e-56a7-4a9e-b4ea-2d989b32faee tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 2.951376 Jul 19 20:05:29.555497 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2196/4471] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:26 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:30.573066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:30.573680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:30.596901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:30.603942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.608522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:30.609517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:30.609981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:30.707446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=86 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:31.374378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:31.390879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57d5253a-2188-4eb4-98e6-c62ebdb5bb3a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.828863 Jul 19 20:05:31.407607 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2276/4472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:30 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:32.417495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:32.418898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:32.435570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:32.437983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:32.438991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:32.442271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:33.214784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:33.225359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf98a1b8-1962-4c0f-8a70-9fced4f4a2e7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 0.816198 Jul 19 20:05:33.228175 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2197/4473] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:32 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:34.247180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:34.248907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:34.270526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.272779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:34.274791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:34.285856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:35.651851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:35.699741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3411d011-51e4-46f7-9071-9e8797712bc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1681 microversion: 2.1 time: 1.457428 Jul 19 20:05:35.700767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2277/4474] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:34 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1681 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:36.724815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:36.726326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:36.754567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:36.756699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:36.757988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:36.763120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.313866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:37.326442 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7dbdf46-de01-4235-b875-b82560818dbe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.605848 Jul 19 20:05:37.327560 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2198/4475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:36 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:37.660203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:37.661492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:37.672799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.674279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:37.675603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:37.676266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:38.120885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:38.135638 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b84ea401-70b8-4534-be53-edc8668382f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.479990 Jul 19 20:05:38.137036 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2278/4476] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:37 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:39.005433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-231454366", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "da70039e-8ef9-4acd-8284-8d00826a7aaf"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:39.279765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] validate_networks() for [('da70039e-8ef9-4acd-8284-8d00826a7aaf', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:05:41.207352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d8ca7e02-7d47-4d63-8b2e-87bd4828f196 req-5a69f0de-a165-4dd9-a04c-f56de1704ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:41.250509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d8ca7e02-7d47-4d63-8b2e-87bd4828f196 req-5a69f0de-a165-4dd9-a04c-f56de1704ef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:41.253878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d8ca7e02-7d47-4d63-8b2e-87bd4828f196 req-5a69f0de-a165-4dd9-a04c-f56de1704ef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:41.311265 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d8ca7e02-7d47-4d63-8b2e-87bd4828f196 req-5a69f0de-a165-4dd9-a04c-f56de1704ef1 service nova] Creating event network-vif-unplugged:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:05:41.334486 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d8ca7e02-7d47-4d63-8b2e-87bd4828f196 req-5a69f0de-a165-4dd9-a04c-f56de1704ef1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.747840 Jul 19 20:05:41.348039 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2279/4477] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:42.563476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:42.573339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:42.599797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.607994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.609845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.613658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.727519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:05:42.728381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:05:42.728638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:05:42.729165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:05:42.731629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:05:42.771755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.772218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.773084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:42.773561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:42.804183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:42.851445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Getting quotas for project 67218bdd44bb4a8a98930da4e23fc4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:05:42.869562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Getting quotas for user a8907832c11842f482f603256733fc94 and project 67218bdd44bb4a8a98930da4e23fc4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:05:42.902390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:05:42.906337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:05:43.061885 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb77dd33-980f-4175-a770-4ba9038e1dc4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.059885 Jul 19 20:05:43.070720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2199/4478] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:05:43.108133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e02e8ae-2b04-4e30-97bb-7c441b0cd6c4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:43.108762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e02e8ae-2b04-4e30-97bb-7c441b0cd6c4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:43.750034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8e02e8ae-2b04-4e30-97bb-7c441b0cd6c4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:43.758823 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e02e8ae-2b04-4e30-97bb-7c441b0cd6c4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1213 microversion: 2.1 time: 0.684734 Jul 19 20:05:43.779816 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2200/4479] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:43 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1213 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:43.937587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:43.954355 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-407e0281-288d-4e51-8a91-e5df27f158b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.395190 Jul 19 20:05:43.966947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2280/4480] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:44.002554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:44.003239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:44.042663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.043227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.046372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:44.047883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:44.781888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc233138-0f95-4805-a6b5-16ca5d68a7b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:44.782790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc233138-0f95-4805-a6b5-16ca5d68a7b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.114460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cc233138-0f95-4805-a6b5-16ca5d68a7b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.168366 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc233138-0f95-4805-a6b5-16ca5d68a7b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1213 microversion: 2.1 time: 0.381966 Jul 19 20:05:45.170902 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2281/4481] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:44 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1213 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:45.243742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:45.259852 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-54407d67-2c13-4fc4-a166-1e961d99ef02 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.273713 Jul 19 20:05:45.269221 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2201/4482] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:43 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:45.299916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:45.301406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:45.346993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.348534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:45.350226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:45.351320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.206023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:46.207147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:46.255852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.257783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.266581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:46.269474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:46.682152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:46.745415 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-066b4b30-17a0-4295-9c3b-fddfd0bc9f1c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1265 microversion: 2.1 time: 0.541137 Jul 19 20:05:46.750470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2202/4483] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:46 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1265 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:47.765119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:47.766542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:47.847604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.849021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.850775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:47.857216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.859623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3c81494-ca30-4b94-80bb-0a02a67cb33b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 2.568070 Jul 19 20:05:47.860729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.862340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2282/4484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:45 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:47.888156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:47.892333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:47.930655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.931838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:47.937246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:47.944551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.160814 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd138408-59a0-4b93-928f-4839130defb9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.284802 Jul 19 20:05:48.163229 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2283/4485] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:47 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:05:48.198054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.203536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.237550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.243264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.250174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.252195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.338751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:05:48.515136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75b9c5a5-328c-45c9-9c30-0f7423b87b8b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 204 len: 0 microversion: 2.1 time: 0.337277 Jul 19 20:05:48.516541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2284/4486] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:48 2022] DELETE /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:48.538249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.541003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.557958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.576394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.580426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.581254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.792860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:48.812455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6ffdad8-0401-4b0f-b6c2-0a1ec5873617 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1271 microversion: 2.1 time: 1.051485 Jul 19 20:05:48.815531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2203/4487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:47 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1271 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:48.846019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:48.849854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:48.879152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.897840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:48.899940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:48.902969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.089621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.098517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a484918e-8d27-415b-87e3-311566877c3d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1670 microversion: 2.1 time: 2.578380 Jul 19 20:05:51.105188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2285/4488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1670 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:51.127837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:51.128946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:51.147340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.148277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.149408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:51.150137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:51.372588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.381480 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35020b6f-635f-446a-b69f-c68978b5d6b5 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1271 microversion: 2.1 time: 0.264190 Jul 19 20:05:51.396689 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2286/4489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:51 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:51.518333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:51.530537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8d6855d-c59c-49d5-acdb-6e77c97cb49b tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1509 microversion: 2.1 time: 2.710988 Jul 19 20:05:51.533341 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2204/4490] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:48 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1509 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:52.125433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:52.126124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:52.145913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.146394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:52.147245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.147692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:52.400205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:52.400829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:52.431684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.432754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:52.440677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.442204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:52.805581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:52.866998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:52.883758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-027a4995-d57e-4974-9dc0-9a2f4f8b7c7c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1271 microversion: 2.1 time: 0.483889 Jul 19 20:05:52.884648 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2205/4491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:52 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1271 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:52.900867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:52.907483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:52.935696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.937633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:52.939114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:52.942250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.019308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.028437 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c181722-4a33-49d0-8e87-60d613d85130 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1670 microversion: 2.1 time: 0.907871 Jul 19 20:05:53.054355 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2287/4492] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:52 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1670 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:53.637627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:53.649084 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-029bab75-84bc-42e4-847e-69c82c1614bd tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 200 len: 1509 microversion: 2.1 time: 0.760909 Jul 19 20:05:53.652657 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2206/4493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:52 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 1509 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:53.799366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-97055ed3-d425-45cc-8585-6ac78b85e47d req-54232785-99b0-4399-8793-de94f0de14d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978eae6a-ef19-414a-afdb-571544ed0fed", "name": "network-vif-deleted", "tag": "d5438201-25cf-4d34-9f7f-fb3dd1108c16"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:53.815794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-97055ed3-d425-45cc-8585-6ac78b85e47d req-54232785-99b0-4399-8793-de94f0de14d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.827647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-97055ed3-d425-45cc-8585-6ac78b85e47d req-54232785-99b0-4399-8793-de94f0de14d4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.862463 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-97055ed3-d425-45cc-8585-6ac78b85e47d req-54232785-99b0-4399-8793-de94f0de14d4 service nova] Creating event network-vif-deleted:d5438201-25cf-4d34-9f7f-fb3dd1108c16 for instance 978eae6a-ef19-414a-afdb-571544ed0fed on n-h1-843834-3 Jul 19 20:05:53.882998 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-97055ed3-d425-45cc-8585-6ac78b85e47d req-54232785-99b0-4399-8793-de94f0de14d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087509 Jul 19 20:05:53.887783 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2288/4494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:05:53.912224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:53.913756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:53.924543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:53.928693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.930677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:53.932699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:53.940346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.046702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:54.050271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:54.064056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.070119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.072046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:54.077731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:54.952415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:54.962019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc46fc7a-4675-490b-ad89-6c458d228b01 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 1.064480 Jul 19 20:05:54.979614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2207/4495] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:53 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:54.994817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:54.996157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 978eae6a-ef19-414a-afdb-571544ed0fed] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.016302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.019805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.020886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.024894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.067215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed HTTP/1.1 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '978eae6a-ef19-414a-afdb-571544ed0fed'} Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:55.068840 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 404 to user: Instance 978eae6a-ef19-414a-afdb-571544ed0fed could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:05:55.075285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f824b91-6bdd-4ecf-b207-e90408f47237 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed" status: 404 len: 111 microversion: 2.1 time: 0.089669 Jul 19 20:05:55.084856 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2208/4496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/978eae6a-ef19-414a-afdb-571544ed0fed => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:05:55.105836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.106349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.127414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.127882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.128681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.135832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.137304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:55.232289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:05:55.396083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:55.410686 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c94aaf80-8e67-424b-8196-db524fad4f12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.368650 Jul 19 20:05:55.411340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2289/4497] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:54 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:55.451223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:55.452324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.485605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.490933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.492116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.494405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.499107 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8872273b-cd04-43e5-be97-9d47f68f2962 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 204 len: 0 microversion: 2.1 time: 0.407545 Jul 19 20:05:55.505107 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2209/4498] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:05:55 2022] DELETE /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:05:55.557391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.569139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.587140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.587399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.593312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.593845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.617093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e01fd63e-6c7d-4f0b-9283-ac62622840b0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 200 len: 322 microversion: 2.1 time: 0.181691 Jul 19 20:05:55.618653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2290/4499] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:05:55 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:55.634044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:55.634754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:55.668299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.668790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:55.674114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:55.674787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.398941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:56.410231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-187f5634-84a8-4282-b83c-c9e4506dfeac tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.894131 Jul 19 20:05:56.424344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2210/4500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:55 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:56.437304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:56.438329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:56.452451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.456468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.457690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.458356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.589269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:56.605862 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16b2d168-1a5b-4eae-ab10-b9dfcebe5afd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.981654 Jul 19 20:05:56.607206 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2291/4501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:55 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:56.644512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:56.646511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:56.665735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.667511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.672058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:56.672911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:56.920826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:56.935313 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-839072db-14d8-4886-b1fe-1d136072a700 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 0.506591 Jul 19 20:05:56.935978 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2211/4502] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:56 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:57.081323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:57.092999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:57.101189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0eb31197-b7d4-4013-bc91-d5ec02b0e8e3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.467707 Jul 19 20:05:57.105798 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2292/4503] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:56 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:05:57.136473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:57.137175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:57.139566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:05:57.155040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.155498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.156287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.156737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.442269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:57.442810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:57.469016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.469471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:57.470394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:57.470868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.193703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.205690 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09a450e4-dd02-4759-8a2d-73cc79ff7dcb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.076864 Jul 19 20:05:58.215215 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2212/4504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:57 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:58.228723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.229595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.244461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.245222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.246190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.246792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.364065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.381431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0f420ee-d85d-44fc-977d-644ed259a2d1 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1522 microversion: 2.1 time: 0.943954 Jul 19 20:05:58.395467 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2293/4505] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:57 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1522 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:58.406713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:58.409245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:58.433511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.434230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.435112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.435613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.842807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:58.852177 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ea8b9665-1a1e-417e-b44a-4ea0048a52d2 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 0.635429 Jul 19 20:05:58.866700 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2213/4506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:58.878177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5af25088-9ca1-4665-ab4e-c0518e290c55 req-f65ff049-cba5-486e-904e-b621d57c20ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb807992-57f1-4453-bd4a-f1d2e3c74e2f", "tag": "e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:58.917720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5af25088-9ca1-4665-ab4e-c0518e290c55 req-f65ff049-cba5-486e-904e-b621d57c20ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:58.918192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5af25088-9ca1-4665-ab4e-c0518e290c55 req-f65ff049-cba5-486e-904e-b621d57c20ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:58.952343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5af25088-9ca1-4665-ab4e-c0518e290c55 req-f65ff049-cba5-486e-904e-b621d57c20ad service nova] Creating event network-changed:e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51 for instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f on n-h2-843834-3 Jul 19 20:05:58.964147 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5af25088-9ca1-4665-ab4e-c0518e290c55 req-f65ff049-cba5-486e-904e-b621d57c20ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092767 Jul 19 20:05:58.966678 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2214/4507] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:05:59.190613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:59.203881 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a966c8b0-9e35-41cb-8eb7-e839a130fa5c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.805297 Jul 19 20:05:59.205541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2294/4508] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:58 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:59.401835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:05:59.402520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:05:59.428630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.433172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.436355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:05:59.437063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:05:59.767224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0810747a1c58432f9cf6c0731051a2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f9b3fcdb224a3488545c596d4e9746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:05:59.788338 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ec715a05-8cc7-427c-a72e-92443233548e tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 200 len: 1306 microversion: 2.1 time: 0.384909 Jul 19 20:05:59.790982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2295/4509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:05:59 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 1306 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:05:59.807560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1752941840", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1e5d8cfc-4319-48ca-95d7-3aa27f475ae1"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:05:59.987228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] validate_networks() for [('1e5d8cfc-4319-48ca-95d7-3aa27f475ae1', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:06:00.035288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3b488017-0030-44fd-989a-3b6a4e23ca25 req-da3f55e9-87e6-4615-977c-6a0fc71c921e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8813ef55-e645-4822-8578-e953516d4ade", "name": "network-vif-deleted", "tag": "20db4582-8aca-425f-896d-86435e1fcb11"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:00.065810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3b488017-0030-44fd-989a-3b6a4e23ca25 req-da3f55e9-87e6-4615-977c-6a0fc71c921e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.068558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3b488017-0030-44fd-989a-3b6a4e23ca25 req-da3f55e9-87e6-4615-977c-6a0fc71c921e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.095286 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3b488017-0030-44fd-989a-3b6a4e23ca25 req-da3f55e9-87e6-4615-977c-6a0fc71c921e service nova] Creating event network-vif-deleted:20db4582-8aca-425f-896d-86435e1fcb11 for instance 8813ef55-e645-4822-8578-e953516d4ade on n-h2-843834-3 Jul 19 20:06:00.103134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3b488017-0030-44fd-989a-3b6a4e23ca25 req-da3f55e9-87e6-4615-977c-6a0fc71c921e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.729462 Jul 19 20:06:00.104528 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2215/4510] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:00.115762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.116820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:00.126168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.127054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.128438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.129202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.643635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:00.659735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5965f848-4147-443c-8115-25534cfc8052 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 0.553437 Jul 19 20:06:00.675267 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2216/4511] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:00 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:00.805505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:00.806357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] [instance: 8813ef55-e645-4822-8578-e953516d4ade] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:00.823199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.823606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.824503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:00.824945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:00.862168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] HTTP exception thrown: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Request method failure captured: Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade HTTP/1.1 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w0xEuZVdlVPjcEf3oPfgz5ygGli848tv_P8yQlaKbYzCuyBbpX57V-xU-vTPwowBQrQH7J9pFDLchNvrfdQS0DC44-gsUQagVTS4nigphMcE3rMSuEl4MHcug8ekxEzT9-loPAb4L9fBHgzqAesk0N1ekRacrAlUL8hfl0-LrsOh2o Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f9b3fcdb224a3488545c596d4e9746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d3f9b3fcdb224a3488545c596d4e9746 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1809449337 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 0810747a1c58432f9cf6c0731051a2c3 Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1809449337-project Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8813ef55-e645-4822-8578-e953516d4ade'} Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:00.864195 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. Jul 19 20:06:00.868621 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:00.876338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] Returning 404 to user: Instance 8813ef55-e645-4822-8578-e953516d4ade could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:00.877486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfbca7f4-5ba2-4a3e-a86d-a5ba027e8973 tempest-ServerRescueNegativeTestJSON-1809449337 tempest-ServerRescueNegativeTestJSON-1809449337-project] 10.222.0.23 "GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade" status: 404 len: 111 microversion: 2.1 time: 0.076132 Jul 19 20:06:00.878586 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2217/4512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:00 2022] GET /compute/v2.1/servers/8813ef55-e645-4822-8578-e953516d4ade => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:06:01.683767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:01.685000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:01.708916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.709509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.712202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:01.716145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:01.795098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:02.940508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:02.952589 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ad08f39-120b-4c73-81d2-3121be1aaa0c tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 1.274987 Jul 19 20:06:02.955866 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2218/4513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:01 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:03.356096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:06:03.356969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:06:03.357860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:06:03.358869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:06:03.360331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:06:03.364351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:03.396730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.397898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.400073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.401292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.471002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:03.507116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:03.563088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:06:03.579301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:06:03.722459 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62d5bd38-3ecc-4052-ab19-3e2f0222e96b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.928944 Jul 19 20:06:03.746261 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2296/4514] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:06:03.756033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9be4b1fb-cdc8-4dff-87f0-5af537edefd0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:03.756981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9be4b1fb-cdc8-4dff-87f0-5af537edefd0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:03.974406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:03.975092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:03.994678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.995424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:03.997730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:03.998194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:04.124719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9be4b1fb-cdc8-4dff-87f0-5af537edefd0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:04.160658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9be4b1fb-cdc8-4dff-87f0-5af537edefd0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1215 microversion: 2.1 time: 0.405979 Jul 19 20:06:04.165288 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2219/4515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:03 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:04.434423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:04.447973 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-795960c8-0d39-4cbe-9963-a71d6acd9047 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 0.479125 Jul 19 20:06:04.449212 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2297/4516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:03 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:05.194250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:05.195677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:05.239306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.241244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.244747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.245947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.482209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:05.483663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:05.502741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:05.538218 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21d66e40-9d8f-42e9-a608-81d7017f40ab tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1211 microversion: 2.1 time: 0.351450 Jul 19 20:06:05.544266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.563033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:05.563577 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2220/4517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:05 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1211 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:05.563764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:05.563764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.156232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-71d24e01-f63c-46a2-bea4-913cccb34c9d req-9dacbb1b-3c63-48e5-ac80-28b362b0b559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb807992-57f1-4453-bd4a-f1d2e3c74e2f", "name": "network-vif-plugged", "status": "completed", "tag": "e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:06.220793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-71d24e01-f63c-46a2-bea4-913cccb34c9d req-9dacbb1b-3c63-48e5-ac80-28b362b0b559 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.221812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-71d24e01-f63c-46a2-bea4-913cccb34c9d req-9dacbb1b-3c63-48e5-ac80-28b362b0b559 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.307583 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-71d24e01-f63c-46a2-bea4-913cccb34c9d req-9dacbb1b-3c63-48e5-ac80-28b362b0b559 service nova] Creating event network-vif-plugged:e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51 for instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f on n-h2-843834-3 Jul 19 20:06:06.341638 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-71d24e01-f63c-46a2-bea4-913cccb34c9d req-9dacbb1b-3c63-48e5-ac80-28b362b0b559 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191857 Jul 19 20:06:06.351399 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2221/4518] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:06:06.585097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:06.590419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:06.625213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.640155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:06.641060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.646375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:06.651042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:06.675283 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35702817-6fca-42a9-8711-e4a9e464f1b3 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 1.203471 Jul 19 20:06:06.701616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2298/4519] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:05 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:07.269254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:07.285298 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b13107e0-ede3-41bd-970e-c1108a5c6418 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1273 microversion: 2.1 time: 0.707652 Jul 19 20:06:07.295653 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2222/4520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:06 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1273 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:07.715266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:07.716611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:07.739050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.741155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:07.745119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:07.748091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.318166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:08.319459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:08.348442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.352129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:08.360665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:08.361749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:09.240129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:09.256748 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c55590e4-94ad-47b0-98a9-25838ef24608 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1313 microversion: 2.1 time: 1.551151 Jul 19 20:06:09.261108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2299/4521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:07 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1313 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:09.645015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:09.670518 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-917c3bd7-6d0e-4a38-9e45-e595722f3be3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 1.360174 Jul 19 20:06:09.671170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2223/4522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:08 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:10.284287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:10.285823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:10.308725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.312047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.317377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.320915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.697798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:10.698745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:10.733845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.735992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:10.741776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:10.742495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:12.601646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:12.618300 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62ec31c7-b191-4dc7-ba93-f1e6629e156b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1497 microversion: 2.1 time: 2.343023 Jul 19 20:06:12.622010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2300/4523] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:10 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1497 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:13.399432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:13.409878 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2180261a-5310-4a6a-a8d9-08992a122290 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 2.720479 Jul 19 20:06:13.422877 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2224/4524] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:10 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:14.237616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:14.257696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2a6747f7-a2c2-4fbd-b37c-4ff647d2321b req-c2bc39e5-a7e0-4f29-a48e-d4a96490160a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c90c01-5f7c-41eb-8bc4-1c64251a40d1", "tag": "93b8a268-a817-4b32-8e2a-344593e8cd1b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:14.264057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:14.293675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:14.299617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:14.311585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.312422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.313880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.314672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.324281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:14.337541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2a6747f7-a2c2-4fbd-b37c-4ff647d2321b req-c2bc39e5-a7e0-4f29-a48e-d4a96490160a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.337992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2a6747f7-a2c2-4fbd-b37c-4ff647d2321b req-c2bc39e5-a7e0-4f29-a48e-d4a96490160a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.392263 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2a6747f7-a2c2-4fbd-b37c-4ff647d2321b req-c2bc39e5-a7e0-4f29-a48e-d4a96490160a service nova] Creating event network-changed:93b8a268-a817-4b32-8e2a-344593e8cd1b for instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 on n-h1-843834-3 Jul 19 20:06:14.408642 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2a6747f7-a2c2-4fbd-b37c-4ff647d2321b req-c2bc39e5-a7e0-4f29-a48e-d4a96490160a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162200 Jul 19 20:06:14.415794 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2225/4525] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:14.458449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:14.460662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:14.488276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.502736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.511113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:14.512329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:14.512801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:14.964161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb0d111a-efe6-438a-924d-8e8a2b1e012e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 204 len: 0 microversion: 2.1 time: 0.737962 Jul 19 20:06:14.966517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2301/4526] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:14 2022] DELETE /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:15.068696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:15.070136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:15.102577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.103190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.104017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:15.104466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:15.947889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.006953 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84fcaa44-ce1c-4803-8412-fbbb42ddb4a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 1.546456 Jul 19 20:06:16.013291 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2226/4527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:14 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:16.555705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:16.584388 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb15388b-08df-4fa6-9354-00016d300a6a tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1503 microversion: 2.1 time: 1.557434 Jul 19 20:06:16.585417 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2302/4528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:14 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1503 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:17.051068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:17.053355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:17.156648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.157880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.159690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.160766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.666877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:17.673451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:17.746076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.757066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:17.760838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:17.766150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:18.926270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:18.943149 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-706f92a0-8c0d-4aae-b986-82dbe4c58424 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 1.903663 Jul 19 20:06:18.943418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:18.956876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2227/4529] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:17 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:18.962189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c53e2033-11f3-45ae-8577-d23b7a4aef7b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1503 microversion: 2.1 time: 1.358180 Jul 19 20:06:18.972167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2303/4530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:17 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1503 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:19.983632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:19.984730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:19.984730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:19.987288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:20.005081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.010900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.016016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.016770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.019981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.020856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.025044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:20.027587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:20.861571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.876049 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb313ea2-c716-418e-8f95-5c469356a5e9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 0.901195 Jul 19 20:06:20.876666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2228/4531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:19 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:20.909166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:20.931608 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9303afe-ee16-4f50-8f50-1d2b06fa84fa tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1503 microversion: 2.1 time: 0.951427 Jul 19 20:06:20.948844 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2304/4532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:19 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1503 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:21.086033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-29ac9ead-6176-4b04-8706-4cb2b698ebee req-c3e60e42-f88e-4b75-998c-417243bc73ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb807992-57f1-4453-bd4a-f1d2e3c74e2f", "name": "network-vif-deleted", "tag": "e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:21.111600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-29ac9ead-6176-4b04-8706-4cb2b698ebee req-c3e60e42-f88e-4b75-998c-417243bc73ab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.112760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-29ac9ead-6176-4b04-8706-4cb2b698ebee req-c3e60e42-f88e-4b75-998c-417243bc73ab service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.146213 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-29ac9ead-6176-4b04-8706-4cb2b698ebee req-c3e60e42-f88e-4b75-998c-417243bc73ab service nova] Creating event network-vif-deleted:e5e59bb2-ecc5-46d8-b0d8-98a3d6309f51 for instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f on n-h2-843834-3 Jul 19 20:06:21.164378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-29ac9ead-6176-4b04-8706-4cb2b698ebee req-c3e60e42-f88e-4b75-998c-417243bc73ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081037 Jul 19 20:06:21.168642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2229/4533] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:21.901062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:21.904729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.922505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.924441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.927262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:21.928661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:21.957885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:21.969437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:21.999566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:22.006147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:22.012804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:22.014779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:22.086156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:22.090133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:22.090133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lazy-loading 'fault' on Instance uuid bb807992-57f1-4453-bd4a-f1d2e3c74e2f {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:06:22.197726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:22.230535 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb6302ad-548d-4563-91a4-63eabb1e9c81 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 200 len: 1303 microversion: 2.1 time: 0.280300 Jul 19 20:06:22.234439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2230/4534] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:21 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:22.488950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:22.544314 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4191bf6c-d57b-4841-b5cb-2b2f1456b968 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 0.648820 Jul 19 20:06:22.547234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2305/4535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:21 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:23.252704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:23.254025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: bb807992-57f1-4453-bd4a-f1d2e3c74e2f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:23.272490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.273163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.278401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.279739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.311791 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] HTTP exception thrown: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Request method failure captured: Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f HTTP/1.1 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w6M0O474Sqr5WM-tq8Bby73EDv99OF8rnfO5CY2f1suGS43pplqiK9QZNQd2g427GjyDZTCih1JUmN57dAykHq_SZ0VaEBzaVXfc4Qb6yK01NfcmFBSxzQ5TkEaPVPySbWZKQSc9vti0tIr63rpxNoxuelFzYFCw1CDFFKuoNySOHA Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 67218bdd44bb4a8a98930da4e23fc4c9 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesActionsTest-986281977 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesActionsTest-986281977 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 67218bdd44bb4a8a98930da4e23fc4c9 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesActionsTest-986281977 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesActionsTest-986281977-project Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a8907832c11842f482f603256733fc94 Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesActionsTest-986281977-project Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bb807992-57f1-4453-bd4a-f1d2e3c74e2f'} Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:23.313725 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. Jul 19 20:06:23.321186 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:06:23.323524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Returning 404 to user: Instance bb807992-57f1-4453-bd4a-f1d2e3c74e2f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:23.324951 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c3f4ca0-546c-46f3-9dcd-ddefb8b9c66d tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f" status: 404 len: 111 microversion: 2.1 time: 0.076964 Jul 19 20:06:23.325750 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2231/4536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:23 2022] GET /compute/v2.1/servers/bb807992-57f1-4453-bd4a-f1d2e3c74e2f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:23.571152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:23.571976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:23.584276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.585957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.587952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:23.588709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:23.757361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1015809357", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "da70039e-8ef9-4acd-8284-8d00826a7aaf"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:23.889180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] validate_networks() for [('da70039e-8ef9-4acd-8284-8d00826a7aaf', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:06:24.227268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:24.238843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8cc83c66-2167-4493-b342-cc77a77127f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 0.677048 Jul 19 20:06:24.240119 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2306/4537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:23 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:24.554029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-23a0493d-85e7-42a6-99f8-b87b42d2f29f req-f1bfb1b7-f456-40e0-a13d-448df44eea3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c90c01-5f7c-41eb-8bc4-1c64251a40d1", "name": "network-vif-plugged", "status": "completed", "tag": "93b8a268-a817-4b32-8e2a-344593e8cd1b"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:24.580129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-23a0493d-85e7-42a6-99f8-b87b42d2f29f req-f1bfb1b7-f456-40e0-a13d-448df44eea3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:24.585102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-23a0493d-85e7-42a6-99f8-b87b42d2f29f req-f1bfb1b7-f456-40e0-a13d-448df44eea3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:24.633487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-23a0493d-85e7-42a6-99f8-b87b42d2f29f req-f1bfb1b7-f456-40e0-a13d-448df44eea3e service nova] Creating event network-vif-plugged:93b8a268-a817-4b32-8e2a-344593e8cd1b for instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 on n-h1-843834-3 Jul 19 20:06:24.665308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-23a0493d-85e7-42a6-99f8-b87b42d2f29f req-f1bfb1b7-f456-40e0-a13d-448df44eea3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112673 Jul 19 20:06:24.666026 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2307/4538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:25.263927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:25.267062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:25.292634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:25.293853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:25.297660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:25.299413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:25.905810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:06:25.906638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:06:25.907512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:06:25.908448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:06:25.909057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:06:25.957801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:25.958509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:25.959903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:25.960730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:26.078152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:26.096767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Getting quotas for project 67218bdd44bb4a8a98930da4e23fc4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:26.111216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51c14b07-90bb-4dfc-84ee-44655ca4376a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 0.856961 Jul 19 20:06:26.115244 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2308/4539] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:25 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:26.139858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Getting quotas for user a8907832c11842f482f603256733fc94 and project 67218bdd44bb4a8a98930da4e23fc4c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:26.203763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:06:26.211834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:06:26.351051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b09e53c-f8a3-4bf2-ab2d-195c32164bf1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.631749 Jul 19 20:06:26.355509 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2232/4540] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:06:26.364566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0fd301fe-0959-4c4f-a4ff-de77b78357fe tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:26.365283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0fd301fe-0959-4c4f-a4ff-de77b78357fe tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:26.490315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0fd301fe-0959-4c4f-a4ff-de77b78357fe tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:26.512548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0fd301fe-0959-4c4f-a4ff-de77b78357fe tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1214 microversion: 2.1 time: 0.152175 Jul 19 20:06:26.528653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2309/4541] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:26 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:27.156707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:27.171732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:27.242898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.243780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.252502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.255903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.558319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:27.565535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:27.600862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.601756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.602877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:27.603633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:27.612546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:28.013678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:28.025299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b3ccd7f-1202-4839-bfbc-14a36cb3dde1 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1210 microversion: 2.1 time: 0.490279 Jul 19 20:06:28.034817 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2310/4542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:27 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1210 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:28.274721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:28.284109 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-060f9c73-8c03-4e8d-bb20-ce9b511f9664 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1315 microversion: 2.1 time: 1.142251 Jul 19 20:06:28.297456 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2233/4543] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:27 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:29.051426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:29.055021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:29.103659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.114130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.120246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.124442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.343176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:29.345301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:29.363677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:29.382159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:29.387240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.388470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.391405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:29.393053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:29.402645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca89dd99-aae7-407c-9e09-e8981b255437 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1272 microversion: 2.1 time: 0.361148 Jul 19 20:06:29.406634 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2311/4544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:29 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:30.189607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:30.227585 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81217aa4-80f7-4b48-8a49-2cf2965d6bc2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1502 microversion: 2.1 time: 0.921302 Jul 19 20:06:30.231446 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2234/4545] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:29 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1502 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:30.260543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98cd24ea-d768-4462-8d01-a8244b66a511 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:30.277532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98cd24ea-d768-4462-8d01-a8244b66a511 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.288772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98cd24ea-d768-4462-8d01-a8244b66a511 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.355134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98cd24ea-d768-4462-8d01-a8244b66a511 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Going to try to stop instance {{(pid=131229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:06:30.434728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:30.435735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:30.464641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.466740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.472537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.476988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.492523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98cd24ea-d768-4462-8d01-a8244b66a511 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1/action" status: 202 len: 0 microversion: 2.1 time: 0.238328 Jul 19 20:06:30.495111 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2312/4546] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:30 2022] POST /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:06:30.514852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:30.516323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:30.533854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.535608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:30.537463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:30.538156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:31.542533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:31.573097 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09e085e0-b050-47a2-a0ce-45f8c6509a88 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1272 microversion: 2.1 time: 1.144647 Jul 19 20:06:31.576079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2235/4547] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:30 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1272 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:31.707572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:31.730518 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-70fa809e-5b3c-4002-9ec4-e6ee1a398581 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.229909 Jul 19 20:06:31.737925 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2313/4548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:30 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:32.603945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:32.604727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:32.616714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.620565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.624579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.634390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.646262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=82 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:32.766162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:32.768033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:32.793264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.793790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:32.794882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:32.796101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:33.872580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:33.905370 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6042f6d2-9712-4516-8ffd-f68bad555726 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 1.302619 Jul 19 20:06:33.910022 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2236/4549] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:32 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:34.004968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:34.030308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f3e82de-d488-4301-85d1-f4771deb493d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.266498 Jul 19 20:06:34.034212 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2314/4550] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:32 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:34.931347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:34.932813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:34.967617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.983303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:34.985220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:34.991262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.056409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:35.057260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:35.061369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:35.091833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.092422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.093396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:35.093858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:35.942925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:35.984721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce8b8f07-3cde-480b-a128-674f67b5964e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 1.058448 Jul 19 20:06:36.003523 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2237/4551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:34 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:36.021357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0685fe45-79df-47f4-b29e-d7e34e87d61e req-5a185e6e-78f9-474e-acc0-d0d0c3850cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9", "tag": "b4386eb8-52cd-4d02-8b3d-e04e2a00719a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:36.038240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:36.063710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0685fe45-79df-47f4-b29e-d7e34e87d61e req-5a185e6e-78f9-474e-acc0-d0d0c3850cdc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:36.071800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0685fe45-79df-47f4-b29e-d7e34e87d61e req-5a185e6e-78f9-474e-acc0-d0d0c3850cdc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:36.101419 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0685fe45-79df-47f4-b29e-d7e34e87d61e req-5a185e6e-78f9-474e-acc0-d0d0c3850cdc service nova] Creating event network-changed:b4386eb8-52cd-4d02-8b3d-e04e2a00719a for instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 on n-h2-843834-3 Jul 19 20:06:36.127789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0685fe45-79df-47f4-b29e-d7e34e87d61e req-5a185e6e-78f9-474e-acc0-d0d0c3850cdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113465 Jul 19 20:06:36.140802 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2238/4552] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:36.257987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:36.271908 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f71d9d69-46e0-47ef-9e0a-b96e8e0a963a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.221389 Jul 19 20:06:36.276146 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2315/4553] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:35 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:37.013388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:37.019336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:37.022842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:37.057428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.058199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.059529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.075808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.295453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:37.296410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:37.320223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:37.331321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.332132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:37.337815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:37.338895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:38.115214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:38.131031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d01d1ee-87c0-43f7-9a0d-116d8339ae24 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 0.843721 Jul 19 20:06:38.133712 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2316/4554] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:37 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:38.197363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:38.221316 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-495d6599-369a-48bc-8b11-8a5299bf6bdd tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 1.214738 Jul 19 20:06:38.226284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2239/4555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:37 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:39.156935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:39.159077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:39.215796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.216420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.217350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.217854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.246646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:39.247497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:39.302002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.302591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.311603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:39.320452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:39.992459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:40.018023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fabbe0a1-ae76-4337-9001-08e8a42f8b57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 0.870134 Jul 19 20:06:40.023717 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2317/4556] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:39 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:40.216079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:40.230249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90a7f5ad-e5ba-438f-a569-5a087cfd3e10 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 0.991335 Jul 19 20:06:40.231622 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2240/4557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:39 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:41.044139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:41.046074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:41.076981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.087717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.094797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.096123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.249758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:41.250302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:41.272476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.272969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:41.273874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:41.274320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:42.104373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:42.115028 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4640b161-5270-45d8-af25-1396928fdd53 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 0.869946 Jul 19 20:06:42.120123 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2241/4558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:41 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:42.437528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:42.469163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3aeda37-c976-44e6-a575-6d4099183b77 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.430494 Jul 19 20:06:42.470008 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2318/4559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:41 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:43.150081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.151804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.165207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.166362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.167997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.168748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.489169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:43.491384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:43.543942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.545528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:43.548318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:43.558129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.377400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:44.424475 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1076d7ed-165c-420a-9e06-63a4221ecd61 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 0.941095 Jul 19 20:06:44.434072 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2319/4560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:44.453527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-47c0412f-1be7-4c39-b6d0-bf4b50d45402 req-b2354107-551e-40f7-bd70-974c13851d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9", "name": "network-vif-plugged", "status": "completed", "tag": "b4386eb8-52cd-4d02-8b3d-e04e2a00719a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:44.477655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-47c0412f-1be7-4c39-b6d0-bf4b50d45402 req-b2354107-551e-40f7-bd70-974c13851d9c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:44.485649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-47c0412f-1be7-4c39-b6d0-bf4b50d45402 req-b2354107-551e-40f7-bd70-974c13851d9c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:44.548551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:44.562218 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-47c0412f-1be7-4c39-b6d0-bf4b50d45402 req-b2354107-551e-40f7-bd70-974c13851d9c service nova] Creating event network-vif-plugged:b4386eb8-52cd-4d02-8b3d-e04e2a00719a for instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 on n-h2-843834-3 Jul 19 20:06:44.581365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-47c0412f-1be7-4c39-b6d0-bf4b50d45402 req-b2354107-551e-40f7-bd70-974c13851d9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145017 Jul 19 20:06:44.582153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2320/4561] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:44.589097 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4fad4d8c-eee4-4d69-95eb-8f61733bd72e tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 1.444699 Jul 19 20:06:44.598172 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2242/4562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:43 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:45.488875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.498658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.581553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.586799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.593633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.599398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.626833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:45.628533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:45.643796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.647474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:45.648700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:45.650338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:46.340422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:46.367678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ceed0239-b7d1-4ee0-99b3-3a28fbbff7ca tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1314 microversion: 2.1 time: 0.748473 Jul 19 20:06:46.368627 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2243/4563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:46.574882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:46.638879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af0e6dec-8926-41b7-a747-59301c0ee37d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.185103 Jul 19 20:06:46.677173 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2321/4564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:45 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:47.388908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.389975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:47.452818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.453546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.454900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.465543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.714502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:47.716959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:47.737593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.737593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:47.737874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:47.755052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:48.130982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.163869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3f003f3-a69a-4680-9d54-e94ede8b83d4 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1498 microversion: 2.1 time: 0.773512 Jul 19 20:06:48.164744 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2244/4565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:47 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1498 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:48.254037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:48.270979 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60bfa95d-112a-406c-91d3-044c2c1d522d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 0.568388 Jul 19 20:06:48.279673 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2322/4566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:47 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:49.318010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:49.325899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:49.399198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.415105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.418004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:49.423502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:49.972932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:49.974853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.007527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.019627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.021025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.028318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.200799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:06:50.296198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:50.315455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1020964d-adc4-475e-8642-3cd975fc1f5b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.009871 Jul 19 20:06:50.317298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2245/4567] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:49 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:50.655259 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b7274e5-93b6-4e9a-b25b-fde1d13caf68 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "DELETE /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 204 len: 0 microversion: 2.1 time: 0.681850 Jul 19 20:06:50.656226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2323/4568] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:06:49 2022] DELETE /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:06:50.669295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:50.671077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:50.693567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.695537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:50.716029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:50.719359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:51.340392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:51.341350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:51.359168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.370879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:51.373421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:51.378486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:52.567961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:52.582941 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd8291cb-85c6-4e62-b371-ca3a5bacdb32 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1504 microversion: 2.1 time: 1.920817 Jul 19 20:06:52.604917 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2246/4569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:50 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1504 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:52.748078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:52.755161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:52.777355 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e4825dc-903d-4b84-b3ae-ab242bb2cbd7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.443246 Jul 19 20:06:52.791899 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2324/4570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:51 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:53.624281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:53.625574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:53.640954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.666691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.667759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:53.668230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:53.809325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-387459601", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:53.942063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:06:54.104234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8907832c11842f482f603256733fc94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67218bdd44bb4a8a98930da4e23fc4c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:54.165012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12ff690a-0f04-49dc-aeef-964960718476 tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 200 len: 1462 microversion: 2.1 time: 0.541116 Jul 19 20:06:54.179984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2325/4571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:53 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 1462 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:54.232414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:54.242671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:54.270687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.273457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:54.275103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:54.278712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.170799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:55.206991 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0ada6e4-1585-4bc5-89e9-cea1bd05481a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1512 microversion: 2.1 time: 1.010590 Jul 19 20:06:55.228543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2326/4572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:54 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1512 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:55.241845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-255c8f7b-e602-4de4-a1e6-cd1e67b82bdf req-e4067e4e-50a3-42b9-b705-4c6cb7445919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9", "name": "network-vif-deleted", "tag": "b4386eb8-52cd-4d02-8b3d-e04e2a00719a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:55.263119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-255c8f7b-e602-4de4-a1e6-cd1e67b82bdf req-e4067e4e-50a3-42b9-b705-4c6cb7445919 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.263828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-255c8f7b-e602-4de4-a1e6-cd1e67b82bdf req-e4067e4e-50a3-42b9-b705-4c6cb7445919 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.291730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-255c8f7b-e602-4de4-a1e6-cd1e67b82bdf req-e4067e4e-50a3-42b9-b705-4c6cb7445919 service nova] Creating event network-vif-deleted:b4386eb8-52cd-4d02-8b3d-e04e2a00719a for instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 on n-h2-843834-3 Jul 19 20:06:55.301364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-255c8f7b-e602-4de4-a1e6-cd1e67b82bdf req-e4067e4e-50a3-42b9-b705-4c6cb7445919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071086 Jul 19 20:06:55.302694 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2327/4573] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:06:55.315723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:55.317839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] [instance: 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:55.328857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.329963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.331240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:55.332029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:55.350829 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] HTTP exception thrown: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Request method failure captured: Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 HTTP/1.1 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w6M0O474Sqr5WM-tq8Bby73EDv99OF8rnfO5CY2f1suGS43pplqiK9QZNQd2g427GjyDZTCih1JUmN57dAykHq_SZ0VaEBzaVXfc4Qb6yK01NfcmFBSxzQ5TkEaPVPySbWZKQSc9vti0tIr63rpxNoxuelFzYFCw1CDFFKuoNySOHA Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 67218bdd44bb4a8a98930da4e23fc4c9 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-VolumesActionsTest-986281977 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67218bdd44bb4a8a98930da4e23fc4c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-VolumesActionsTest-986281977 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 67218bdd44bb4a8a98930da4e23fc4c9 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-VolumesActionsTest-986281977 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-VolumesActionsTest-986281977-project Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a8907832c11842f482f603256733fc94 Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-VolumesActionsTest-986281977-project Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9'} Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:06:55.353598 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. Jul 19 20:06:55.358538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:06:55.361127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] Returning 404 to user: Instance 449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:06:55.362457 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be081141-49ef-4bb6-bab7-5c6a8af3290b tempest-VolumesActionsTest-986281977 tempest-VolumesActionsTest-986281977-project] 10.222.0.23 "GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9" status: 404 len: 111 microversion: 2.1 time: 0.057979 Jul 19 20:06:55.370020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2328/4574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:55 2022] GET /compute/v2.1/servers/449e5b1e-1091-4ff0-9bb2-bfcb7b19a4b9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:06:56.232176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:56.232982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:56.270078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.270968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.295567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.299846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.568079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:06:56.569386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:06:56.570075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:06:56.570678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:06:56.572075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:06:56.601447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.605009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.608912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:56.610597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:56.694863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:06:56.720824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:06:56.870190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:06:56.905116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:06:56.959418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:56.978153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e88e45e-aa81-4160-9300-1c56d0c4d46e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1489 microversion: 2.1 time: 0.750398 Jul 19 20:06:56.979807 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2329/4575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:56 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1489 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:57.015535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:06:57.024776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:57.038686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.039949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.041640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.042677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.100826 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8c00078-999c-471c-b229-b043d23e66ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.129521 Jul 19 20:06:57.112267 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2247/4576] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:06:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:06:57.118641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d9bc881-70bb-44f1-8ecb-44c734a2410d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:57.125349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d9bc881-70bb-44f1-8ecb-44c734a2410d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:57.145448 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-17e0c0e2-8825-4778-af65-baf300b8310a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 200 len: 121 microversion: 2.1 time: 0.138902 Jul 19 20:06:57.160852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2330/4577] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:06:57 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 121 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:06:57.172881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:57.174474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:57.192688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.193921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.197006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.198191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.385922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d9bc881-70bb-44f1-8ecb-44c734a2410d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:57.423224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d9bc881-70bb-44f1-8ecb-44c734a2410d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1192 microversion: 2.1 time: 0.297315 Jul 19 20:06:57.443125 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2248/4578] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:57 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1192 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:57.781615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:57.793380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-251a07e0-43d2-4e23-a40d-e3498ea214f9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.630206 Jul 19 20:06:57.799951 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2331/4579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:57 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:57.838548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:57.840452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:57.883021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.883786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:57.888050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:57.894022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:58.462838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-63fec5ee-2e90-42e7-8154-c40fa65c30bc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:58.471222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-63fec5ee-2e90-42e7-8154-c40fa65c30bc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:58.471847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:58.488854 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-afe6b66b-4adc-4d5a-a71b-d93273608d75 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.657839 Jul 19 20:06:58.513399 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2249/4580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:57 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:58.528021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:58.528566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:58.556338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:58.557331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:58.559957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:58.563080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:58.706900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-63fec5ee-2e90-42e7-8154-c40fa65c30bc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:58.723722 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-63fec5ee-2e90-42e7-8154-c40fa65c30bc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1192 microversion: 2.1 time: 0.268045 Jul 19 20:06:58.729916 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2332/4581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:58 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1192 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:06:59.105040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:06:59.138550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e001d8a-629e-477b-80d1-77f4fbb2f92a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.621179 Jul 19 20:06:59.143597 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2250/4582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:58 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:06:59.171365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:59.173601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:59.215463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:59.216156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:59.224525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:59.231549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:59.751102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:06:59.752776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:06:59.757121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:06:59.775243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:59.775969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:06:59.777055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:06:59.779743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:00.261034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:00.317123 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-80487902-c77b-4c4a-845f-ce85231170d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.143315 Jul 19 20:07:00.324208 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2333/4583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:59 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:00.661938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:00.696076 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9322c64f-c545-4a5e-9de7-7a11e1470517 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1244 microversion: 2.1 time: 0.947099 Jul 19 20:07:00.699816 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2251/4584] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:06:59 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1244 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:00.846672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-521279064", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1e5d8cfc-4319-48ca-95d7-3aa27f475ae1"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:01.072702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] validate_networks() for [('1e5d8cfc-4319-48ca-95d7-3aa27f475ae1', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:01.717683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:01.746264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:01.770234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.773526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:01.777467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:01.779526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:02.477264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:02.536954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dade625e-9772-46c1-8dc5-0b4b39ffc427 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1250 microversion: 2.1 time: 0.822787 Jul 19 20:07:02.583093 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2252/4585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:01 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1250 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:03.157621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:03.158226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:03.160046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:03.160647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:03.161262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:03.197225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.197760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:03.199074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.214058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:03.311514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:03.344356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:03.389572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:03.398121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:03.598067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:03.606813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:03.646468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.652482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:03.654232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:03.657563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:03.686018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=88 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:03.764954 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-085a2253-d9c1-4eb6-8fcd-ec5933fc62c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.925786 Jul 19 20:07:03.772249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2334/4586] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:07:03.822094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-17237521-32e8-4873-8fa2-2899f9f3abec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:03.835423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-17237521-32e8-4873-8fa2-2899f9f3abec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:04.407622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-17237521-32e8-4873-8fa2-2899f9f3abec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:04.426905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-17237521-32e8-4873-8fa2-2899f9f3abec tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1214 microversion: 2.1 time: 0.645042 Jul 19 20:07:04.429466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2335/4587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:03 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1214 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:04.472711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:04.497933 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb9764d7-c603-45ba-bd13-4266a3ec21c7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1250 microversion: 2.1 time: 0.905809 Jul 19 20:07:04.498642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2253/4588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:03 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1250 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:05.450972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32db7c19-b1e6-49d3-a000-049cf710ef29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:05.452305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32db7c19-b1e6-49d3-a000-049cf710ef29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:05.470407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:05.518092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:05.519265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:05.542758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:05.548889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:05.549920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:05.550451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:05.702575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-32db7c19-b1e6-49d3-a000-049cf710ef29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:05.710349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32db7c19-b1e6-49d3-a000-049cf710ef29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1214 microversion: 2.1 time: 0.264700 Jul 19 20:07:05.716800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2336/4589] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:05 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:05.786442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:05.799877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-282779a1-62f2-4f4b-b9df-b09d052de295 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1250 microversion: 2.1 time: 0.287856 Jul 19 20:07:05.813018 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2254/4590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:05 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1250 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:06.755128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:06.760783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:06.824029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:06.824974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:06.851426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:06.853238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:06.864012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:06.878900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:06.883859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:06.901910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:06.910111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:06.920447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:06.925008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:07.396105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:07.900098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:07.926102 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01c39463-33ad-40c6-a7e4-880f6a35aaed tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1274 microversion: 2.1 time: 1.184782 Jul 19 20:07:07.940052 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2337/4591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:06 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1274 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:08.949163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:08.955778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:08.981309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:08.981771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:08.982580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:08.990049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:09.051960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:09.062155 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4e1f53e-c05c-4a57-86ff-ff63327ac6f7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 2.245000 Jul 19 20:07:09.073717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2255/4592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:06 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:09.767812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:09.785904 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32a1bad1-6ae5-45cc-8b2e-29749159ef3f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1272 microversion: 2.1 time: 0.843582 Jul 19 20:07:09.789595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2338/4593] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:08 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1272 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:10.091979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:10.097546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:10.181930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.182990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:10.184482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.185249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:10.807206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:10.808878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:10.831748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.832606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:10.833480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:10.833929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:11.140330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:11.160724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:11.181388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8bf030ca-b846-496d-b651-bac535bd3035 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 1.097817 Jul 19 20:07:11.202333 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dcc748ea-970d-4153-addf-78cfb5f658d8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1272 microversion: 2.1 time: 0.382116 Jul 19 20:07:11.206418 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2256/4594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:10 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:11.213708 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2339/4595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:10 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:12.223086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:12.231694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:12.233907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:12.237333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:12.261716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.262338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.263880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:12.264323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:12.265615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.266655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:12.268073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:12.268441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:13.267443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:13.432516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:13.472153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50a10b76-556d-4dcd-8675-d126e30ca250 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1272 microversion: 2.1 time: 1.245436 Jul 19 20:07:13.506584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2340/4596] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:12 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1272 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:13.787100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:13.805172 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-102b3d73-6161-46e0-9684-bf01b4aa9120 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 1.591549 Jul 19 20:07:13.808792 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2257/4597] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:12 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:14.547799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:14.550768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:14.591826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.592282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.593458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.594079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.782331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-fd459c4d-81f9-4e8d-8da6-0ab3b564b911 req-bcf9a407-c0a1-44d5-9dcc-2bbe5e8fcca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19937d78-ae5a-450f-b130-b5a5cd17c881", "tag": "741fe6cf-5ba6-44e1-934d-d8ca480303bd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:14.820895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fd459c4d-81f9-4e8d-8da6-0ab3b564b911 req-bcf9a407-c0a1-44d5-9dcc-2bbe5e8fcca4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.829538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fd459c4d-81f9-4e8d-8da6-0ab3b564b911 req-bcf9a407-c0a1-44d5-9dcc-2bbe5e8fcca4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.898552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-fd459c4d-81f9-4e8d-8da6-0ab3b564b911 req-bcf9a407-c0a1-44d5-9dcc-2bbe5e8fcca4 service nova] Creating event network-changed:741fe6cf-5ba6-44e1-934d-d8ca480303bd for instance 19937d78-ae5a-450f-b130-b5a5cd17c881 on n-h2-843834-3 Jul 19 20:07:14.933589 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-fd459c4d-81f9-4e8d-8da6-0ab3b564b911 req-bcf9a407-c0a1-44d5-9dcc-2bbe5e8fcca4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176071 Jul 19 20:07:14.935024 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2258/4598] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:07:14.950451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:14.955144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:14.974899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.975759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:14.977293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:14.978311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:15.710376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:19.368606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.436034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08b6776f-998e-4d43-8593-c670edebae55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 4.497515 Jul 19 20:07:19.447477 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2259/4599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:14 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 4512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:19.859097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:19.935500 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92a58f87-e1f8-4979-ab15-eff32a3c6c29 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 5.417459 Jul 19 20:07:19.947029 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2341/4600] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:14 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 5436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:20.485281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:20.487573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:20.529095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.535641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.540677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:20.543686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:20.975325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:20.976110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:21.027509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:21.033553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:21.035084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:21.035911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:22.370317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:22.435282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ee53116-0339-49ba-85b1-9961f108291e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 1.959911 Jul 19 20:07:22.437029 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2260/4601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:20 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:23.460451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:23.462960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:23.494895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.496071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:23.499003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:23.509562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:25.730118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:25.808645 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-499cf1b5-f00a-4a7e-9edf-5dd2da0852ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 2.356056 Jul 19 20:07:25.809766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2261/4602] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:23 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:25.898994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3718c81b-6c68-48f2-8e87-0da802452822 req-6953dfa5-3c73-4f1b-8cdd-e330262063bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725c01db-ef03-4809-b10a-e01adcc661c2", "tag": "baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:25.982458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3718c81b-6c68-48f2-8e87-0da802452822 req-6953dfa5-3c73-4f1b-8cdd-e330262063bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:25.983965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3718c81b-6c68-48f2-8e87-0da802452822 req-6953dfa5-3c73-4f1b-8cdd-e330262063bc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:26.065672 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3718c81b-6c68-48f2-8e87-0da802452822 req-6953dfa5-3c73-4f1b-8cdd-e330262063bc service nova] Creating event network-changed:baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7 for instance 725c01db-ef03-4809-b10a-e01adcc661c2 on n-h1-843834-3 Jul 19 20:07:26.093789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3718c81b-6c68-48f2-8e87-0da802452822 req-6953dfa5-3c73-4f1b-8cdd-e330262063bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281782 Jul 19 20:07:26.112457 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2262/4603] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:26.462361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:26.467013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=76 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:26.541216 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e1be5fa-da0c-4c88-ac4a-2eeec46c0c04 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 5.571055 Jul 19 20:07:26.542398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2342/4604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:20 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 5577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:26.848628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:26.857972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:26.986274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:26.995768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:26.999248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:27.018876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:27.581723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:27.582621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:27.630279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:27.631642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:27.633010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:27.639348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:29.312274 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:07:29.312998 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 (ip 10.222.0.23) !!! Jul 19 20:07:29.639583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:29.672190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92aa185c-5509-441a-a21f-d9034de31f1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 2.096575 Jul 19 20:07:29.685601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2343/4605] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:27 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:29.689308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:29.704576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de6e2624-8c1e-4a94-aa9f-072fe5a79a12 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 2.866486 Jul 19 20:07:29.712759 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2263/4606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:26 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:30.698505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:30.699164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:30.739255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.739759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:30.740685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.742941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:30.744092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:30.753777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:30.764516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=26 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:30.775585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.777928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:30.779249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:30.783652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:32.827163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:32.847118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2daa4078-6a22-4d7d-9c85-8fb0b74a6c01 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 2.110663 Jul 19 20:07:32.863063 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2264/4607] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:30 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:33.028064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-af4f570c-b32c-4c46-a7d0-96ed82d6c763 req-9e8ce823-8f20-43a8-9c8f-fd6fe80cbdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19937d78-ae5a-450f-b130-b5a5cd17c881", "name": "network-vif-plugged", "status": "completed", "tag": "741fe6cf-5ba6-44e1-934d-d8ca480303bd"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:33.059078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-af4f570c-b32c-4c46-a7d0-96ed82d6c763 req-9e8ce823-8f20-43a8-9c8f-fd6fe80cbdc7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.059512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-af4f570c-b32c-4c46-a7d0-96ed82d6c763 req-9e8ce823-8f20-43a8-9c8f-fd6fe80cbdc7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.154431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-af4f570c-b32c-4c46-a7d0-96ed82d6c763 req-9e8ce823-8f20-43a8-9c8f-fd6fe80cbdc7 service nova] Creating event network-vif-plugged:741fe6cf-5ba6-44e1-934d-d8ca480303bd for instance 19937d78-ae5a-450f-b130-b5a5cd17c881 on n-h2-843834-3 Jul 19 20:07:33.200684 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-af4f570c-b32c-4c46-a7d0-96ed82d6c763 req-9e8ce823-8f20-43a8-9c8f-fd6fe80cbdc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170706 Jul 19 20:07:33.209232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2265/4608] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:33.251393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:33.300575 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0417db0c-ca7d-4fb4-a07a-2386af4c6163 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 2.606674 Jul 19 20:07:33.339095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2344/4609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:30 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:33.875821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:33.876541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:33.894544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.895475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.896533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:33.898890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:33.947651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=66 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:34.356750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:34.358200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:34.372484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:34.375264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:34.378107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:34.378796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:36.170834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:36.188178 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cabbe29b-8d0b-42ec-a9f3-a390cfbd7a44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 1.835134 Jul 19 20:07:36.189515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:36.199821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a58ab565-234d-4347-9f1e-a961e832e296 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1292 microversion: 2.1 time: 2.328992 Jul 19 20:07:36.202738 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2345/4610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:34 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:36.210412 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2266/4611] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:33 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1292 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:37.220139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:37.229511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:37.245009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:37.247354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:37.271972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=22 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:37.296784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.302767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.309695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.312185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.315484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.319303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:37.329941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:37.330751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.748344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:39.761967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:39.807286 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d808a549-ddca-4a05-ae2a-d6ae023c2e3b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 2.602600 Jul 19 20:07:39.815025 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2346/4612] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:37 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:39.821068 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcc50a6a-2eef-4b10-b796-0d471d35cb85 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1473 microversion: 2.1 time: 2.566528 Jul 19 20:07:39.822258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2267/4613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:37 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1473 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:39.825838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-532d8615-942c-4477-ac50-abca62f2c330 req-b740d806-a160-4442-be77-9052b3643ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725c01db-ef03-4809-b10a-e01adcc661c2", "name": "network-vif-plugged", "status": "completed", "tag": "baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:39.854154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-532d8615-942c-4477-ac50-abca62f2c330 req-b740d806-a160-4442-be77-9052b3643ebe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:39.858160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-532d8615-942c-4477-ac50-abca62f2c330 req-b740d806-a160-4442-be77-9052b3643ebe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:39.889596 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-532d8615-942c-4477-ac50-abca62f2c330 req-b740d806-a160-4442-be77-9052b3643ebe service nova] Creating event network-vif-plugged:baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7 for instance 725c01db-ef03-4809-b10a-e01adcc661c2 on n-h1-843834-3 Jul 19 20:07:39.899594 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-532d8615-942c-4477-ac50-abca62f2c330 req-b740d806-a160-4442-be77-9052b3643ebe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079966 Jul 19 20:07:39.901097 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2347/4614] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:07:40.277537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-704641744", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:40.501685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:40.848704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:40.868977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:40.927906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.928453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:40.932210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:40.935030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:42.137896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:42.156206 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-549b5ec0-2bf3-45cd-baeb-3c473acd6b79 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1314 microversion: 2.1 time: 1.329478 Jul 19 20:07:42.170627 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2348/4615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:40 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1314 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:42.801898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:42.803877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:42.805094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:42.806970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:42.809061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:42.846724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:42.850077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:42.859966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:42.862589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:42.981955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:43.011201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:43.074964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:43.080569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:43.181141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:43.181890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:43.217879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:43.221580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:43.224180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:43.224665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:43.298703 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b5216df-31f2-473b-a366-606bfa802694 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.021651 Jul 19 20:07:43.306154 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2268/4616] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:07:43.325056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:43.328892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:43.476998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:07:43.829500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:43.851110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e1e4c7ad-e018-40c6-9c0a-09265491d469 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1502 microversion: 2.1 time: 0.674044 Jul 19 20:07:43.852852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2349/4617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:43 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1502 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:43.874741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:43.880159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:43.902310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:43.918327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:43.924803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:43.927502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:44.062810 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75c79763-17f7-4449-8147-a768f5698e69 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.192006 Jul 19 20:07:44.068735 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2350/4618] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:43 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:07:44.972633 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.scheduler.client.report [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Deleted allocations for instance 26e28891-5a18-484c-8639-7f6c3aa038ab Jul 19 20:07:44.985470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Instance Mapping does not exist while attempting local delete cleanup. Jul 19 20:07:44.990845 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-02591f8b-6c94-4f00-9723-2d0705dd97a2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab" status: 204 len: 0 microversion: 2.1 time: 1.682744 Jul 19 20:07:45.002553 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2269/4619] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:07:43 2022] DELETE /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:07:45.015306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:45.016566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:45.090608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:45.093346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:45.145222 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab HTTP/1.1 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '26e28891-5a18-484c-8639-7f6c3aa038ab'} Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:07:45.149201 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:07:45.189594 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:07:45.189594 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:07:45.189594 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:07:45.189594 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:07:45.195975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:45.196584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:07:45.196584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d802d3f5-60e9-4778-bb04-d99ae8efe8f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab" status: 404 len: 111 microversion: 2.1 time: 0.173520 Jul 19 20:07:45.202886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:45.204678 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2351/4620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:45 2022] GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:07:45.206473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:45.210648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:45.460363 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-219d5bed-08a6-4a98-a7c4-3c1f9b10fe57 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.385385 Jul 19 20:07:45.462607 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2270/4621] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:45 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:07:45.940542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-379820371", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:46.400955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:07:46.477874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:46.497502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:46.562193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:46.577413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:46.580110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:46.589053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:46.800984 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a449f21d-b107-44ef-8155-932ab903319d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.329850 Jul 19 20:07:46.805886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2271/4622] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:46 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:07:47.822480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:47.843150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:47.934594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.936339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:47.938771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:47.940643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:48.063412 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00e3fe87-9060-41e6-9334-fd46eae8b745 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.249387 Jul 19 20:07:48.069089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2272/4623] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:47 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:07:49.089931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:49.093576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:49.199627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:49.208423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:49.210226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:49.216706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:49.403868 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ade57c8c-a74c-47dd-aea5-28642a6e3232 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.328454 Jul 19 20:07:49.411525 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2273/4624] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:49 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:07:50.436020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:50.452254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:50.489750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.495154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.497595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:50.504846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:50.707092 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-38ed95dc-5650-4c16-823a-4b6fe37b2a1a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.284539 Jul 19 20:07:50.718343 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2274/4625] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:50 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:07:50.968680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:07:50.969514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:07:50.969690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:07:50.969988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:07:50.970668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:07:51.051276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:51.055482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:51.060946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:51.067271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:51.157946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:07:51.168271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:07:51.216125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:07:51.226678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:07:51.459386 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ee8a38e-271b-4742-bf4e-edf6e34ca604 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.517256 Jul 19 20:07:51.475367 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2352/4626] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:07:51.481211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7587c358-7b6a-41c7-8d8a-fd69ac537efc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:51.482859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7587c358-7b6a-41c7-8d8a-fd69ac537efc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:51.727536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:51.728500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:51.752268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:51.752725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:51.753526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:51.753955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:51.853844 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-392fe23f-4b7f-4e89-a27a-4dbcbd6ce6e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.131710 Jul 19 20:07:51.858226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2353/4627] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:51 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:07:51.923618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7587c358-7b6a-41c7-8d8a-fd69ac537efc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:51.935376 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7587c358-7b6a-41c7-8d8a-fd69ac537efc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1220 microversion: 2.1 time: 0.458661 Jul 19 20:07:51.946649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2275/4628] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:51 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1220 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:52.875309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:52.898530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:52.955828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:52.957006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:52.981843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:52.997279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:53.001328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:53.002203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:53.002420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:53.003874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:53.011956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:53.013321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:53.016555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:53.267526 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f1c5379-47d3-49e2-a11f-23768f8f9983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 14 microversion: 2.1 time: 0.400688 Jul 19 20:07:53.279109 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2354/4629] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:52 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 14 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:07:54.291389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:07:54.293414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:54.372182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.372877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.398941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.405150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.580114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:54.616152 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84d6f41b-def1-4481-8a45-3fdea76f47f6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1224 microversion: 2.1 time: 1.658764 Jul 19 20:07:54.643216 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2276/4630] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:52 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1224 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:54.743640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-33973e5d-3633-4f4e-bc4c-eb01814c2506 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action" status: 200 len: 8205 microversion: 2.1 time: 0.459643 Jul 19 20:07:54.746135 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2355/4631] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:07:54 2022] POST /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2/action => generated 8205 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:54.756542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:54.757740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:54.772783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.781512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:54.787246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:54.792758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.656221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:55.657724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:55.742733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.750061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.760174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:55.762281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.763127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.778356 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-953cd3e9-0427-4bcd-8b19-c6c58c7ee3a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.026535 Jul 19 20:07:55.794066 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2277/4632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:54 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:55.802806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:55.860314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:55.873297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.873950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:55.875373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:55.876022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:56.430492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:56.454992 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ea6ba14-21d3-415b-abeb-19aede3b496e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1278 microversion: 2.1 time: 0.815047 Jul 19 20:07:56.456186 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2356/4633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:55 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1278 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:57.493093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:57.497519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:57.532724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.538632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.546937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.548163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.565333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:57.619915 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e923ecff-0fe9-4f8b-a700-ecfaece74ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.823597 Jul 19 20:07:57.658419 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2278/4634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:55 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:07:57.698192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:57.723806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:57.756107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=64 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:07:57.795824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.802404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.811910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:57.818975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:57.992705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:07:58.037101 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46ade8b1-074f-40c4-9251-e3b17577dacc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1278 microversion: 2.1 time: 0.554384 Jul 19 20:07:58.038272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2357/4635] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:57 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1278 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:07:59.071130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:07:59.081704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:07:59.163244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.171745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:07:59.178060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:07:59.178831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.127203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:01.208774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:01.489817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:01.514130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:01.529227 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-447fcd47-1534-488c-909d-21355d104883 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 2.468995 Jul 19 20:08:01.560559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2358/4636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:59 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:01.607356 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc8f470c-8278-484f-9d05-6015d8133fb2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 3.914254 Jul 19 20:08:01.615449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2279/4637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:07:57 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 3929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:01.650419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:01.660517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:01.689453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.704508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:01.728444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:01.729561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.563045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:02.563994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:02.610798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:02.618540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:02.620940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.623094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:02.628734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:02.629442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.834955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:04.866426 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc9f7971-fb6d-4a6f-a8cb-be0f7274eceb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 3.228109 Jul 19 20:08:04.880720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2359/4638] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:01 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 3244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:04.961881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:04.964515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:04.989851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.991548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:04.993422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:04.994289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.206545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Locking {{(pid=131229) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 19 20:08:05.409172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fedf4a5c-b7cd-478c-9e9b-2547a6427d2b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.503216 Jul 19 20:08:05.419404 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2360/4639] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:04 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:05.441403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:05.467597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:05.489899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:05.503318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=62 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:05.503713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:05.505042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.508018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:05.509742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:05.519381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71c68920-a055-4f0d-9e76-a277f0320e8a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 2.960383 Jul 19 20:08:05.521561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2280/4640] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:02 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:06.550248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:06.551366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:06.594270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.596120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:06.600030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:06.603083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.585959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:07.626253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f0d0e09-68a9-44b4-8a80-aeaf3ccc628d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 2.201175 Jul 19 20:08:07.642042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2361/4641] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:05 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:07.707889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2135d4fd-653b-43d8-a858-292ee7b7afaa req-7fdbaa81-47b7-464d-90d6-6bfa4eeb8b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66", "tag": "7eac448a-cebf-4909-af78-ef4c53e7c1e1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:07.737980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:07.752883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2135d4fd-653b-43d8-a858-292ee7b7afaa req-7fdbaa81-47b7-464d-90d6-6bfa4eeb8b78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.754953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2135d4fd-653b-43d8-a858-292ee7b7afaa req-7fdbaa81-47b7-464d-90d6-6bfa4eeb8b78 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.829958 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2135d4fd-653b-43d8-a858-292ee7b7afaa req-7fdbaa81-47b7-464d-90d6-6bfa4eeb8b78 service nova] Creating event network-changed:7eac448a-cebf-4909-af78-ef4c53e7c1e1 for instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 on n-h2-843834-3 Jul 19 20:08:07.850633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2135d4fd-653b-43d8-a858-292ee7b7afaa req-7fdbaa81-47b7-464d-90d6-6bfa4eeb8b78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200257 Jul 19 20:08:07.852939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2362/4642] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:07.864435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:07.883301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:07.884665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:07.951296 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action HTTP/1.1 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 15 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: {"os-stop": {}} Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'a4374f34-7e78-4e25-9dbf-20c72050b1f2', 'body': {'os-stop': {}}} Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked Jul 19 20:08:07.955122 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:07.968317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 409 to user: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 is locked {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:07.970207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1d496a5c-ca46-4a6c-ae94-0d659d59918e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 409 len: 107 microversion: 2.1 time: 0.114965 Jul 19 20:08:07.972299 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2363/4643] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:07 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 107 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:08:08.004780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:08.011186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:08.036728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.041325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.043137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.046096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.233579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Unlocking {{(pid=131229) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 20:08:08.420569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31855f9d-3d3e-4359-a755-602a4431c1d4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.433746 Jul 19 20:08:08.432952 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2364/4644] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:07 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:08.452161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-82c67f50-4fc8-4ceb-8704-4ffc0e3e8fa2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:08.465678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82c67f50-4fc8-4ceb-8704-4ffc0e3e8fa2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.466515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82c67f50-4fc8-4ceb-8704-4ffc0e3e8fa2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.584142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-82c67f50-4fc8-4ceb-8704-4ffc0e3e8fa2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Going to try to stop instance {{(pid=131229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:08:08.842256 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-82c67f50-4fc8-4ceb-8704-4ffc0e3e8fa2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.400737 Jul 19 20:08:08.852331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2365/4645] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:08 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:08.879309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:08.885780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:08.921111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.921495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:08.923050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:08.929390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:10.111561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:10.205414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55c51805-bcd8-42d6-8508-c0a1b574243d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 3.661277 Jul 19 20:08:10.208325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2281/4646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:06 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 3665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:10.710127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:10.740932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5418143-6fbb-454f-8e92-e56fed316632 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 1.886748 Jul 19 20:08:10.746184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2366/4647] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:08 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:11.224043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:11.224959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:11.249193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.250552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.251246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.267806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.761923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:11.762522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:11.791518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.791994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:11.792819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:11.793272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:14.725735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:14.764044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f22199f-99a6-4f67-9d8c-611dff035f8e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 3.006454 Jul 19 20:08:14.779725 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2367/4648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:11 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:15.340734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:15.369523 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d31f2872-adfa-4e67-924b-271f28c2f9be tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 4.147025 Jul 19 20:08:15.395911 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2282/4649] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:11 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 4176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:15.807542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:15.808965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:15.862147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.863792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:15.873827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:15.875268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.398605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:16.400053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:16.434300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.434805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:16.435933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:16.436431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:17.747477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:17.774397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:17.783540 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2adffc3b-bc73-4c4c-a7c2-7c209d30338c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 1.982356 Jul 19 20:08:17.804474 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2368/4650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:15 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:18.459189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:18.498055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f40363ef-79ec-4b3f-a41d-cdae8024af84 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 2.102602 Jul 19 20:08:18.501611 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2283/4651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:16 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:18.822789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:18.831055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:18.883575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.888946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:18.896025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:18.900287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:19.526473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:19.527194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:19.549445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:19.552143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:19.556561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:19.562216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:21.199056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:21.267441 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31540cef-f8e3-434f-92a1-fcb6a57855a5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 2.455992 Jul 19 20:08:21.277813 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2369/4652] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:18 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:21.512906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:21.528424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67c4b4f7-753c-4bb4-ac91-435cd83f8526 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 2.006813 Jul 19 20:08:21.532546 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2284/4653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:19 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:22.302080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:22.306701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:22.384164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.384707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.388952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.392574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.552424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:22.554217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:22.582631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.584082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:22.589634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:22.591403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:23.523526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:23.543990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9546b03b-d454-4d9b-b3cd-4309afb403bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 0.997683 Jul 19 20:08:23.552409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2285/4654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:22 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:23.649863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:23.683803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca5f39b4-9768-47ab-a831-f68864525bfe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1655 microversion: 2.1 time: 1.381400 Jul 19 20:08:23.688222 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2370/4655] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:22 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1655 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:23.712158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a2ffa1f-2ff8-4fba-a875-8c3226872f3c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:23.748187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a2ffa1f-2ff8-4fba-a875-8c3226872f3c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:23.751701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a2ffa1f-2ff8-4fba-a875-8c3226872f3c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:23.857678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a2ffa1f-2ff8-4fba-a875-8c3226872f3c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:08:24.095673 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a2ffa1f-2ff8-4fba-a875-8c3226872f3c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.391039 Jul 19 20:08:24.111331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:24.114091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:24.121719 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2286/4656] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:23 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:24.155509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.156424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.161756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.161756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.580643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:24.581842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:24.625762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.626545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:24.627981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:24.628758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:25.163703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.175551 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e1bebb3-590d-422d-a47b-e9c400f33e27 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1664 microversion: 2.1 time: 1.072039 Jul 19 20:08:25.209666 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2371/4657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:24 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1664 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:25.753732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:25.793681 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b03c8d49-c33f-4cfe-ba12-4bacc5c58402 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 1.226851 Jul 19 20:08:25.813605 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2287/4658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:24 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:26.237307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:26.238132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:26.248895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.249647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.252160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.252885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.829330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:26.834050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:26.866677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.873751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:26.875569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:26.890034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:29.031135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:29.049362 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f0d2a656-ea9e-416e-b674-0cf267944dd8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1664 microversion: 2.1 time: 2.816574 Jul 19 20:08:29.054080 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2372/4659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:26 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1664 bytes in 2823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:29.072895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-59c6e01f-a99c-461b-a137-39e78f02bf58 req-0f80a400-94c7-4a9c-ab54-5b2450a297ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66", "name": "network-vif-plugged", "status": "completed", "tag": "7eac448a-cebf-4909-af78-ef4c53e7c1e1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:29.100015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:29.110675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-59c6e01f-a99c-461b-a137-39e78f02bf58 req-0f80a400-94c7-4a9c-ab54-5b2450a297ac service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:29.111548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-59c6e01f-a99c-461b-a137-39e78f02bf58 req-0f80a400-94c7-4a9c-ab54-5b2450a297ac service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:29.160601 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-da61178e-ccef-49e4-b457-27db8657a473 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 2.336025 Jul 19 20:08:29.169442 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2288/4660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:26 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:29.175502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-59c6e01f-a99c-461b-a137-39e78f02bf58 req-0f80a400-94c7-4a9c-ab54-5b2450a297ac service nova] Creating event network-vif-plugged:7eac448a-cebf-4909-af78-ef4c53e7c1e1 for instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 on n-h2-843834-3 Jul 19 20:08:29.215352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-59c6e01f-a99c-461b-a137-39e78f02bf58 req-0f80a400-94c7-4a9c-ab54-5b2450a297ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150394 Jul 19 20:08:29.216015 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2373/4661] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:30.076412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:30.079268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:30.121643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.128346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:30.141147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.145283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:30.201214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:30.201939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:30.245689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.247533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:30.251294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:30.252117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.218039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.238834 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-46b4aadc-abcc-4ac3-9a47-f4aa1eda7592 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.166599 Jul 19 20:08:31.245201 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2289/4662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:30 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:31.281403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:31.283845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:31.316762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.323575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.324787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:31.325627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:31.813455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:31.838746 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dcee64fc-d385-4043-b165-a7d0fd7f0bad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1320 microversion: 2.1 time: 1.645635 Jul 19 20:08:31.840943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2374/4663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:30 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1320 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:32.520201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:32.560995 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-256a85e9-39b4-45f1-8d7c-222232aef3e2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.283047 Jul 19 20:08:32.564208 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2290/4664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:31 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:32.581189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:32.583186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:32.597359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.599747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.601694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.602750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.721174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Unlocking {{(pid=131229) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 20:08:32.845886 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fb467f90-898d-4ff7-a9d3-e821f852f70a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.270064 Jul 19 20:08:32.846811 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2375/4665] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:32 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:32.873555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:32.877825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:32.879231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:32.882763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:32.891241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=22 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:32.906365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.913577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.915995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.920402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.922585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.932756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:32.935685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:32.944016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.670873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.689051 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae5b43cd-c7f1-4e92-8ce3-0bf8856c215a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1502 microversion: 2.1 time: 0.821799 Jul 19 20:08:33.689821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2376/4666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:32 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1502 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:33.718861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:33.720008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:33.741003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.742882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.747456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.748153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.815520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:33.825455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-848b5a12-d8df-4283-a1a9-021c8e4c74aa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.961391 Jul 19 20:08:33.838449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2291/4667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:32 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:33.864957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:33.865897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:33.892077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.901174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:33.906850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:33.908013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.478233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:34.494244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:34.508537 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-249e46e9-79a0-4ec9-ad20-a4b0dcba147b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1502 microversion: 2.1 time: 0.793680 Jul 19 20:08:34.512805 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2377/4668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:33 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1502 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:34.539852 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8cd5800-844d-4cda-bd63-7580a03c1388 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.656394 Jul 19 20:08:34.548315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2292/4669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:33 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:34.586671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:34.588010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:34.608826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:34.624855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:34.628969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.641355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.645924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.647466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.738953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.748587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.755761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:34.770382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:34.942170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:08:35.238438 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df3ef550-06b0-43a4-98cc-19cff0cfb565 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 204 len: 0 microversion: 2.1 time: 0.695133 Jul 19 20:08:35.241452 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2378/4670] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:08:34 2022] DELETE /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:08:35.263231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:35.266616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:35.287984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:35.288770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.289929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.296723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.297464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.314262 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47e538c6-dfc8-4b06-a5b5-1a1e57554c87 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.743523 Jul 19 20:08:35.317061 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2293/4671] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:34 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:35.346432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:35.347478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:35.362058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.362812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.364605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.365837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.612237 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cdadccbf-02cb-49e1-929a-725032dae5ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.271671 Jul 19 20:08:35.613705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2294/4672] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:35 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:35.669353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:35.674361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:35.702514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.703877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.708215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:35.717439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:35.769119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:36.219721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:36.293477 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b6ac47d-882e-4b2b-8fb7-d65ca65e816c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1508 microversion: 2.1 time: 1.045141 Jul 19 20:08:36.306199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2379/4673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:35 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1508 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:36.764783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:36.793749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b3651ee-955d-48f9-8e0b-d82a19f6cb56 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1673 microversion: 2.1 time: 1.170545 Jul 19 20:08:36.795410 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2295/4674] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:35 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1673 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:37.323478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:37.324411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:37.338168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.338892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.340435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.341460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.828863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:37.833821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:37.909416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.919530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:37.926384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:37.931026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:39.222637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:39.252414 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03cf6c16-5a13-4a47-8dd5-989a9ec91ef4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1508 microversion: 2.1 time: 1.936058 Jul 19 20:08:39.254706 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2380/4675] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:37 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1508 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:39.859920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:39.894024 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eba295be-1799-40ad-9e17-0b0d07a72aeb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1653 microversion: 2.1 time: 2.077165 Jul 19 20:08:39.901512 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2296/4676] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:37 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1653 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:39.940710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:39.946659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:39.971596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:39.980071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:39.982213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:39.988667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:39.990036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.150382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:40.257053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb6e8f15-cf66-46ea-b802-0151f942b119 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.328349 Jul 19 20:08:40.258936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2381/4677] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:08:39 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:08:40.283554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:40.284895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:40.285936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:40.290030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:40.323978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.326968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.328962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.330378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.333885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.334323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:40.335296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:40.336230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:41.272985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.278253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:41.288444 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-272aaf9c-0404-4fe5-9b86-f7533428fe78 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1508 microversion: 2.1 time: 1.017504 Jul 19 20:08:41.289039 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2382/4678] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:40 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1508 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:41.306058 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a661f4e2-ea27-4a9a-9bb0-c15c84244cc6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1660 microversion: 2.1 time: 1.040144 Jul 19 20:08:41.306904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2297/4679] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:40 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1660 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:41.964251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-0cbe9959-db40-4e75-be29-f900a37e3339 req-855da068-898d-4c47-962d-fd571cfd7a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66", "name": "network-vif-deleted", "tag": "7eac448a-cebf-4909-af78-ef4c53e7c1e1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:42.006780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0cbe9959-db40-4e75-be29-f900a37e3339 req-855da068-898d-4c47-962d-fd571cfd7a5b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.015932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-0cbe9959-db40-4e75-be29-f900a37e3339 req-855da068-898d-4c47-962d-fd571cfd7a5b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.060840 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-0cbe9959-db40-4e75-be29-f900a37e3339 req-855da068-898d-4c47-962d-fd571cfd7a5b service nova] Creating event network-vif-deleted:7eac448a-cebf-4909-af78-ef4c53e7c1e1 for instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 on n-h2-843834-3 Jul 19 20:08:42.080952 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-0cbe9959-db40-4e75-be29-f900a37e3339 req-855da068-898d-4c47-962d-fd571cfd7a5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122142 Jul 19 20:08:42.090225 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2383/4680] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:08:42.316719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:42.320634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:42.337488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:42.340246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:42.352767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.357270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.359618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.365350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.369063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.369538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.370526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.371062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.493281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.495620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.497485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lazy-loading 'fault' on Instance uuid fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:08:42.656752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:42.682176 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72a6551a-a006-443c-8089-ba2c9619419e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 200 len: 1310 microversion: 2.1 time: 0.378632 Jul 19 20:08:42.699349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2298/4681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:42 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 1310 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:42.878439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:42.895119 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19b1d9cb-111c-4689-aeb4-71ee1e24c152 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.563640 Jul 19 20:08:42.895585 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2384/4682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:42.920527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:42.922542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:42.938379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.939465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:42.940527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:42.941374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.232559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.249947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-056bfe25-6ba8-4c66-9495-a80d7822786f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.333398 Jul 19 20:08:43.251335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2299/4683] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:43.274040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:43.274652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:43.285679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.286140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.291444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.300066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.556131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:43.580153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4324744-4989-43b7-8dde-309656175280 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.311316 Jul 19 20:08:43.582626 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2385/4684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:43 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:43.600249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:43.601490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:43.610267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.611306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.612588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.613253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.720347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:43.730109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:43.744493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.745660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.746795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:43.748456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:43.772295 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 HTTP/1.1 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66'} Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:43.775342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:08:43.784428 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:08:43.786381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:08:43.789392 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-057e7ed6-619d-4c1c-ab26-aeb83beef59a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 404 len: 111 microversion: 2.1 time: 0.078886 Jul 19 20:08:43.798674 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2386/4685] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:43 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:08:43.805029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42774d29-fb17-4ec8-aef4-b08c5c5f1fd8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: .version_select at 0x7f23ef8cfaf0>, body: {"keypair": {"name": "tempest-key-1758612648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3y+bCKLQOQO8pEWz37kI/9z+1TJKu5usgC23dHs1YoWnVuv7KVBIlgMn6rLjYy1iPGR3omG8NncCN7/phhEJ5s3jX2ja87JKGDxO7ZZBf+tHMxSteBVidYl46zClwCPQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:43.834081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-42774d29-fb17-4ec8-aef4-b08c5c5f1fd8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:08:43.848060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-42774d29-fb17-4ec8-aef4-b08c5c5f1fd8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:08:43.943979 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42774d29-fb17-4ec8-aef4-b08c5c5f1fd8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.144247 Jul 19 20:08:43.945732 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2387/4686] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:08:43 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:43.965483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ade9fce5-af6a-4826-91ba-23bd3e279e9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '.version_select at 0x7f23eed72670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:43.969977 n-d-843834-3 devstack@n-api.service[131229]: WARNING oslo_db.sqlalchemy.utils [None req-ade9fce5-af6a-4826-91ba-23bd3e279e9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 20:08:43.982275 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ade9fce5-af6a-4826-91ba-23bd3e279e9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024818 Jul 19 20:08:43.983961 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2388/4687] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 19 20:08:43 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:08:44.106295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:44.115650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90d3fac5-05c2-470d-8504-30ad2747b57a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.520323 Jul 19 20:08:44.117227 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2300/4688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:43 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:44.150388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:44.151252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:44.171731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.172486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.173652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.174290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.319308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-932172179", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-key-1758612648", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:44.413116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:08:44.757505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:44.769326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-25e2d5fc-12f5-4823-9131-58f361a077d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.625475 Jul 19 20:08:44.771892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2389/4689] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:44 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:44.785927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:44.786786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:44.797640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.799442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:44.800501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:44.804316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.345650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:45.364595 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-88d1c291-8788-4b85-af71-711faf9a6c00 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.582357 Jul 19 20:08:45.367966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2390/4690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:44 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:45.642406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:08:45.643098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:08:45.643474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:08:45.644044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:08:45.644672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:08:45.671526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.674633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.679452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:45.680407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:45.727542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:08:45.739087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:08:45.770704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:08:45.773357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:08:45.873909 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aaca9f72-c332-43f5-aa06-c4bc116383c9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558970 Jul 19 20:08:45.886447 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2301/4691] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:08:45.898298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e306ac2d-46a6-47dd-b6ee-a04d918f3012 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:45.899148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e306ac2d-46a6-47dd-b6ee-a04d918f3012 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:46.064027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e306ac2d-46a6-47dd-b6ee-a04d918f3012 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:46.075567 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e306ac2d-46a6-47dd-b6ee-a04d918f3012 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1228 microversion: 2.1 time: 0.182761 Jul 19 20:08:46.084790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2391/4692] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:45 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1228 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:47.105673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:47.109280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:47.166030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.168986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.172576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:47.173328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:47.315408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:47.330177 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-051ba151-9136-4d14-80d2-5e2218e55f55 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1232 microversion: 2.1 time: 0.229625 Jul 19 20:08:47.339640 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2302/4693] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:47 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1232 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:48.358444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:48.370289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:48.440313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.441506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:48.445339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:48.448226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:48.958125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-38708928", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:49.066442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:08:49.405489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:49.419040 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0fab527-7404-4b82-9c2a-9dbbc2b61faa tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1298 microversion: 2.1 time: 1.064895 Jul 19 20:08:49.422203 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2392/4694] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:48 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1298 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:50.439687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:50.440303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:50.464466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.466849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.468021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.468877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.775094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:08:50.776184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:08:50.776861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:08:50.777471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:08:50.778118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:08:50.793909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.796287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.798170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:50.799792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:50.841539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Getting quotas for project 1c4354f682f74c2da094553b11f35ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:08:50.861538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Getting quotas for user 4e91d6c35cd04afbb8b9abe2ef8056f2 and project 1c4354f682f74c2da094553b11f35ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:08:50.890689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:08:50.895858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:08:51.093050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e1d925d-1597-4caa-81cd-1a95b0cb6cb1 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140663 Jul 19 20:08:51.098419 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2303/4695] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:08:51.140508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa5b276e-ca86-4352-b839-fe2b1ff5cf3d tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:51.142428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fa5b276e-ca86-4352-b839-fe2b1ff5cf3d tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:51.449594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa5b276e-ca86-4352-b839-fe2b1ff5cf3d tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:51.454555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:51.464414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa5b276e-ca86-4352-b839-fe2b1ff5cf3d tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1212 microversion: 2.1 time: 0.347882 Jul 19 20:08:51.467722 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2304/4696] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:51 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1212 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:51.482749 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b9b8da2-8fb0-41a1-920d-dd9595997f47 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 1.045979 Jul 19 20:08:51.495948 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2393/4697] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:50 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:52.481901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:52.483147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:52.496279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.503202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:52.504747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:52.509315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.511627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.516185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.524810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.525494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.527637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:52.534880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:52.821590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:52.834681 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb34d311-7365-4d7a-b1e1-427f915e461c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1208 microversion: 2.1 time: 0.356615 Jul 19 20:08:52.835798 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2305/4698] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:52 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1208 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:53.167239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:53.178623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-08ebf0ef-2525-410a-9e20-f861b58d2b49 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.679825 Jul 19 20:08:53.185055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2394/4699] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:52 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:53.873182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:53.874472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:53.905395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:53.907605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:53.908712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:53.914709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.198447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:54.200017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:54.214333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.216385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.219862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:54.220942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:54.257264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:54.265925 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f854f090-f9f9-4e0d-9611-296f885457e7 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1270 microversion: 2.1 time: 0.411337 Jul 19 20:08:54.272906 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2306/4700] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:53 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1270 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:54.988962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:54.999910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7099218-65da-4028-8c59-67aa543bfcad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.806445 Jul 19 20:08:55.001620 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2395/4701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:54 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:55.292119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:55.292808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:55.336532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.337356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.347713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.348204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.373050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-10a12dea-ded3-411f-86c4-56b2e905ca92 req-9eb9f6b8-e42b-4594-9aca-d0cd10e4c07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8851427-37ac-47fc-b98d-de35ceab7a40", "tag": "ccc62046-eb67-463d-b2b4-d3a2bd4f70f0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:08:55.403703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-10a12dea-ded3-411f-86c4-56b2e905ca92 req-9eb9f6b8-e42b-4594-9aca-d0cd10e4c07a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:55.406299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-10a12dea-ded3-411f-86c4-56b2e905ca92 req-9eb9f6b8-e42b-4594-9aca-d0cd10e4c07a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:55.457881 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-10a12dea-ded3-411f-86c4-56b2e905ca92 req-9eb9f6b8-e42b-4594-9aca-d0cd10e4c07a service nova] Creating event network-changed:ccc62046-eb67-463d-b2b4-d3a2bd4f70f0 for instance c8851427-37ac-47fc-b98d-de35ceab7a40 on n-h2-843834-3 Jul 19 20:08:55.474293 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-10a12dea-ded3-411f-86c4-56b2e905ca92 req-9eb9f6b8-e42b-4594-9aca-d0cd10e4c07a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104995 Jul 19 20:08:55.479025 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2396/4702] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:08:55.896987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:55.909034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84303538-dc22-4e22-ac34-297510a3f7ec tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1270 microversion: 2.1 time: 0.621209 Jul 19 20:08:55.911811 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2307/4703] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:55 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1270 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:56.035186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:56.036562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:56.069891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.073726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.077287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.078305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.082401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:08:56.932701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:56.936103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:56.958164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.961116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:56.965968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:56.968061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:57.392919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:57.401207 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce64798d-a59d-4c5c-9a35-760f0e9ec580 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1270 microversion: 2.1 time: 0.479013 Jul 19 20:08:57.404538 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2308/4704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:56 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1270 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:08:57.892588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:57.903959 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-457d5775-223c-440d-8f52-a641a67c4587 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 1.880337 Jul 19 20:08:57.917958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2397/4705] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:56 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:58.441490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:58.443662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:58.459281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.460334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.462544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.463905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.715387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:58.742249 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-280c07ec-30ba-4008-82b7-316cd53f3e43 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1270 microversion: 2.1 time: 0.323660 Jul 19 20:08:58.748768 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2309/4706] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:58 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1270 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:58.927395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:58.928802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:58.937737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.938345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:58.939421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:58.940141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.588732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:08:59.619135 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0363d65e-56a0-435e-9b42-bee75fbb48a7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.694643 Jul 19 20:08:59.620988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2398/4707] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:58 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:08:59.770153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:08:59.774536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:08:59.791895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.792812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:08:59.794740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:08:59.797944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.434990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:00.453852 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52db8d29-a869-4d18-8734-23567fd91062 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 0.688246 Jul 19 20:09:00.456828 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2310/4708] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:08:59 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:00.641613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:00.642980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:00.660027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:00.670038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:00.672242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:00.672845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:01.485491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:01.486329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:01.490590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:01.494880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:01.516529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:01.516999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:01.520608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:01.522117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:01.897371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:01.920671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-301dfaa9-1113-4e1b-88dc-d34fbf9a4ad5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 1.274835 Jul 19 20:09:01.931828 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2399/4709] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:00 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:02.172724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:02.197284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-15aa7e6e-90cb-4b85-aeb3-a06e75358b20 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 0.716270 Jul 19 20:09:02.217030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2311/4710] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:01 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:02.940252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:02.940919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:02.975520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.976275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:02.979188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:02.982370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.169713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-41faac77-0abd-470b-8db9-f40ecc5e9705 req-6b48ef4e-d1c0-48f2-a610-7f023ad6d7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510c115c-6c69-4176-9196-3df5ef90a441", "tag": "fc63928b-a5a5-4ede-bbad-39077f9b990d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:03.200147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:03.205113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-41faac77-0abd-470b-8db9-f40ecc5e9705 req-6b48ef4e-d1c0-48f2-a610-7f023ad6d7d2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:03.205937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-41faac77-0abd-470b-8db9-f40ecc5e9705 req-6b48ef4e-d1c0-48f2-a610-7f023ad6d7d2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.240957 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-41faac77-0abd-470b-8db9-f40ecc5e9705 req-6b48ef4e-d1c0-48f2-a610-7f023ad6d7d2 service nova] Creating event network-changed:fc63928b-a5a5-4ede-bbad-39077f9b990d for instance 510c115c-6c69-4176-9196-3df5ef90a441 on n-h1-843834-3 Jul 19 20:09:03.263087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-41faac77-0abd-470b-8db9-f40ecc5e9705 req-6b48ef4e-d1c0-48f2-a610-7f023ad6d7d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098869 Jul 19 20:09:03.264659 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2312/4711] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:03.274825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:03.276776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:03.288764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:03.289888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.291656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:03.292691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:03.502893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:03.516885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f2547bcb-ee1c-466a-8624-29001e9f7da6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.580246 Jul 19 20:09:03.518685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2400/4712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:02 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:03.795373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:03.817703 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-050e87b5-de5f-4070-a654-021fef24e62c tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 0.543944 Jul 19 20:09:03.817703 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2313/4713] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:03 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:04.548772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:04.549400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:04.565976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:04.568562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:04.569543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:04.570482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:04.834951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:04.836306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:04.856623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:04.860818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:04.863272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:04.865806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.192717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:05.210409 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f439dde-0980-4387-9f52-fd3975d7ab04 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.672267 Jul 19 20:09:05.211047 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2401/4714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:04 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:05.230049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6c11170f-ab2b-42d5-ab7b-2e999619b662 req-70da874e-e47c-4922-8cd4-1cad46a418de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8851427-37ac-47fc-b98d-de35ceab7a40", "name": "network-vif-plugged", "status": "completed", "tag": "ccc62046-eb67-463d-b2b4-d3a2bd4f70f0"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:05.256443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6c11170f-ab2b-42d5-ab7b-2e999619b662 req-70da874e-e47c-4922-8cd4-1cad46a418de service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:05.257334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6c11170f-ab2b-42d5-ab7b-2e999619b662 req-70da874e-e47c-4922-8cd4-1cad46a418de service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:05.280570 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6c11170f-ab2b-42d5-ab7b-2e999619b662 req-70da874e-e47c-4922-8cd4-1cad46a418de service nova] Creating event network-vif-plugged:ccc62046-eb67-463d-b2b4-d3a2bd4f70f0 for instance c8851427-37ac-47fc-b98d-de35ceab7a40 on n-h2-843834-3 Jul 19 20:09:05.316613 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6c11170f-ab2b-42d5-ab7b-2e999619b662 req-70da874e-e47c-4922-8cd4-1cad46a418de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104200 Jul 19 20:09:05.321510 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2402/4715] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:06.008566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:06.010976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=100 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:06.018976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df48170d-88a8-45b0-b427-00d5109f304b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 1.188612 Jul 19 20:09:06.019581 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2314/4716] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:04 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:06.239267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:06.256152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:06.274615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:06.275707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:06.281564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:06.282841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:06.290698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:07.039172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:07.040578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:07.052762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.053587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.054518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.062335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.135819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:07.150727 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03ce1f29-80e3-41b3-8272-c10031eadab5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1328 microversion: 2.1 time: 0.917199 Jul 19 20:09:07.157829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2403/4717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:06 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1328 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:07.542572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:07.570503 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d26fb9e7-2c35-4b79-896e-e375d86492da tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 0.536037 Jul 19 20:09:07.582510 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2315/4718] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:07 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:07.752943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:07.754121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:07.762755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.763577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.764972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.765710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.892609 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a3e9eec-412b-419a-8fcf-d63a03305a54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.142810 Jul 19 20:09:07.897922 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2404/4719] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:09:07 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:09:07.903265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:07.904499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:07.918404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.920526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:07.923458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:07.924312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:08.177323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:08.178981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:08.191273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:08.192253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:08.193442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:08.194293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.361568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:09.376383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8adc9f1-5c9f-43c6-aa99-031771cee5f4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1670 microversion: 2.1 time: 1.473075 Jul 19 20:09:09.377371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2316/4720] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:07 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1670 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:09.397354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:09.399684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:09.426736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.429555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.431719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.435253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.440686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:09.449953 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-088da3ea-a193-4d54-acde-2195e0614f9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1510 microversion: 2.1 time: 1.279012 Jul 19 20:09:09.460088 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2405/4721] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:08 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1510 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:09.479631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:09.480512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:09.501254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.501983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:09.509133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:09.509958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.837248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.859687 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f4545ef-0139-400d-a71b-858281577746 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1510 microversion: 2.1 time: 1.384726 Jul 19 20:09:10.874745 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2406/4722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:09 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1510 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:10.882656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:10.885420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.893955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:10.898386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.899812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.900901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.901548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.925670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:10.935515 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0523c059-efa7-468f-bec4-fb21ffbc3a73 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 1.550837 Jul 19 20:09:10.951300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2317/4723] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:09 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:10.961645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:10.962387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:10.974732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.982501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:10.984289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:10.984751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.044907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:09:11.338068 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-119b62b3-86fe-49a7-9a3e-5a556734ea7b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 204 len: 0 microversion: 2.1 time: 0.385108 Jul 19 20:09:11.339253 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2318/4724] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:09:10 2022] DELETE /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:09:11.356288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-283d5396-2b02-41d2-a469-d1fa4e587bab req-653d5ca4-4ee2-4b93-8a8c-d5d0eeed3273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510c115c-6c69-4176-9196-3df5ef90a441", "name": "network-vif-plugged", "status": "completed", "tag": "fc63928b-a5a5-4ede-bbad-39077f9b990d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:11.369171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.381059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-283d5396-2b02-41d2-a469-d1fa4e587bab req-653d5ca4-4ee2-4b93-8a8c-d5d0eeed3273 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.381507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-283d5396-2b02-41d2-a469-d1fa4e587bab req-653d5ca4-4ee2-4b93-8a8c-d5d0eeed3273 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.388537 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de563a88-614b-4d2c-9d1b-42ce159fc147 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1670 microversion: 2.1 time: 0.509200 Jul 19 20:09:11.390788 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2407/4725] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:10 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:11.407376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:11.412383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:11.426735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-283d5396-2b02-41d2-a469-d1fa4e587bab req-653d5ca4-4ee2-4b93-8a8c-d5d0eeed3273 service nova] Creating event network-vif-plugged:fc63928b-a5a5-4ede-bbad-39077f9b990d for instance 510c115c-6c69-4176-9196-3df5ef90a441 on n-h1-843834-3 Jul 19 20:09:11.435780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.437831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.441960 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-283d5396-2b02-41d2-a469-d1fa4e587bab req-653d5ca4-4ee2-4b93-8a8c-d5d0eeed3273 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100939 Jul 19 20:09:11.443267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.443996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.444595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2319/4726] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:11.859811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:11.878752 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b199f05-09e6-42ed-a43f-89647461abea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1516 microversion: 2.1 time: 0.485480 Jul 19 20:09:11.880034 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2408/4727] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:11 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1516 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:11.957832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:11.958715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:11.981226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.987053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:11.989075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:11.989667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.306511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:12.333433 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5a3999e3-6dc7-4716-9e56-e6152cd65458 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1312 microversion: 2.1 time: 0.378226 Jul 19 20:09:12.337245 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2320/4728] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:11 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:12.409414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:12.410032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:12.418195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.436463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.437609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.438279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.897168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:12.898487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:12.908807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.909334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:12.910372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:12.910575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.093953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.103532 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fec0949b-ede2-4808-9a90-2f3915a7219b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.698119 Jul 19 20:09:13.108835 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2409/4729] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:12 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:13.355172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:13.361533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:13.364717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:13.372872 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3eb0df2-46a8-49d2-95b8-8573cde13cd0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1516 microversion: 2.1 time: 0.479564 Jul 19 20:09:13.381512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.381963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.382772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:13.383234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:13.396000 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2321/4730] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:12 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1516 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:13.997441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:14.006064 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2147d27-5bbe-4e53-ba69-7ebabaf0aa9e tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1460 microversion: 2.1 time: 0.656624 Jul 19 20:09:14.028518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f588f66-6144-43ae-94ab-3abec387c06c", "device": "/dev/sdb"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:14.029722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.032993 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2410/4731] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:13 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1460 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:14.038037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.038838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.040693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.041592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.413122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:14.414462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:14.448597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.451028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.452857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:14.454013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:14.753271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab5e219a-fef6-4c6e-887c-4c242f585a7b tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "POST /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728639 Jul 19 20:09:14.773583 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2322/4732] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:09:14 2022] POST /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:09:15.534775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:15.544516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3e81d7d-f381-4043-8d78-2ebf0a533af3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1516 microversion: 2.1 time: 1.135709 Jul 19 20:09:15.556648 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2411/4733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:14 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1516 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:16.019388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-de7cc13b-6c31-44e7-abc5-3ebd62cb9493 req-01003fca-3753-4352-9bbc-06806de68b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8851427-37ac-47fc-b98d-de35ceab7a40", "name": "network-vif-deleted", "tag": "ccc62046-eb67-463d-b2b4-d3a2bd4f70f0"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:16.089174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-de7cc13b-6c31-44e7-abc5-3ebd62cb9493 req-01003fca-3753-4352-9bbc-06806de68b45 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.097155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-de7cc13b-6c31-44e7-abc5-3ebd62cb9493 req-01003fca-3753-4352-9bbc-06806de68b45 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.179224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-de7cc13b-6c31-44e7-abc5-3ebd62cb9493 req-01003fca-3753-4352-9bbc-06806de68b45 service nova] Creating event network-vif-deleted:ccc62046-eb67-463d-b2b4-d3a2bd4f70f0 for instance c8851427-37ac-47fc-b98d-de35ceab7a40 on n-h2-843834-3 Jul 19 20:09:16.204576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-de7cc13b-6c31-44e7-abc5-3ebd62cb9493 req-01003fca-3753-4352-9bbc-06806de68b45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190373 Jul 19 20:09:16.211665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2323/4734] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:16.574586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:16.576170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:16.618882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.619416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.620258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.625884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.784399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:16.784837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:16.785301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lazy-loading 'fault' on Instance uuid c8851427-37ac-47fc-b98d-de35ceab7a40 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:09:16.969040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:16.990487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30b16d54-93fa-42ec-b798-29c97f135590 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 200 len: 1318 microversion: 2.1 time: 0.418366 Jul 19 20:09:16.993831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2412/4735] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:16 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:18.012132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:18.013766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:18.041283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.043637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.047506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:18.048353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:18.094532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 HTTP/1.1 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c8851427-37ac-47fc-b98d-de35ceab7a40'} Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:09:18.101361 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:09:18.105598 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:09:18.108058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:09:18.112034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e5b6861-8e39-4359-92c8-bb2c3b6c9d5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 404 len: 111 microversion: 2.1 time: 0.106570 Jul 19 20:09:18.116324 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2324/4736] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:18 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:09:18.124181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1e05681-d91d-4642-83cf-40dc62854698 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '.version_select at 0x7f23ee326310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:18.179280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1e05681-d91d-4642-83cf-40dc62854698 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1758612648" status: 202 len: 0 microversion: 2.1 time: 0.059089 Jul 19 20:09:18.179896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2413/4737] 10.222.0.23 () {58 vars in 1208 bytes} [Tue Jul 19 20:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1758612648 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:09:18.617354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1727237493", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:19.217283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:20.391671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:20.392434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:20.392865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:20.393379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:20.393904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:20.435708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.436373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.437355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:20.437864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:20.539146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:20.567556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:20.604799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:20.607389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:20.758782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e63af4c-5d7a-4195-b51e-ce0ee1aae1a0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.143839 Jul 19 20:09:20.761906 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2325/4738] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:09:20.772696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57206860-0405-42fb-bb39-46fa8ca3539f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:20.785048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57206860-0405-42fb-bb39-46fa8ca3539f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:21.778204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57206860-0405-42fb-bb39-46fa8ca3539f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:21.789189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57206860-0405-42fb-bb39-46fa8ca3539f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1209 microversion: 2.1 time: 1.022060 Jul 19 20:09:21.802941 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2414/4739] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:20 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1209 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:22.818704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:22.827893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:22.852449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.853355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:22.861325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:22.861939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:23.454344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:23.466466 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dce41993-e687-4a60-89c7-c2a19c4b79cc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1261 microversion: 2.1 time: 0.655522 Jul 19 20:09:23.468040 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2326/4740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:22 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1261 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:24.497717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:24.510166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:24.568232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.569636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.582889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:24.588017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:24.961193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:24.993425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-867f4a21-b190-47fa-9f19-c6f0565435ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1267 microversion: 2.1 time: 0.509351 Jul 19 20:09:24.994622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2415/4741] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:24 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1267 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:26.024521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:26.025230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:26.053994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.056238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.066261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:26.070632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:26.574267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:26.610349 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-693e787e-8c9e-4d13-9938-bcce68729eef tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1267 microversion: 2.1 time: 0.591544 Jul 19 20:09:26.635954 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2327/4742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:26 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1267 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:27.681788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:27.684014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:27.707477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:27.723803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:27.726228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:27.729149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:28.107967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:28.146831 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42418c5a-4175-41ac-af0b-8a998eaeab8c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1267 microversion: 2.1 time: 0.481294 Jul 19 20:09:28.148630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2416/4743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:27 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1267 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:29.179617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:29.181101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:29.223275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.227548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.231430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:29.237607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:29.942114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:29.961599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-825b3787-0ac6-4549-8f4d-ad540cb8631f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 0.786545 Jul 19 20:09:29.983175 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2328/4744] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:29 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:30.991574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:30.992691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:31.033099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:31.033697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:31.034550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:31.035037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:31.234264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d752be9b-3eef-43bd-9fa9-e7cae796d675 req-a1dc4482-17fd-4784-930e-d66285262d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a2e479-3bd9-4e5d-872b-69983c1a2bdf", "tag": "e2a0158e-5dd4-4f49-ade8-5f189d4347c7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:31.257348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:31.260480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:31.309347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d752be9b-3eef-43bd-9fa9-e7cae796d675 req-a1dc4482-17fd-4784-930e-d66285262d2a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:31.313392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d752be9b-3eef-43bd-9fa9-e7cae796d675 req-a1dc4482-17fd-4784-930e-d66285262d2a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:31.381486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d752be9b-3eef-43bd-9fa9-e7cae796d675 req-a1dc4482-17fd-4784-930e-d66285262d2a service nova] Creating event network-changed:e2a0158e-5dd4-4f49-ade8-5f189d4347c7 for instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf on n-h2-843834-3 Jul 19 20:09:31.401476 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d752be9b-3eef-43bd-9fa9-e7cae796d675 req-a1dc4482-17fd-4784-930e-d66285262d2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169300 Jul 19 20:09:31.405328 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2329/4745] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:09:31.790044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:32.021106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:32.045449 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb79a21d-a224-4d1e-800d-d877241cad90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 1.047709 Jul 19 20:09:32.049831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2417/4746] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:30 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:33.070241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:33.072860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:33.095881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.112913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:33.114493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:33.115363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:33.635786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:33.647709 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa524008-7346-4bf8-a6c6-a88b4cad4808 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 0.583698 Jul 19 20:09:33.651284 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2330/4747] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:33 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:34.676495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:34.681980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:34.725182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:34.727025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:34.731159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:34.732180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:35.763324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:35.789143 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12967dad-cd5b-45fe-93bd-dce7c4f60d4a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 1.128307 Jul 19 20:09:35.796572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2418/4748] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:34 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:36.814651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:36.816350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:36.826068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:36.858481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.867195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:36.867381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:36.868134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:37.291538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-631120db-86f6-4f06-aaca-43e5dd2443a8 req-1193160c-4cc1-402e-8f52-23c2432c299e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2e479-3bd9-4e5d-872b-69983c1a2bdf", "name": "network-vif-plugged", "status": "completed", "tag": "e2a0158e-5dd4-4f49-ade8-5f189d4347c7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:37.317989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-631120db-86f6-4f06-aaca-43e5dd2443a8 req-1193160c-4cc1-402e-8f52-23c2432c299e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:37.318809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-631120db-86f6-4f06-aaca-43e5dd2443a8 req-1193160c-4cc1-402e-8f52-23c2432c299e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:37.326412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:37.354107 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-631120db-86f6-4f06-aaca-43e5dd2443a8 req-1193160c-4cc1-402e-8f52-23c2432c299e service nova] Creating event network-vif-plugged:e2a0158e-5dd4-4f49-ade8-5f189d4347c7 for instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf on n-h2-843834-3 Jul 19 20:09:37.377217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-631120db-86f6-4f06-aaca-43e5dd2443a8 req-1193160c-4cc1-402e-8f52-23c2432c299e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090704 Jul 19 20:09:37.378617 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2419/4749] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:37.390770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:37.398541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:37.461769 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8b0d2afd-5e8e-454a-a52d-295396f870d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 0.651420 Jul 19 20:09:37.468539 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2331/4750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:36 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:38.493015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:38.493812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:38.506533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:38.507018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:38.507829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:38.515057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:38.898429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:38.932602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c824a28d-1f42-498d-ac21-677e3bebcbcf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1309 microversion: 2.1 time: 0.445956 Jul 19 20:09:38.933669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2420/4751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:38 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:39.966021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:39.967724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:40.003864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.005492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:40.009648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:40.029517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:40.347706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:40.364168 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67f6d9bb-cb0d-406b-b0fa-a1365cfc8515 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1490 microversion: 2.1 time: 0.413231 Jul 19 20:09:40.365531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2332/4752] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:39 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1490 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:40.645415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1727237493", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:41.009220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:43.204106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:43.204838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:43.208178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:43.209282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:43.211396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:43.223523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:43.288341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.288978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:43.296277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:43.297383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:43.388417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:43.397161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:43.421528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:43.425020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:43.498640 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6ef61cf-f2c5-46e1-ad72-e68b8521367f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.862365 Jul 19 20:09:43.500000 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2421/4753] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:09:43.514224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d191f72-29d7-47d2-84d9-b817caf3062d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:43.515919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d191f72-29d7-47d2-84d9-b817caf3062d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:43.787759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d191f72-29d7-47d2-84d9-b817caf3062d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:43.802835 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d191f72-29d7-47d2-84d9-b817caf3062d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1209 microversion: 2.1 time: 0.293845 Jul 19 20:09:43.804781 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2333/4754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:43 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1209 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:44.823248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-493fd48f-7a5b-4e14-98c2-8403c826050f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:44.824262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-493fd48f-7a5b-4e14-98c2-8403c826050f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:45.033666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-493fd48f-7a5b-4e14-98c2-8403c826050f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:45.061713 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-493fd48f-7a5b-4e14-98c2-8403c826050f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1209 microversion: 2.1 time: 0.236942 Jul 19 20:09:45.063638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2422/4755] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:44 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1209 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:46.082774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:46.084854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:46.130621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.137386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:46.141226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:46.143605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:47.402824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:47.433023 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90175b7f-1934-4440-98aa-21930b04cc07 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1269 microversion: 2.1 time: 1.356060 Jul 19 20:09:47.434626 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2334/4756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:46 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1269 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:48.152725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:48.165163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:48.222873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.233146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.239249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.240680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.470739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:48.489277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:48.520795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.521927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.524486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:48.527996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:48.775088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:48.807874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a0127608-15ee-4340-b338-025f5609666f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1267 microversion: 2.1 time: 0.343815 Jul 19 20:09:48.813768 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2335/4757] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:48 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:49.700825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:49.743114 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43b210d3-5985-4217-b465-64be13eb385e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.612364 Jul 19 20:09:49.761879 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2423/4758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:48 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:49.818205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:49.820535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:49.872219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:49.873422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:49.893029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.893530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.906532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:49.907521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:49.995450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.001894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.013449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:50.024323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:50.268724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:50.303220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42c538e4-0a19-4652-a622-a8107ba566e7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1267 microversion: 2.1 time: 0.474854 Jul 19 20:09:50.312444 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2424/4759] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:49 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1267 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:51.351396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:51.355801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:51.402217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.402697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.403721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:51.404216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:51.894255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:51.926936 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-38aff899-ce5f-458b-854c-b8329151cc35 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 2.132176 Jul 19 20:09:51.948577 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2336/4760] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:49 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:51.990312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:51.991996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:52.020538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.023716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:52.033357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:52.034282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.341500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:53.429810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.470383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7a7c5a9-c0b7-4314-b0c7-f7e3bfd20577 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 2.129025 Jul 19 20:09:53.472869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2425/4761] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:51 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:53.518890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:53.528898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-766ceb1c-3714-4b77-9868-de62fc08c23c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.578351 Jul 19 20:09:53.535475 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2337/4762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:51 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:53.578521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:53.583809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:53.632010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.638623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:53.645877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:53.660422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.490630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:54.491478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:54.495128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:54.520390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.527742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:54.538806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:54.539486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:55.052772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:09:55.310320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:55.334261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee36b2a1-c706-4c96-bec8-ab5e5a1837fa tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.777348 Jul 19 20:09:55.352161 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2426/4763] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:53 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:55.693643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1679760963", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1e5d8cfc-4319-48ca-95d7-3aa27f475ae1"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:55.855706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] validate_networks() for [('1e5d8cfc-4319-48ca-95d7-3aa27f475ae1', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:09:56.470996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:56.483120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b1eeca3-6164-40e4-ae18-4d61cc68b3ce tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.997010 Jul 19 20:09:56.486775 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2338/4764] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:54 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:09:57.517931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:57.525575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:09:57.617582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.619619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:57.634577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:57.643485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.063469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:09:59.077647 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fd309462-f4cc-47b3-abeb-2105f1865453 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.568956 Jul 19 20:09:59.088271 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2339/4765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:57 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:09:59.588147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:09:59.588608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:09:59.589053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:09:59.589494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:09:59.589886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:09:59.622352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.623222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.625665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.629906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.682477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2fce0c37-3230-4fcf-924b-7f5ceda625f1 req-1d98e9dc-f0a0-4422-b466-490cec16b027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd39d874-d416-4ad1-8c5f-2bdb89e2c509", "tag": "205a73d9-8335-4cba-8e36-2d7b8a154f47"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:09:59.726463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:09:59.726705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2fce0c37-3230-4fcf-924b-7f5ceda625f1 req-1d98e9dc-f0a0-4422-b466-490cec16b027 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:09:59.726952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2fce0c37-3230-4fcf-924b-7f5ceda625f1 req-1d98e9dc-f0a0-4422-b466-490cec16b027 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:09:59.750504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:09:59.780655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:09:59.785538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:09:59.794463 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2fce0c37-3230-4fcf-924b-7f5ceda625f1 req-1d98e9dc-f0a0-4422-b466-490cec16b027 service nova] Creating event network-changed:205a73d9-8335-4cba-8e36-2d7b8a154f47 for instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 on n-h1-843834-3 Jul 19 20:09:59.807467 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2fce0c37-3230-4fcf-924b-7f5ceda625f1 req-1d98e9dc-f0a0-4422-b466-490cec16b027 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131067 Jul 19 20:09:59.811184 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2340/4766] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:09:59.911392 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61be0879-1bac-4682-9619-73533ef90ba5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.224352 Jul 19 20:09:59.923519 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2427/4767] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:09:59.925889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f43a8758-59ea-45ec-a2c7-53a20d385a0d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:09:59.926892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f43a8758-59ea-45ec-a2c7-53a20d385a0d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.097639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:00.098271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:00.159447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.161028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.161942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:00.162424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:00.275932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f43a8758-59ea-45ec-a2c7-53a20d385a0d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.291174 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f43a8758-59ea-45ec-a2c7-53a20d385a0d tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1215 microversion: 2.1 time: 0.371495 Jul 19 20:10:00.305299 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2341/4768] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:09:59 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1215 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:00.817441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:00.851874 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b78ddd0-e26d-426f-be00-4e6c839af4cd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 0.759154 Jul 19 20:10:00.876651 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2428/4769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:00 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:01.322144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.332473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.354784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.355625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.360491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.361319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.476673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:01.493362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-25f4b62d-e31a-44fe-8f00-57a7fc7ea983 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1211 microversion: 2.1 time: 0.178918 Jul 19 20:10:01.520478 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2342/4770] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1211 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:01.880307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:01.881543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:01.908073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.917711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:01.920928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:01.922159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:02.533839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:02.535374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:02.558094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:02.559383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:02.560870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:02.561621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:03.034113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.051785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bce9fb44-aa58-4b5a-bb10-8d0c3fcc1e44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1285 microversion: 2.1 time: 0.522350 Jul 19 20:10:03.060130 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2343/4771] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:02 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1285 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:03.391610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:03.407967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b6729af-3277-4004-b5a3-899f10201213 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.531865 Jul 19 20:10:03.421247 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2429/4772] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:01 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:04.082437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.083476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.131839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.132497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.144317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.151438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.449228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:04.453401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:04.475924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.477590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.479680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:04.480671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:04.762555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:04.798990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-314046a1-00da-4f73-93af-2626a0f19773 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1273 microversion: 2.1 time: 0.722761 Jul 19 20:10:04.801442 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2344/4773] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1273 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:05.525028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:05.550698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-08ced678-7064-4ced-97ff-cb0ec34cd23d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.125418 Jul 19 20:10:05.551723 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2430/4774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:04 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:05.843607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:05.846867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:05.864619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.872469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:05.873764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:05.878023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.578752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:06.580174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:06.625734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.626587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.628077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:06.628870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:06.730278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:06.745363 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2dc434ba-e0f9-4b09-ad6d-fb2f5ff09d60 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.916935 Jul 19 20:10:06.745989 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2345/4775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:05 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:07.309585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:07.320610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ff71f22-dcce-4e82-ad5c-ee2e3e927672 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 0.756122 Jul 19 20:10:07.327408 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2431/4776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:06 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:07.765600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:07.766238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:07.778179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:07.794031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.794557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:07.811860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:07.812339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.344533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:08.345374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:08.382550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:08.384717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.385545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.386948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:08.387675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:08.391053 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9308f3da-af0f-47c1-bf74-2d93039fecff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.630735 Jul 19 20:10:08.391670 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2346/4777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:07 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:09.408601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:09.409386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:09.427074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.427791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.428805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:09.429468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:09.688111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:09.771443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:09.945654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:09.948546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=64 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:09.972239 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd9259d3-c91d-4613-a914-c18d6bd78bd4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.631743 Jul 19 20:10:09.973651 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2432/4778] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:08 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:10.118565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:10.127951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=80 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:10.143434 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fe6ad474-0541-4c6f-9b1a-dafd7c0c7b44 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.738689 Jul 19 20:10:10.157378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2347/4779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:09 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:10.338036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-08a804b5-7dcf-484f-902b-00451ae8b0a1 req-994d0001-b419-47a6-890b-5b8eab818074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd39d874-d416-4ad1-8c5f-2bdb89e2c509", "name": "network-vif-plugged", "status": "completed", "tag": "205a73d9-8335-4cba-8e36-2d7b8a154f47"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:10.372249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-08a804b5-7dcf-484f-902b-00451ae8b0a1 req-994d0001-b419-47a6-890b-5b8eab818074 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.377901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-08a804b5-7dcf-484f-902b-00451ae8b0a1 req-994d0001-b419-47a6-890b-5b8eab818074 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.403236 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-08a804b5-7dcf-484f-902b-00451ae8b0a1 req-994d0001-b419-47a6-890b-5b8eab818074 service nova] Creating event network-vif-plugged:205a73d9-8335-4cba-8e36-2d7b8a154f47 for instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 on n-h1-843834-3 Jul 19 20:10:10.420994 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-08a804b5-7dcf-484f-902b-00451ae8b0a1 req-994d0001-b419-47a6-890b-5b8eab818074 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088027 Jul 19 20:10:10.425949 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2433/4780] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:10.769535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-187ad6f1-bccc-4d67-bc20-5d7669612e47 req-2381bae0-9b26-4f68-851e-75abaf099891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c561d9d7-d60a-440c-84f2-50a9808e7460", "tag": "5d49e772-189b-4fb5-82da-5a1941374265"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:10.811375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:10.829777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-187ad6f1-bccc-4d67-bc20-5d7669612e47 req-2381bae0-9b26-4f68-851e-75abaf099891 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:10.834805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-187ad6f1-bccc-4d67-bc20-5d7669612e47 req-2381bae0-9b26-4f68-851e-75abaf099891 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:10.917830 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-187ad6f1-bccc-4d67-bc20-5d7669612e47 req-2381bae0-9b26-4f68-851e-75abaf099891 service nova] Creating event network-changed:5d49e772-189b-4fb5-82da-5a1941374265 for instance c561d9d7-d60a-440c-84f2-50a9808e7460 on n-h2-843834-3 Jul 19 20:10:10.942625 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-187ad6f1-bccc-4d67-bc20-5d7669612e47 req-2381bae0-9b26-4f68-851e-75abaf099891 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181563 Jul 19 20:10:10.952801 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2348/4781] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:10.995387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:10.996494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.035310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.036152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.037085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.037646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.171834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:11.172857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:11.194083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.198522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:11.199538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:11.203338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:12.196911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.227148 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46debb06-01fe-4ac6-87d9-3352fa4c91b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1309 microversion: 2.1 time: 1.236889 Jul 19 20:10:12.231660 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2434/4782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:10 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1309 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:12.256558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:12.278545 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4df6a51c-551e-4459-8ed3-aad92e6b6ffb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 1.112263 Jul 19 20:10:12.283565 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2349/4783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:11 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:13.252291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.254483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.271206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:13.273781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.274521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.276685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.277201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.297751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.298495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.359663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.373218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.375779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.376431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.699021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.722708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-602a66cc-e9b9-46f6-8f39-77e2920dbb63 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1491 microversion: 2.1 time: 0.476908 Jul 19 20:10:13.725602 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2435/4784] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1491 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:13.735666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:13.748693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a827c05-1a87-481e-813c-1a58c8ed66ef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.456014 Jul 19 20:10:13.755887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:13.758586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:13.760475 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2350/4785] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:13.775507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.775959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:13.776755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:13.777365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.293723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:14.304365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-05e2300e-f43b-453b-aa37-f3dce4a4ec0f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1490 microversion: 2.1 time: 0.560868 Jul 19 20:10:14.324746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:14.327149 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2436/4786] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:13 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1490 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:14.328274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:14.343494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.344432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.345493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.346100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.767839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:14.769125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:14.789114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.799667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:14.801712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:14.804240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.108465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.123593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3f9dd349-0903-469e-baa7-036f8343e291 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1491 microversion: 2.1 time: 0.803997 Jul 19 20:10:15.147875 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2351/4787] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:14 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1491 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:15.166786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:15.167440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:15.193285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.193752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.194576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.195054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.254633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:15.468674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8034d81c-18d2-4daa-8e76-740fe451386c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 204 len: 0 microversion: 2.1 time: 0.313568 Jul 19 20:10:15.473566 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2352/4788] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:15 2022] DELETE /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:15.486896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:15.487733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:15.511017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.512112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.512532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:15.516173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:15.696967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.723944 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f05a588-192d-4258-887d-6d353a4d76b6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.960503 Jul 19 20:10:15.729519 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2437/4789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:14 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:15.957439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:15.974083 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3a4a8f5-b829-4e29-9a2c-f994576fd638 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1497 microversion: 2.1 time: 0.498177 Jul 19 20:10:15.986310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2353/4790] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:15 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1497 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:16.743944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:16.744805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:16.756677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.757194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.758240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:16.758816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:16.994246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:16.994871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:17.009686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:17.012386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:17.013428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:17.018128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:17.663974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:17.686464 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-10f37460-633b-44dd-8da6-8cf89078b3df tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 0.947276 Jul 19 20:10:17.687110 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2438/4791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:16 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:17.707082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e438de72-e12b-4adb-bfe0-d79088c48fc1 req-3398b179-f06e-4f2c-8138-1f21b13c7302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c561d9d7-d60a-440c-84f2-50a9808e7460", "name": "network-vif-plugged", "status": "completed", "tag": "5d49e772-189b-4fb5-82da-5a1941374265"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:17.719884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:17.729940 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d260e9b9-38a1-4705-871e-f966605ccde9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1497 microversion: 2.1 time: 0.739718 Jul 19 20:10:17.733874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2354/4792] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:16 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1497 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:17.736042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e438de72-e12b-4adb-bfe0-d79088c48fc1 req-3398b179-f06e-4f2c-8138-1f21b13c7302 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:17.738723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e438de72-e12b-4adb-bfe0-d79088c48fc1 req-3398b179-f06e-4f2c-8138-1f21b13c7302 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:17.764323 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e438de72-e12b-4adb-bfe0-d79088c48fc1 req-3398b179-f06e-4f2c-8138-1f21b13c7302 service nova] Creating event network-vif-plugged:5d49e772-189b-4fb5-82da-5a1941374265 for instance c561d9d7-d60a-440c-84f2-50a9808e7460 on n-h2-843834-3 Jul 19 20:10:17.772770 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e438de72-e12b-4adb-bfe0-d79088c48fc1 req-3398b179-f06e-4f2c-8138-1f21b13c7302 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082915 Jul 19 20:10:17.777584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2439/4793] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:18.708876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:18.710333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:18.728287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e69e0004-dc4c-420d-9dee-e6222d909b64 req-4cbb09e8-84c6-4e54-8ebf-1183492fa78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd39d874-d416-4ad1-8c5f-2bdb89e2c509", "name": "network-vif-deleted", "tag": "205a73d9-8335-4cba-8e36-2d7b8a154f47"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:18.775514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.782479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.783635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.784231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.809768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e69e0004-dc4c-420d-9dee-e6222d909b64 req-4cbb09e8-84c6-4e54-8ebf-1183492fa78b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.810538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e69e0004-dc4c-420d-9dee-e6222d909b64 req-4cbb09e8-84c6-4e54-8ebf-1183492fa78b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.872141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e69e0004-dc4c-420d-9dee-e6222d909b64 req-4cbb09e8-84c6-4e54-8ebf-1183492fa78b service nova] Creating event network-vif-deleted:205a73d9-8335-4cba-8e36-2d7b8a154f47 for instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 on n-h1-843834-3 Jul 19 20:10:18.904961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e69e0004-dc4c-420d-9dee-e6222d909b64 req-4cbb09e8-84c6-4e54-8ebf-1183492fa78b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188465 Jul 19 20:10:18.910156 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2440/4794] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:18.940054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:18.941504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:18.971399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.971848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:18.974752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:18.975428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:19.254959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:19.314229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd11a9af-59d2-4bff-b3f6-e04da2f3a60a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 200 len: 1294 microversion: 2.1 time: 0.394965 Jul 19 20:10:19.323851 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2441/4795] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:18 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 1294 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:19.859871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:19.892738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-575aaf81-c201-4e57-8ff5-b0092d8413f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1315 microversion: 2.1 time: 1.191493 Jul 19 20:10:19.897219 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2355/4796] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:18 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:20.342938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:20.347978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:20.393914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.394432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.431341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.433787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.556784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 HTTP/1.1 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fd39d874-d416-4ad1-8c5f-2bdb89e2c509'} Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:20.592634 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:20.602479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:20.607155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f86efe1b-afc8-42a5-ae54-f534e1b50611 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 404 len: 111 microversion: 2.1 time: 0.270439 Jul 19 20:10:20.616331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2442/4797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:20 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:10:20.622334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:20.623633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:20.646392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.647435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.648466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.649103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:20.708549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:10:20.922636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:20.936430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:20.973506 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b8649bb-e7a7-4dff-b4a3-d96cac675831 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 204 len: 0 microversion: 2.1 time: 0.357475 Jul 19 20:10:20.979329 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2356/4798] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:10:20 2022] DELETE /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:10:20.983289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:20.985440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.004266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.004838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.010979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:21.011737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:21.039175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.039827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.045239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.045799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.738792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:21.755013 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62bb9c6c-c812-467f-9eec-25df96db3377 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1502 microversion: 2.1 time: 0.841279 Jul 19 20:10:21.760697 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2443/4799] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:20 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1502 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:21.790005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:21.790687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:21.805438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.807602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.809711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:21.810547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:21.860561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:21.884611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-77dece85-1c9f-42d6-84d4-3d5c5b717195 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1496 microversion: 2.1 time: 0.899462 Jul 19 20:10:21.885458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2357/4800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:20 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1496 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:22.905973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:22.908235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:22.929598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:22.933208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:22.935776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:22.937464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:23.295208 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Removing security group fef569ce-f9aa-43ba-8e1b-e791b43cfc98 from port 5d49e772-189b-4fb5-82da-5a1941374265 Jul 19 20:10:25.544859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:25.578072 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9790cd0-e029-42fd-af9b-c534e701086e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1496 microversion: 2.1 time: 2.678955 Jul 19 20:10:25.579168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2358/4801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:22 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1496 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:25.599742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6f27bca2-73a5-4566-a01a-e4110e1efd67 req-259c1d68-3c66-44d7-be71-7c06903c7e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2e479-3bd9-4e5d-872b-69983c1a2bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "e2a0158e-5dd4-4f49-ade8-5f189d4347c7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:25.636372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6f27bca2-73a5-4566-a01a-e4110e1efd67 req-259c1d68-3c66-44d7-be71-7c06903c7e9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:25.637159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6f27bca2-73a5-4566-a01a-e4110e1efd67 req-259c1d68-3c66-44d7-be71-7c06903c7e9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:25.682531 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6f27bca2-73a5-4566-a01a-e4110e1efd67 req-259c1d68-3c66-44d7-be71-7c06903c7e9f service nova] Creating event network-vif-unplugged:e2a0158e-5dd4-4f49-ade8-5f189d4347c7 for instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf on n-h2-843834-3 Jul 19 20:10:25.706210 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6f27bca2-73a5-4566-a01a-e4110e1efd67 req-259c1d68-3c66-44d7-be71-7c06903c7e9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124322 Jul 19 20:10:25.706710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2359/4802] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:26.439705 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ceffa9a-ccbd-4a4c-9067-0d4786766688 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460/action" status: 202 len: 0 microversion: 2.1 time: 4.655329 Jul 19 20:10:26.441266 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2444/4803] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:10:21 2022] POST /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460/action => generated 0 bytes in 4658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:10:26.455201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:26.456510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:26.503063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.504363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:26.532585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:26.542803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.187431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-30ba059c-aaf6-4794-9af4-d65be6aecffd req-0cbadca1-be33-4799-b3b7-f496a36d9067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c561d9d7-d60a-440c-84f2-50a9808e7460", "tag": "5d49e772-189b-4fb5-82da-5a1941374265"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:27.212829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-30ba059c-aaf6-4794-9af4-d65be6aecffd req-0cbadca1-be33-4799-b3b7-f496a36d9067 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.213538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-30ba059c-aaf6-4794-9af4-d65be6aecffd req-0cbadca1-be33-4799-b3b7-f496a36d9067 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.225846 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-30ba059c-aaf6-4794-9af4-d65be6aecffd req-0cbadca1-be33-4799-b3b7-f496a36d9067 service nova] Creating event network-changed:5d49e772-189b-4fb5-82da-5a1941374265 for instance c561d9d7-d60a-440c-84f2-50a9808e7460 on n-h2-843834-3 Jul 19 20:10:27.247342 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-30ba059c-aaf6-4794-9af4-d65be6aecffd req-0cbadca1-be33-4799-b3b7-f496a36d9067 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.732594 Jul 19 20:10:27.248999 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2445/4804] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:27.266114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:27.267539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:27.302235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.302839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.303809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:27.308273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:27.949590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:28.004552 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c6d5469-2915-430c-93fb-be337060b600 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1460 microversion: 2.1 time: 1.556346 Jul 19 20:10:28.012062 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2360/4805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:26 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1460 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:28.048118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:28.051792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:28.073983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.075279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:28.076346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:28.077551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:29.395363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:29.458905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-397d3c87-98eb-49a5-82d8-bd77bc8120ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1496 microversion: 2.1 time: 2.202108 Jul 19 20:10:29.462655 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2446/4806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:27 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1496 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:30.286246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:30.299497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ecf4258-2816-411b-891d-1c9a4b43a34e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 2.265952 Jul 19 20:10:30.304817 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2361/4807] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:28 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:30.325558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:30.326265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:30.344457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.344949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.347546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.348077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.379512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d4181ddb-7437-4125-a2ba-a1e91773de28 req-a36ed217-d6f4-4bca-a72f-f0c401ab7b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2e479-3bd9-4e5d-872b-69983c1a2bdf", "name": "network-vif-deleted", "tag": "e2a0158e-5dd4-4f49-ade8-5f189d4347c7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:30.430553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d4181ddb-7437-4125-a2ba-a1e91773de28 req-a36ed217-d6f4-4bca-a72f-f0c401ab7b9b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.430553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d4181ddb-7437-4125-a2ba-a1e91773de28 req-a36ed217-d6f4-4bca-a72f-f0c401ab7b9b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.440733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d4181ddb-7437-4125-a2ba-a1e91773de28 req-a36ed217-d6f4-4bca-a72f-f0c401ab7b9b service nova] Creating event network-vif-deleted:e2a0158e-5dd4-4f49-ade8-5f189d4347c7 for instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf on n-h2-843834-3 Jul 19 20:10:30.456102 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d4181ddb-7437-4125-a2ba-a1e91773de28 req-a36ed217-d6f4-4bca-a72f-f0c401ab7b9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082438 Jul 19 20:10:30.457275 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2362/4808] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:30.484588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:30.489484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:30.511352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.512198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.513404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:30.515552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:30.526967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:30.709913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:30.723394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7b5553f-e00e-443c-b2f4-dd2954ccc51c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 200 len: 1294 microversion: 2.1 time: 0.246404 Jul 19 20:10:30.739296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2363/4809] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:30 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 1294 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:31.165153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.173946 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-305f81d6-6c1a-41c2-9922-48515ed8daa5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.855036 Jul 19 20:10:31.174561 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2447/4810] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:30 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:31.190404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.191359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.200856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.201563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.202615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.203350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.746338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.747156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.754891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:31.766404 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a1e0a71-1cb2-42af-958a-7e40b7dd1da1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.580155 Jul 19 20:10:31.775536 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2364/4811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:31 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:31.782254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.783180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.798594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.802448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:31.804119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.812226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:31.867601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.868986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.870600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:31.880941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:31.888286 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf HTTP/1.1 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '05a2e479-3bd9-4e5d-872b-69983c1a2bdf'} Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:31.897602 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:10:31.901177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:10:31.906507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:10:31.910140 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5d49d5e-5d29-43b4-9490-3b058e715678 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 404 len: 111 microversion: 2.1 time: 0.168708 Jul 19 20:10:31.916566 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2448/4812] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:31 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:10:32.167490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1481650210", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:32.240495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:10:32.513716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:32.535646 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac30ef9e-d0a5-4e91-9e83-ec4f41202f6e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.740368 Jul 19 20:10:32.536539 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2365/4813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:31 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:32.778628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-645820248", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1e5d8cfc-4319-48ca-95d7-3aa27f475ae1"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:32.862384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] validate_networks() for [('1e5d8cfc-4319-48ca-95d7-3aa27f475ae1', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:10:33.549857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:10:33.551075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:10:33.551836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:10:33.552409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:10:33.552976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:10:33.569500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:33.569956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:33.574189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:33.574955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:33.623102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:10:33.629315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:10:33.663758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:10:33.666138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:10:33.789015 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dbf4fdd5-fe8a-4313-891c-7004f5175627 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625788 Jul 19 20:10:33.789686 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2449/4814] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:10:33.802271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd979443-d0b7-40a3-b5cc-1aa6982f8a86 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:33.818211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd979443-d0b7-40a3-b5cc-1aa6982f8a86 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:34.012152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd979443-d0b7-40a3-b5cc-1aa6982f8a86 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:34.030055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd979443-d0b7-40a3-b5cc-1aa6982f8a86 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1209 microversion: 2.1 time: 0.231507 Jul 19 20:10:34.047024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2450/4815] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:33 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:34.622813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:10:34.623807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:10:34.624460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:10:34.625042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:10:34.625659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:10:34.645586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:34.649169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.650601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:34.660957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:34.737930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:10:34.769468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Getting quotas for user ce9eba1cc82845ad86f6b97b7f828bec and project 39730f5064e948989e59d72d416ac341. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:10:34.835908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:10:34.840598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:10:35.009199 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c1b440fd-098b-4000-a369-452b9f0cf378 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254726 Jul 19 20:10:35.021072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2366/4816] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:10:35.036537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f759577-3cd8-4237-8956-afb3a22b8d6f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:35.038466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f759577-3cd8-4237-8956-afb3a22b8d6f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:35.069561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:35.070884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:35.155693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:35.164953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:35.166111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:35.166843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:35.475590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f759577-3cd8-4237-8956-afb3a22b8d6f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:35.482213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:35.528568 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30bb9131-48f6-4b8b-8ad6-3e0b60ed0780 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1205 microversion: 2.1 time: 0.465661 Jul 19 20:10:35.533103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f759577-3cd8-4237-8956-afb3a22b8d6f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1214 microversion: 2.1 time: 0.502624 Jul 19 20:10:35.555156 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2451/4817] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:35 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1214 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:35.559854 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2367/4818] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:35 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1205 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:36.565710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff53f7a3-b8cb-45fb-a880-f254e4863c72 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:36.569273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ff53f7a3-b8cb-45fb-a880-f254e4863c72 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:36.579638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:36.582278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:36.603639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.605365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:36.610049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:36.616159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:37.024766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:37.057526 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-140bbe03-9b44-474c-a55d-a63ea349046c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1279 microversion: 2.1 time: 0.511530 Jul 19 20:10:37.058809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2452/4819] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:36 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:37.154213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ff53f7a3-b8cb-45fb-a880-f254e4863c72 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:37.207963 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff53f7a3-b8cb-45fb-a880-f254e4863c72 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1214 microversion: 2.1 time: 0.648671 Jul 19 20:10:37.211401 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2368/4820] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:36 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1214 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:38.081842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:38.082455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:38.104476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:38.107828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.110007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:38.112698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.240118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:38.241839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:38.247478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:38.280048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:38.281268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.282838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:38.283591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:38.465621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:38.475144 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2213ae5c-3ea8-4c36-bba0-160776c0f9ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1267 microversion: 2.1 time: 0.397215 Jul 19 20:10:38.488974 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2453/4821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:38 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1267 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:38.506633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:38.527146 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a183035-82c4-4aea-9924-232faeb34271 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1284 microversion: 2.1 time: 0.291823 Jul 19 20:10:38.541340 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2369/4822] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:38 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:39.500073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:39.501181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:39.525443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.526341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.531415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.535397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.555978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:39.559535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:39.576400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.577727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:39.580705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:39.581979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:40.064578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:40.093779 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a927a68-a721-4394-885d-af20bd44e629 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1272 microversion: 2.1 time: 0.543813 Jul 19 20:10:40.107554 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2370/4823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:39 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:41.138019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:41.145710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:41.178542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.183240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.193277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:41.193752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:41.623788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:41.633417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=90 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:41.652720 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4cf1b8a-87ae-4f17-a598-d6459ae8d546 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 2.159638 Jul 19 20:10:41.659208 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2454/4824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:39 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:42.486023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:42.517504 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35b45fea-7967-4c6a-8d0c-ff278d43755f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.395926 Jul 19 20:10:42.518223 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2371/4825] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:41 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:42.679882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:42.681318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:42.702041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:42.704274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:42.712850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:42.713914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:43.352589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:43.376450 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f351c047-7a3f-4228-9a1e-4495a02d3c10 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 0.701059 Jul 19 20:10:43.392999 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2455/4826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:42 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:43.538310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:43.538989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:43.551982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:43.555969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:43.559253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:43.563198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:44.415577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:44.421016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:44.434657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:44.440919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:44.473925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:44.501563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:44.501563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:44.505206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:44.520171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:44.571120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5736f53a-a462-4bcb-b53b-70ff3a107024 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.035154 Jul 19 20:10:44.573987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2372/4827] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:43 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:45.532057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:45.594211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:45.597099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:45.621144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:45.646094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:45.646811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:45.648231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:45.648961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:45.756671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:45.793494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e119211-fe96-4c1e-a767-c7b5f6d790a4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 1.390854 Jul 19 20:10:45.799073 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2456/4828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:44 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:46.661726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a9be122b-a249-4acd-ad5c-fe64a6f5139b req-a9a94222-7f94-4223-8e4a-464e8b79a0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6714c70b-9e2c-44df-9955-cbf1b325a6db", "tag": "5ef34a19-2fc1-459c-92cd-2c40a940bfb1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:46.699867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a9be122b-a249-4acd-ad5c-fe64a6f5139b req-a9a94222-7f94-4223-8e4a-464e8b79a0a4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:46.707024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a9be122b-a249-4acd-ad5c-fe64a6f5139b req-a9a94222-7f94-4223-8e4a-464e8b79a0a4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:46.757168 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a9be122b-a249-4acd-ad5c-fe64a6f5139b req-a9a94222-7f94-4223-8e4a-464e8b79a0a4 service nova] Creating event network-changed:5ef34a19-2fc1-459c-92cd-2c40a940bfb1 for instance 6714c70b-9e2c-44df-9955-cbf1b325a6db on n-h2-843834-3 Jul 19 20:10:46.772067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a9be122b-a249-4acd-ad5c-fe64a6f5139b req-a9a94222-7f94-4223-8e4a-464e8b79a0a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114611 Jul 19 20:10:46.777397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2457/4829] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:10:46.821147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:46.822090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:46.830144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:46.830849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:46.831911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:46.832505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:47.203171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:47.213972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:10:47.222735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-58c0e8d1-632a-4450-a3e1-bfed136aa4ba tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.636140 Jul 19 20:10:47.231888 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2373/4830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:45 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:48.061203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:48.084358 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6b49e22-b4ab-4617-a568-eae0babd35ff tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 1.270515 Jul 19 20:10:48.095608 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2458/4831] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:46 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:48.245743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:48.247913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:48.282520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:48.282875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:48.293018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:48.293522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:49.004607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-37a511c7-f5f9-49c2-b4df-7b0aa5a9f1e5 req-099e1268-328b-4814-8c2b-c2a474f838ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1664ff4b-7ed8-43a2-9f46-9faa7e0d823e", "tag": "ff0bbf35-4d40-46f8-8be3-ce2391341fa8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:49.030731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-37a511c7-f5f9-49c2-b4df-7b0aa5a9f1e5 req-099e1268-328b-4814-8c2b-c2a474f838ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:49.036715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-37a511c7-f5f9-49c2-b4df-7b0aa5a9f1e5 req-099e1268-328b-4814-8c2b-c2a474f838ad service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:49.082331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-37a511c7-f5f9-49c2-b4df-7b0aa5a9f1e5 req-099e1268-328b-4814-8c2b-c2a474f838ad service nova] Creating event network-changed:ff0bbf35-4d40-46f8-8be3-ce2391341fa8 for instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e on n-h2-843834-3 Jul 19 20:10:49.094426 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-37a511c7-f5f9-49c2-b4df-7b0aa5a9f1e5 req-099e1268-328b-4814-8c2b-c2a474f838ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104620 Jul 19 20:10:49.100045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2459/4832] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:49.112277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:49.117286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:49.148290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:49.149038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:49.150345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:49.154594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:49.162664 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:10:49.163265 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:10:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db (ip 10.222.0.23) !!! Jul 19 20:10:49.402026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:49.412496 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ab3d906-2a5b-49cd-8442-8bc9d8fc41c0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.173224 Jul 19 20:10:49.422468 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2374/4833] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:48 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:49.519085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:49.591581 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d1a8528-2b45-4beb-b0eb-c7a0843f8cd6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 0.481666 Jul 19 20:10:49.592658 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2460/4834] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:49 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:50.435829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:50.437417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:50.457038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:50.457715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:50.460329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:50.464071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:50.628451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:50.633611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:50.676051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:50.681144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:50.682535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:50.696081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:52.129346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:52.191950 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fab1536b-30b6-490e-8ba2-3ee3fc5392a4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.755203 Jul 19 20:10:52.193115 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2375/4835] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:50 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:52.265016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:52.283245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-473e39cc-ac8b-44ff-9188-7f9d95efdfc7 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 1.661246 Jul 19 20:10:52.285167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2461/4836] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:50 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:53.221844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:53.229657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:53.269603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:53.277145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:53.281118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:53.284583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:53.307930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:53.311581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:53.338992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:53.341814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:53.343161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:53.345622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:54.782382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:54.795741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a69c2b0e-1e3f-49c4-be0b-833c8d1496cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 1.497800 Jul 19 20:10:54.796553 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2462/4837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:53 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:54.817474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:54.860913 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9613d209-c0a4-46f4-a4c7-0962bb75ddfd tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.654155 Jul 19 20:10:54.870549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2376/4838] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:53 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:55.146168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6bf214bb-a20d-49f5-82ba-d745b2265d6c req-d026b20e-9d79-436b-af0b-17c96a3d2bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6714c70b-9e2c-44df-9955-cbf1b325a6db", "name": "network-vif-plugged", "status": "completed", "tag": "5ef34a19-2fc1-459c-92cd-2c40a940bfb1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:55.163046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6bf214bb-a20d-49f5-82ba-d745b2265d6c req-d026b20e-9d79-436b-af0b-17c96a3d2bf2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.167731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6bf214bb-a20d-49f5-82ba-d745b2265d6c req-d026b20e-9d79-436b-af0b-17c96a3d2bf2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.212600 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6bf214bb-a20d-49f5-82ba-d745b2265d6c req-d026b20e-9d79-436b-af0b-17c96a3d2bf2 service nova] Creating event network-vif-plugged:5ef34a19-2fc1-459c-92cd-2c40a940bfb1 for instance 6714c70b-9e2c-44df-9955-cbf1b325a6db on n-h2-843834-3 Jul 19 20:10:55.226183 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6bf214bb-a20d-49f5-82ba-d745b2265d6c req-d026b20e-9d79-436b-af0b-17c96a3d2bf2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.427374 Jul 19 20:10:55.227808 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2463/4839] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:55.834011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:55.835710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:55.865997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.882257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:55.882993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:55.886721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.895614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.898411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.930664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.931771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:55.933611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:55.934023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:56.977733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:56.999676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4501843b-639f-42f2-aa86-4326432c9271 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 1.173390 Jul 19 20:10:57.013266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2377/4840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:55 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:57.092688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:57.106447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ecb2d7ce-c563-4f71-b068-29201e493d10 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1314 microversion: 2.1 time: 1.230659 Jul 19 20:10:57.107092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2464/4841] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:55 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1314 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:57.632484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c9e59d60-7d66-4e4a-9316-493c3126c0f3 req-9a27885b-2a99-436a-849f-ea164078b39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664ff4b-7ed8-43a2-9f46-9faa7e0d823e", "name": "network-vif-plugged", "status": "completed", "tag": "ff0bbf35-4d40-46f8-8be3-ce2391341fa8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:57.653652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c9e59d60-7d66-4e4a-9316-493c3126c0f3 req-9a27885b-2a99-436a-849f-ea164078b39b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:57.665012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c9e59d60-7d66-4e4a-9316-493c3126c0f3 req-9a27885b-2a99-436a-849f-ea164078b39b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:57.690581 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c9e59d60-7d66-4e4a-9316-493c3126c0f3 req-9a27885b-2a99-436a-849f-ea164078b39b service nova] Creating event network-vif-plugged:ff0bbf35-4d40-46f8-8be3-ce2391341fa8 for instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e on n-h2-843834-3 Jul 19 20:10:57.699626 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c9e59d60-7d66-4e4a-9316-493c3126c0f3 req-9a27885b-2a99-436a-849f-ea164078b39b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071263 Jul 19 20:10:57.700330 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2378/4842] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:10:58.019221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:58.020185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:58.034281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.038367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:58.042084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.044997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:58.147148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:58.149050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:58.190271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.190734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:58.191646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.192106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:58.730166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:58.732949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:58.745480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-061a4598-b2b5-4f75-9f1e-a87af5eae477 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1501 microversion: 2.1 time: 0.615304 Jul 19 20:10:58.746103 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2379/4843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:58 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1501 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:10:58.764324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-744431d3-6184-4969-bffa-11285f03e2d6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 0.751130 Jul 19 20:10:58.766507 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2465/4844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:58 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:58.766725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:10:58.767097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:58.808420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.808420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:58.808420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:58.808420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.046106 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d713a97-7f54-49f1-b05e-d3ad2f0185f6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db/action" status: 202 len: 0 microversion: 2.1 time: 0.286512 Jul 19 20:10:59.051059 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2380/4845] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:10:58 2022] POST /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:10:59.079028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:59.084068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:59.116955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.117827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.129520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.130565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.783208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:10:59.784026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:10:59.800857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.801954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.803622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:10:59.806487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:10:59.826834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:10:59.850738 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a866540-14e7-4b56-ad13-384582f4561b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1506 microversion: 2.1 time: 0.791754 Jul 19 20:10:59.854234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2466/4846] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:59 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:10:59.879458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:00.720236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:00.732821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c79890d-0b5a-4aa1-9ccc-d318cef74e17 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1309 microversion: 2.1 time: 0.954038 Jul 19 20:11:00.737831 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2381/4847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:10:59 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1309 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:00.870677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:00.871638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:00.886240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:00.893882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:00.894707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:00.895417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.395015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:01.424172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72966f40-0bf6-4240-b5c1-6503e13fac65 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1486 microversion: 2.1 time: 0.558614 Jul 19 20:11:01.425591 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2467/4848] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:00 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1486 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:01.453101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:01.456035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:01.480837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.483113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.487384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.491880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.560026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lazy-loading 'flavor' on Instance uuid 6714c70b-9e2c-44df-9955-cbf1b325a6db {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:11:01.763795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:01.764422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:01.776936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.777779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:01.781324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:01.783698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.090287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:02.104559 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d049283f-fc99-4d82-b8d1-27829d57a175 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1490 microversion: 2.1 time: 0.345192 Jul 19 20:11:02.105163 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2468/4849] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:01 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1490 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:02.158591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:02.161920 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84c6bb04-139f-4e45-bde1-ad7e4a5204f0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db/action" status: 202 len: 0 microversion: 2.1 time: 0.712393 Jul 19 20:11:02.168423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:02.176449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2382/4850] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:11:01 2022] POST /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:11:02.184952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.189955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.192638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.196507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.200523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:02.214249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:02.243187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.244208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.247377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.249421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.447035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce3d5498-eee0-43ab-89e5-0d676bb691ea tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "PUT /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1085 microversion: 2.1 time: 0.312916 Jul 19 20:11:02.458190 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2469/4851] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:11:02 2022] PUT /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1085 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:02.473663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:02.474633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:02.490285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.494432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.495410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:02.495874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:02.777305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:02.797311 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce7206fd-beb4-4869-a259-afd655b78ec4 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1492 microversion: 2.1 time: 0.605078 Jul 19 20:11:02.799515 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2383/4852] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:02 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1492 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:03.077190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:03.094629 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa1e1043-d2da-4d8c-9ffd-5abadfab2e5e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1511 microversion: 2.1 time: 0.624299 Jul 19 20:11:03.098468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2470/4853] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:02 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1511 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:03.117923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:03.118615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:03.140209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.141026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:03.143261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.144925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:03.830545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:03.832132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:03.856462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.862386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:03.866890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:03.867730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:04.256535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:04.281841 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b4214d8-4043-4f7f-a12d-bd65fa2947ba tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1511 microversion: 2.1 time: 1.163782 Jul 19 20:11:04.295014 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2384/4854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:03 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1511 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:04.308558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:04.312479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:04.346846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:04.350508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:04.354375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:04.358188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:04.459940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:11:04.538274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:04.555148 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ebe3ae3-6c20-4cc8-9cdf-347fae919c5e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1513 microversion: 2.1 time: 0.735955 Jul 19 20:11:04.559858 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2471/4855] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:03 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1513 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:04.884655 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12a1976e-6b53-4b71-89a6-cef33f19d897 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 204 len: 0 microversion: 2.1 time: 0.574938 Jul 19 20:11:04.885423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2385/4856] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:11:04 2022] DELETE /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:11:04.897540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:04.899354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:04.910089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:04.911314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:04.912770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:04.913548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:05.180005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:05.184023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:05.202005 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81fddde2-ba66-4c06-88e0-f690532ecd7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1517 microversion: 2.1 time: 0.310634 Jul 19 20:11:05.205973 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2472/4857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:04 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:05.587642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:05.599541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:05.629110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:05.629583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:05.630584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:05.631072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:05.942906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-bd03427f-8e5d-404a-afd8-4a3661733b3f req-4a8d8eb3-129f-4a9c-987c-3962e6466dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6714c70b-9e2c-44df-9955-cbf1b325a6db", "name": "network-vif-plugged", "status": "completed", "tag": "5ef34a19-2fc1-459c-92cd-2c40a940bfb1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:05.979741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-bd03427f-8e5d-404a-afd8-4a3661733b3f req-4a8d8eb3-129f-4a9c-987c-3962e6466dcb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:05.981831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-bd03427f-8e5d-404a-afd8-4a3661733b3f req-4a8d8eb3-129f-4a9c-987c-3962e6466dcb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:06.051692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-bd03427f-8e5d-404a-afd8-4a3661733b3f req-4a8d8eb3-129f-4a9c-987c-3962e6466dcb service nova] Creating event network-vif-plugged:5ef34a19-2fc1-459c-92cd-2c40a940bfb1 for instance 6714c70b-9e2c-44df-9955-cbf1b325a6db on n-h2-843834-3 Jul 19 20:11:06.078258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-bd03427f-8e5d-404a-afd8-4a3661733b3f req-4a8d8eb3-129f-4a9c-987c-3962e6466dcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133823 Jul 19 20:11:06.078997 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2473/4858] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:11:06.144981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:06.200284 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0ae7c7e-e040-4561-9519-61143109d044 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.622724 Jul 19 20:11:06.213320 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2386/4859] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:05 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:06.223661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:06.225470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:06.240925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:06.241509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:06.242568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:06.243818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:06.656334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:06.704870 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-24e5e5b4-efe3-4611-8dd7-a8c13eb33bab tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1517 microversion: 2.1 time: 0.486028 Jul 19 20:11:06.706070 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2474/4860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:06 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1517 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:07.221820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:07.222750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:07.243550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.244056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:07.246846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.247316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:07.734614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:07.735660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:07.769342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.775955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:07.784626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:07.786432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:08.001435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.016269 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0e73818f-75a6-4ece-9deb-d58198b4aa89 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.799052 Jul 19 20:11:08.020292 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2387/4861] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:07 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:08.106400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:08.130789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1fc44a1b-ecf1-48d1-9a12-2947c7a6ead9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1517 microversion: 2.1 time: 0.400271 Jul 19 20:11:08.134122 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2475/4862] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:07 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1517 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:09.057722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:09.059042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:09.061472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:09.166670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:09.167697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:09.191112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.193997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.200118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.202658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.203949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.208082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:09.214799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:09.220507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:10.229731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:10.244364 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43d81507-7ef3-4160-902c-0ecad6a5d743 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 200 len: 1517 microversion: 2.1 time: 1.085339 Jul 19 20:11:10.245602 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2476/4863] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:09 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 1517 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:10.274590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:10.316752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f0616a16-5c75-423e-a902-93ca3c9c8d14 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.266212 Jul 19 20:11:10.317886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2388/4864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:09 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:10.846888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ced3a0af-13af-4320-b94a-f441a142aacd req-ebe4303b-7873-4017-b995-4b9a65336ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664ff4b-7ed8-43a2-9f46-9faa7e0d823e", "name": "network-vif-deleted", "tag": "ff0bbf35-4d40-46f8-8be3-ce2391341fa8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:10.881025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ced3a0af-13af-4320-b94a-f441a142aacd req-ebe4303b-7873-4017-b995-4b9a65336ec7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:10.887693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ced3a0af-13af-4320-b94a-f441a142aacd req-ebe4303b-7873-4017-b995-4b9a65336ec7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:10.935507 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ced3a0af-13af-4320-b94a-f441a142aacd req-ebe4303b-7873-4017-b995-4b9a65336ec7 service nova] Creating event network-vif-deleted:ff0bbf35-4d40-46f8-8be3-ce2391341fa8 for instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e on n-h2-843834-3 Jul 19 20:11:10.980510 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ced3a0af-13af-4320-b94a-f441a142aacd req-ebe4303b-7873-4017-b995-4b9a65336ec7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.707840 Jul 19 20:11:10.987479 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2477/4865] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:11:11.266868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:11.267810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:11.277881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.290668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.292270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.292921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.334372 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:11:11.336037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e HTTP/1.1 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1664ff4b-7ed8-43a2-9f46-9faa7e0d823e'} Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:11:11.337548 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a912da22-39ff-41f4-896e-2fc8c3dc369c tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 404 len: 111 microversion: 2.1 time: 0.077576 Jul 19 20:11:11.341970 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2389/4866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:11 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:11:11.346816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:11.357764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.358656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.360036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:11.360717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:11.808430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-424257070", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0215f5e2-0d86-430d-8367-34bc9d16f8ae"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:12.100332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] validate_networks() for [('0215f5e2-0d86-430d-8367-34bc9d16f8ae', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:11:12.551446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:12.566951 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28f5439c-b657-4a0f-a0c3-d8aa4ee9fc4a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.236535 Jul 19 20:11:12.588376 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2478/4867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:11 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:13.532956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:11:13.533948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:11:13.534861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:11:13.535678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:11:13.537319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:11:13.619320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:13.620531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:13.622305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.623247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.633583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.634767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.719257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.727296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.748840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:13.756433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:13.804842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:11:13.857655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Getting quotas for user 65aed851d7ec4a49a1ea208845829dd9 and project e9780efcf1d04ba1b27a2bb19005a703. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:11:13.985362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:11:13.991250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:11:14.307952 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b642260-876c-4fa2-9545-5016e7e9b7eb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.507620 Jul 19 20:11:14.329989 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2390/4868] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:11:14.365672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7a7eab48-7f74-4442-98b7-a3367112bf6f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:14.389882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a7eab48-7f74-4442-98b7-a3367112bf6f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:14.786954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7a7eab48-7f74-4442-98b7-a3367112bf6f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.795774 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7a7eab48-7f74-4442-98b7-a3367112bf6f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1208 microversion: 2.1 time: 0.463641 Jul 19 20:11:14.799071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2391/4869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:14 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1208 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:14.927273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:14.956026 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-69d715c9-d08e-45cf-88d6-af10de690dc8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.369921 Jul 19 20:11:14.972352 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2479/4870] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:13 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:15.846208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8626ee11-c5d2-4aa6-9715-0b87feed99cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:15.850717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8626ee11-c5d2-4aa6-9715-0b87feed99cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:15.981223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:15.983890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:16.001995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=48 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:16.009313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:16.011051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:16.013377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:16.014727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:16.230805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8626ee11-c5d2-4aa6-9715-0b87feed99cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:16.239559 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8626ee11-c5d2-4aa6-9715-0b87feed99cb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1208 microversion: 2.1 time: 0.402016 Jul 19 20:11:16.244384 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2392/4871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:15 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1208 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:16.572484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:16.679560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9678ec4-0a59-408c-9a2d-177de359ed54 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.702520 Jul 19 20:11:16.681656 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2480/4872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:15 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:17.276402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:17.277412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:17.323515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.324795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.332439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.333151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.683728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:17.704203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4d9b21e-8eb8-4322-8a89-98e555662e90 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1268 microversion: 2.1 time: 0.435595 Jul 19 20:11:17.711315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:17.712786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:17.717166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2393/4873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:17 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1268 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:17.744073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.745507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:17.758737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:17.759448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.732707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:18.734395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:18.773043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.773629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:18.774812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:18.775424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:19.012441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:19.022107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:19.043990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce55aa20-8c72-4022-8580-16fb410aa8ec tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1266 microversion: 2.1 time: 0.316801 Jul 19 20:11:19.046658 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2394/4874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:18 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:19.052712 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a90ebfe4-aafa-4136-8857-2fb1c82131d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.345867 Jul 19 20:11:19.055867 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2481/4875] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:17 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:20.094389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:20.103681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:20.106843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:20.140165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:20.149359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:20.149936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:20.150855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:20.151414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:20.176893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:20.177358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:20.178172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:20.178619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:20.731683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:20.760846 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f0096d2-bffd-4ace-a07c-fb41cdb9d377 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1266 microversion: 2.1 time: 0.697548 Jul 19 20:11:20.764174 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2395/4876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:20 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1266 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:21.801721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:21.804265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:21.843925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.845319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:21.849282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:21.850649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:22.341441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:22.367839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83bcd3f8-6ed2-4c30-94d5-56f598c9b7bb tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1266 microversion: 2.1 time: 0.576795 Jul 19 20:11:22.376426 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2396/4877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:21 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1266 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:22.404108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:22.417610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-27af0a91-a221-42c4-a47d-5547cbef59de tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 2.342615 Jul 19 20:11:22.430030 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2482/4878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:20 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:23.394249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:23.395841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:23.423311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.424337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.425695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.428944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.459213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:23.461860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:23.486614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.496113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:23.523817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.525556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:23.535660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:23.745104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:24.835678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:24.849865 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ad31f7e-a540-4665-ab51-df656ff4f54a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.415959 Jul 19 20:11:24.851085 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2483/4879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:23 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:25.618034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:25.630593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27fa69ac-d94f-4f3d-a23e-8070ece95f8d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 2.241429 Jul 19 20:11:25.636717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2397/4880] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:23 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:25.871870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:25.877052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:25.893674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:25.894381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:25.895845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:25.896695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.659635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:26.661739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:26.672763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:26.679796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.680983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:26.683166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:26.684344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:27.988565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:28.012035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1256a80b-5564-48d6-af61-b6152508e3d6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 2.136867 Jul 19 20:11:28.016649 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2484/4881] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:25 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:29.042093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:29.045224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:29.066510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.067319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.068297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.068896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.215745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:29.248782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3dececb-14b4-4f0c-8699-90dd4da5b0dd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 2.598491 Jul 19 20:11:29.260571 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2398/4882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:26 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:29.590085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3dd9034e-fefc-43cd-a4ef-136801b768c4 req-86a85f57-33af-43f1-83fd-a305f693a7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a3417d-7179-4c06-bac7-a85dcdf94ed5", "tag": "c9008273-5657-4feb-b9a7-12c6f4af6430"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:29.625440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3dd9034e-fefc-43cd-a4ef-136801b768c4 req-86a85f57-33af-43f1-83fd-a305f693a7dd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:29.625868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3dd9034e-fefc-43cd-a4ef-136801b768c4 req-86a85f57-33af-43f1-83fd-a305f693a7dd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:29.703473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3dd9034e-fefc-43cd-a4ef-136801b768c4 req-86a85f57-33af-43f1-83fd-a305f693a7dd service nova] Creating event network-changed:c9008273-5657-4feb-b9a7-12c6f4af6430 for instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 on n-h1-843834-3 Jul 19 20:11:29.733050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3dd9034e-fefc-43cd-a4ef-136801b768c4 req-86a85f57-33af-43f1-83fd-a305f693a7dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146435 Jul 19 20:11:29.738784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2399/4883] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:11:30.213790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:30.243455 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be456769-986d-4785-a441-79af6bc7f9d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 1.216511 Jul 19 20:11:30.246264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2485/4884] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:29 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:30.303761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:30.318836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:30.361510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.367854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:30.371546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:30.374319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.275123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:31.277042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:31.310222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:31.312863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.315004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:31.320278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:31.546341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.571171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03ba02d8-3e6e-431a-a0b0-83514749c228 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 1.292950 Jul 19 20:11:31.613563 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2400/4885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:30 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:31.968690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:31.993497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5365b8a6-e404-4f3e-b1d2-b383cb0a57e5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.713636 Jul 19 20:11:31.999486 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2486/4886] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:31 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:32.639820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:32.642273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:32.652705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.658366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:32.659617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:32.660238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.023929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:33.029969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:33.074182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.077349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.078861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:33.085861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:33.381299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.411640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c44ef83c-36c2-402b-ab92-c67407cacbf0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 0.776386 Jul 19 20:11:33.415344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2401/4887] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:32 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:33.639443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:33.647775 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ac903a2-b6d5-4edb-8e47-cd11e72f83db tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.634629 Jul 19 20:11:33.648384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2487/4888] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:33 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:34.439824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:34.441535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:34.469408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.471769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.474159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.477173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.670905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:34.671920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:34.756945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.764060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:34.765614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:34.766323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:35.219101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.240628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7d9fda2-7214-4de8-a096-f74e2018cced tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 0.806661 Jul 19 20:11:35.246350 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2402/4889] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:34 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:35.461062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:35.491644 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2454dc9-b234-4ab2-8766-d7846ed8ae88 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1508 microversion: 2.1 time: 0.827560 Jul 19 20:11:35.495033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2488/4890] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:34 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1508 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:35.836081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-854d1611-d796-493f-90f5-10385adb61e9 req-1f18a5f3-ef94-4bc6-80e4-e606d6c8249a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a3417d-7179-4c06-bac7-a85dcdf94ed5", "name": "network-vif-plugged", "status": "completed", "tag": "c9008273-5657-4feb-b9a7-12c6f4af6430"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:35.865357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-854d1611-d796-493f-90f5-10385adb61e9 req-1f18a5f3-ef94-4bc6-80e4-e606d6c8249a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:35.867595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-854d1611-d796-493f-90f5-10385adb61e9 req-1f18a5f3-ef94-4bc6-80e4-e606d6c8249a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:35.896288 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-854d1611-d796-493f-90f5-10385adb61e9 req-1f18a5f3-ef94-4bc6-80e4-e606d6c8249a service nova] Creating event network-vif-plugged:c9008273-5657-4feb-b9a7-12c6f4af6430 for instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 on n-h1-843834-3 Jul 19 20:11:35.907236 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-854d1611-d796-493f-90f5-10385adb61e9 req-1f18a5f3-ef94-4bc6-80e4-e606d6c8249a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075141 Jul 19 20:11:35.908823 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2403/4891] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:11:36.277142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:36.278848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:36.300747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.301205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.302007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.302448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.307132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=90 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:36.518300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:36.520564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:36.529712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.531422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.532555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:36.533292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:36.873449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.883180 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-50bb9136-4ca0-42a3-af0d-73d4cac60be9 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1308 microversion: 2.1 time: 0.619566 Jul 19 20:11:36.886594 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2489/4892] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:36 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1308 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:36.955287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:36.971980 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0ca243e6-897d-49da-8f57-7f238b3d67a1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1505 microversion: 2.1 time: 0.462113 Jul 19 20:11:36.974014 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2404/4893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:36 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:37.909975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:37.916808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:37.946133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.947852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:37.950726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:37.955985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.043435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:38.048621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:38.074834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.075240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.081237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.083590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.403640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:38.412581 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-edbd87c7-a57f-4e10-8e16-cbe4bcecfcae tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1489 microversion: 2.1 time: 0.509937 Jul 19 20:11:38.413975 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2490/4894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:37 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1489 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:38.437131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1467251999"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:38.438650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:38.452251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.454231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.455191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.457859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.492997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:38.502532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34e9ec2c-fd94-42f1-aaf9-4269e57ac8ce tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1505 microversion: 2.1 time: 0.508489 Jul 19 20:11:38.508933 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2405/4895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:37 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:38.677969 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d2e0890-77d3-42de-a96c-7c6e8cd5448d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "PUT /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1075 microversion: 2.1 time: 0.247548 Jul 19 20:11:38.694705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:38.695775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:38.704258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.704463 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2491/4896] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:11:38 2022] PUT /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1075 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:38.711148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:38.712245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:38.712807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.152457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.183436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-514307d0-f47c-40c1-9c48-506f9a6fd686 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1501 microversion: 2.1 time: 0.492724 Jul 19 20:11:39.203139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2406/4897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:38 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1501 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:39.212874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:39.213933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:39.230554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.231897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.233658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.234540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.525900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:39.526694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:39.530215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:39.541908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.542980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.546346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.547354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.558879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:39.572657 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a943185a-1024-4810-bbb7-a0d253392578 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1501 microversion: 2.1 time: 0.366568 Jul 19 20:11:39.578160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2492/4898] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:39 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:39.599113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebcbbb4c-ee91-4c45-a652-6e3d53d482dc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:39.621944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbbb4c-ee91-4c45-a652-6e3d53d482dc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.630854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebcbbb4c-ee91-4c45-a652-6e3d53d482dc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.697920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebcbbb4c-ee91-4c45-a652-6e3d53d482dc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Going to try to stop instance {{(pid=131229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:11:39.830646 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebcbbb4c-ee91-4c45-a652-6e3d53d482dc tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "POST /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5/action" status: 202 len: 0 microversion: 2.1 time: 0.237833 Jul 19 20:11:39.831663 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2493/4899] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:11:39 2022] POST /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:11:39.862184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e8aa4f1b-5def-4176-936f-9e9a7a0dc9ba req-e1528d20-1b94-4d95-9ee8-9fc84d148ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6714c70b-9e2c-44df-9955-cbf1b325a6db", "name": "network-vif-unplugged", "status": "completed", "tag": "5ef34a19-2fc1-459c-92cd-2c40a940bfb1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:39.889135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e8aa4f1b-5def-4176-936f-9e9a7a0dc9ba req-e1528d20-1b94-4d95-9ee8-9fc84d148ae3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.890962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e8aa4f1b-5def-4176-936f-9e9a7a0dc9ba req-e1528d20-1b94-4d95-9ee8-9fc84d148ae3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.922340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e8aa4f1b-5def-4176-936f-9e9a7a0dc9ba req-e1528d20-1b94-4d95-9ee8-9fc84d148ae3 service nova] Creating event network-vif-unplugged:5ef34a19-2fc1-459c-92cd-2c40a940bfb1 for instance 6714c70b-9e2c-44df-9955-cbf1b325a6db on n-h2-843834-3 Jul 19 20:11:39.931432 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e8aa4f1b-5def-4176-936f-9e9a7a0dc9ba req-e1528d20-1b94-4d95-9ee8-9fc84d148ae3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098156 Jul 19 20:11:39.933055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2494/4900] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:11:39.941165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:39.942425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:39.950783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.951622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:39.953043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:39.953715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:40.527840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:40.533047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:40.542047 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d87be350-33d3-4a88-aeae-2fa49127e5f4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.607467 Jul 19 20:11:40.544635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2495/4901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:39 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:40.579481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-acbc8be6-345f-426f-960f-82042a98c364 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1505 microversion: 2.1 time: 1.047065 Jul 19 20:11:40.596608 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2407/4902] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:39 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1505 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:41.564585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:41.565358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:41.582421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.586260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:41.589636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.592257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:41.613976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:41.614711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:41.632476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.632948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:41.640670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:41.641136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.034637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.052870 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7d01a17-6a35-4bd0-89c9-892e0f782aed tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.488464 Jul 19 20:11:42.054237 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2496/4903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:41 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:42.146589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.161859 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98848580-15dd-43ef-8150-26eb21c098d2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 200 len: 1448 microversion: 2.1 time: 0.551987 Jul 19 20:11:42.176377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2408/4904] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:41 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 1448 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:42.181531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:42.182585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:42.193577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.194137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.205895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.207424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.542385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.559516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aea30464-4d69-410e-a074-afe371f566f3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.381991 Jul 19 20:11:42.574827 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2497/4905] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:42.592385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:42.593351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:42.601153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.601989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.603137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:42.605918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:42.952280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:42.976081 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8c9e9fc-33d6-4bdf-8515-f3a8d7d8818a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.386736 Jul 19 20:11:43.006868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:43.007972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:43.017130 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2409/4906] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:43.043286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.043983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.047175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.047652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.081469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:43.082436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:43.101718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.102181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:43.103119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:43.137457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:44.580635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.632789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:44.640717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6915475e-a1f0-4bbf-ba29-099225604293 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 1.640309 Jul 19 20:11:44.655020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2498/4907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:42 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:44.657025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-282247d8-624b-40f3-8d66-bba1b42d1c40 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 1.580348 Jul 19 20:11:44.658185 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2410/4908] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:43 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:44.675310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:44.676307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:44.707537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:44.708008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:44.708997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:44.709235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.191530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:45.220257 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55b43269-7399-4d53-85a1-26aa12dba43e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.553780 Jul 19 20:11:45.223240 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2499/4909] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:44 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:45.255178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-041501e5-b7e6-4171-b896-585bfa040227 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:45.292920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-041501e5-b7e6-4171-b896-585bfa040227 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.293833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-041501e5-b7e6-4171-b896-585bfa040227 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.376281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-041501e5-b7e6-4171-b896-585bfa040227 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:11:45.581936 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-041501e5-b7e6-4171-b896-585bfa040227 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.335248 Jul 19 20:11:45.603145 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2411/4910] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:11:45 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:11:45.619021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:45.627791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:45.687502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:45.689308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:45.700455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.701189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.702712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.703327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.706137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.717115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:45.717115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:45.717115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:46.172291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:46.181891 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-032af9b6-7a66-4524-abf3-b2c631d23c9f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.500281 Jul 19 20:11:46.182514 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2412/4911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:45 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:46.250025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:46.259072 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56693468-8ddb-4960-b4cc-6ebe5b7689a3 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.650258 Jul 19 20:11:46.259988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2500/4912] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:45 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:47.216592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:47.217966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:47.251082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.253078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.254599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.272685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.300949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:47.302475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:47.376418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=42 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:47.383699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.384416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:47.407366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:47.407941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:48.280348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:48.319277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7824a79-b3fd-4d39-aa5a-af40553126bd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 1.103791 Jul 19 20:11:48.321915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2413/4913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:47 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:48.391192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:48.416383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cc38b90-9299-44ca-86a0-b236169921e8 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 1.125286 Jul 19 20:11:48.443235 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2501/4914] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:47 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:49.324819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:49.325355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:49.342080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.342574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.343523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.344385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.344758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:49.346943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:49.364003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.370770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:49.371495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.379179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.381920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.497118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lazy-loading 'services' on Instance uuid 510c115c-6c69-4176-9196-3df5ef90a441 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:11:49.644439 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c9cb182-a21f-425d-a5e7-38fdf2f9ad37 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "DELETE /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441/os-volume_attachments/4f588f66-6144-43ae-94ab-3abec387c06c" status: 202 len: 0 microversion: 2.1 time: 0.324154 Jul 19 20:11:49.645458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2414/4915] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:11:49 2022] DELETE /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441/os-volume_attachments/4f588f66-6144-43ae-94ab-3abec387c06c => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:11:49.666979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:49.671324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:49.692686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.693533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.694604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:49.696428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:49.917439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:49.939004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03009e2d-8392-40b3-b28d-e4f8792d4a89 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.602742 Jul 19 20:11:49.941419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2502/4916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:49 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:50.064872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:50.079091 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07bd4042-ef93-4529-b715-9663f3da43b5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.429785 Jul 19 20:11:50.080355 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2415/4917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:49 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:50.958643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:50.959932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:50.973133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:50.975571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:50.979070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:50.980423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:51.103489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:51.107486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:51.179191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:51.180082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:51.181153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:51.181842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:51.322339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:51.339730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a4a92b4b-126a-457f-9011-1400949e64b1 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.385687 Jul 19 20:11:51.340644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2503/4918] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:50 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:51.452362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:51.461121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09bc9caa-3ac7-4bdf-8bbb-a3760c285372 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.364349 Jul 19 20:11:51.463878 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2416/4919] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:51 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:52.368218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:52.369986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:52.390005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:52.392723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:52.409495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:52.410677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:52.485969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:52.487384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:52.497512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:52.497972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:52.498808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:52.499274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:52.700230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:52.719961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:11:52.788494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-99efb863-f052-48e0-9096-0a64758d0cb6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.404718 Jul 19 20:11:52.793037 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2504/4920] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:52 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:52.968899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:52.990459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34eaddbc-3962-49df-9df5-e91978142922 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.507667 Jul 19 20:11:52.991986 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2417/4921] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:52 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:54.008101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:54.009469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:54.017831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:54.018718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:54.019769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:54.020572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:54.148490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:54.149941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:54.173545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:54.175368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:54.177004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:54.177790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:54.420471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:54.433656 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2dc9b58-c278-41d9-9cee-136e64947fda tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.429463 Jul 19 20:11:54.436546 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2418/4922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:54 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:54.529144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:54.551586 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-02c8727e-5196-4802-8055-5b04cd22b1f2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.737370 Jul 19 20:11:54.553588 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2505/4923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:53 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:55.466082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:55.468943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:55.488179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.489481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:55.490832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.491714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:55.581513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:55.582439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:55.624131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.628644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:55.629814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:55.630114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:56.208064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:56.223140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b63a34b9-bf87-4386-83bb-8f6ab4f08e0f tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1678 microversion: 2.1 time: 0.762984 Jul 19 20:11:56.224562 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2419/4924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:55 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1678 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:56.252080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:56.266730 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4c744dab-b7d6-4597-9b4f-340e9c452a9b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.700483 Jul 19 20:11:56.283686 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2506/4925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:55 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:57.259777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:57.263642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:57.301978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:57.304300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:57.307237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.308391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.310611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.317468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.318043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.318413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.319468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.321234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.798119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:57.808453 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ded4017a-ccad-4bfd-8415-6cf7dc88a428 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1655 microversion: 2.1 time: 0.564086 Jul 19 20:11:57.812919 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2420/4926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:57 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1655 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:57.850263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b80f783-1d43-465f-876d-14f931fe4e7b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:11:57.860568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b80f783-1d43-465f-876d-14f931fe4e7b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:57.861314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b80f783-1d43-465f-876d-14f931fe4e7b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:57.908237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b80f783-1d43-465f-876d-14f931fe4e7b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:11:57.940248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:57.950048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af7e9648-c0df-4fd9-8f4b-becaef50df29 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.653774 Jul 19 20:11:57.950678 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2507/4927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:57 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:58.063914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:58.064757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:58.079991 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b80f783-1d43-465f-876d-14f931fe4e7b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.244075 Jul 19 20:11:58.083177 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2421/4928] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:11:57 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:11:58.091137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.091930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.093406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.094197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.101036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:58.102242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:58.126045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.130373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.131735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.135146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.242506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:11:58.495613 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb6dcdf5-8817-4a2d-8e0f-de8045059058 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "DELETE /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 204 len: 0 microversion: 2.1 time: 0.438678 Jul 19 20:11:58.503521 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2508/4929] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:11:58 2022] DELETE /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:11:58.519952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:58.521120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:58.551788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.553495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.556964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.560439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.719324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:58.728364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-310dc3e1-1f53-4fd9-aff9-0c3009032cd6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1664 microversion: 2.1 time: 0.639028 Jul 19 20:11:58.734980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2422/4930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:58 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1664 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:11:58.856498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:58.870518 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-814dfba9-1c22-4503-b9a2-08472a14df19 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1466 microversion: 2.1 time: 0.363047 Jul 19 20:11:58.872138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2509/4931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:58 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:58.967514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:58.968441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:58.979604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.980576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:58.982345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:58.983605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:59.242439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:11:59.254803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af0d1619-7d0b-4d74-8293-041ed6169112 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.291066 Jul 19 20:11:59.266422 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2423/4932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:58 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:11:59.754365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:59.755781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:59.765472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:59.766218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:59.767345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:59.768054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:59.902118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:11:59.903163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:11:59.913657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:59.914435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:11:59.915424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:11:59.916430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:00.546047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:00.558428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d653a88-c41e-4306-9898-2407c3f4b58e tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1664 microversion: 2.1 time: 0.809376 Jul 19 20:12:00.572245 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2510/4933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:59 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1664 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:00.583573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:00.585215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:00.593676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:00.594981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:00.596139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:00.597385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:00.641331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:00.649678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e67bf5f2-50fc-445a-85e9-254d83c37702 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1466 microversion: 2.1 time: 0.756406 Jul 19 20:12:00.663516 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2424/4934] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:11:59 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1466 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:01.199184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:01.222842 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68edb077-8123-4897-a1a4-e82c8eb29423 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.648313 Jul 19 20:12:01.223698 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2511/4935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:00 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:01.585710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:01.588242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:01.599745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:01.600557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:01.601635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:01.602797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:01.675150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:01.676212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:01.687749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:01.688928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:01.690206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:01.690954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:02.633629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:02.661611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e91d6c35cd04afbb8b9abe2ef8056f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4354f682f74c2da094553b11f35ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:02.677813 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-011d9ee6-60f1-4ada-8722-f6e205c80834 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1664 microversion: 2.1 time: 1.092701 Jul 19 20:12:02.690227 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2425/4936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:01 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1664 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:02.699172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:02.700338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:02.709616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:02.710591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:02.711847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:02.712586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:02.723669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c234023-a70e-41c2-9092-65a55cdd92d9 tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 200 len: 1466 microversion: 2.1 time: 1.056665 Jul 19 20:12:02.732681 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2512/4937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:01 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 1466 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:02.758751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a8fcd3ca-9537-45fb-9bec-5b949afaf55c req-7816b44b-6d06-4272-be87-6f193cac3111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510c115c-6c69-4176-9196-3df5ef90a441", "name": "network-vif-deleted", "tag": "fc63928b-a5a5-4ede-bbad-39077f9b990d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:02.793347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a8fcd3ca-9537-45fb-9bec-5b949afaf55c req-7816b44b-6d06-4272-be87-6f193cac3111 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:02.795314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a8fcd3ca-9537-45fb-9bec-5b949afaf55c req-7816b44b-6d06-4272-be87-6f193cac3111 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:02.828498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a8fcd3ca-9537-45fb-9bec-5b949afaf55c req-7816b44b-6d06-4272-be87-6f193cac3111 service nova] Creating event network-vif-deleted:fc63928b-a5a5-4ede-bbad-39077f9b990d for instance 510c115c-6c69-4176-9196-3df5ef90a441 on n-h1-843834-3 Jul 19 20:12:02.837873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a8fcd3ca-9537-45fb-9bec-5b949afaf55c req-7816b44b-6d06-4272-be87-6f193cac3111 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102511 Jul 19 20:12:02.839979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2513/4938] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:03.095451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:03.122649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b9da9d7-063a-4314-97e8-d0569e569a37 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.430333 Jul 19 20:12:03.124083 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2426/4939] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:02 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:03.714188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:03.716478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:03.726990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:03.727450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:03.728315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:03.728760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:03.755034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:03.756472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] [instance: 510c115c-6c69-4176-9196-3df5ef90a441] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:03.776472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:03.777300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:03.778359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:03.779051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:03.808140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] HTTP exception thrown: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Request method failure captured: Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 HTTP/1.1 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w9LPlGEubggXtmU42RAgLGD82x6dX_pk769ScCXHmgEt2Ppeuv9w4_Gd4F3nhAHA7uL1xl1TQS_LK6OTy1XY7hE4U26u3A5pOxSP9NSe7m1RwKGLJD05UHLhqSV5rGHSj-UHR9voPznmSEgTEIqFcyc5Ao27Ws4fsTTJ_uTAMzzmNk Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1c4354f682f74c2da094553b11f35ca2 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesBackupsTest-93835875 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4354f682f74c2da094553b11f35ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c4354f682f74c2da094553b11f35ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c4354f682f74c2da094553b11f35ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c4354f682f74c2da094553b11f35ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesBackupsTest-93835875 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1c4354f682f74c2da094553b11f35ca2 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesBackupsTest-93835875 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesBackupsTest-93835875-project Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4e91d6c35cd04afbb8b9abe2ef8056f2 Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesBackupsTest-93835875-project Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '510c115c-6c69-4176-9196-3df5ef90a441'} Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:03.810267 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. Jul 19 20:12:03.814295 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:03.816572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] Returning 404 to user: Instance 510c115c-6c69-4176-9196-3df5ef90a441 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:03.817701 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08976ad4-fb16-4209-b16d-409c13509c5f tempest-VolumesBackupsTest-93835875 tempest-VolumesBackupsTest-93835875-project] 10.222.0.23 "GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441" status: 404 len: 111 microversion: 2.1 time: 0.069283 Jul 19 20:12:03.818947 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2427/4940] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:03 2022] GET /compute/v2.1/servers/510c115c-6c69-4176-9196-3df5ef90a441 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:04.080692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:04.089954 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fbfadfe7-48bd-494f-8e54-d2145394a1eb tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.381907 Jul 19 20:12:04.090870 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2514/4941] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:03 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:04.121873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:04.123509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:04.133933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.134767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.136441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.143181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.146496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:04.147411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:04.157608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.159508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.163132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.163830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.490345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:04.501922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:04.503257 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-686c2adf-1af4-4642-95b5-f982d12755b9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.394028 Jul 19 20:12:04.504034 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2428/4942] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:04 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:04.517240 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b813f6d-670c-421e-8717-c43eef3e207f tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1511 microversion: 2.1 time: 0.375782 Jul 19 20:12:04.519249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2515/4943] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:04 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:04.552129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:04.564965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:04.582529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.584901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.610818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.614161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.824401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:04.835697 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5dc421f6-0e9e-4f54-afdb-fb534f7d7cd9 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.308220 Jul 19 20:12:04.836495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2429/4944] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:04 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:04.852694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:04.853475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:04.873683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.874377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:04.875583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:04.876104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.119382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:05.139392 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-52aaecc1-264b-4ee2-8dcd-d6b031ae1e12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.280953 Jul 19 20:12:05.139392 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2516/4945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:04 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:05.166366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:05.167043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.174225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.174682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.175853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.176885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.181433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:05.466348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:05.485873 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27ec1434-3ac6-4868-a677-f9b982010331 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.324982 Jul 19 20:12:05.495597 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2430/4946] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:05 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:05.511942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:05.512496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.519881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.520644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.521752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.522367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.539068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:05.539857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.553025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.553493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.554290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.554733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.590464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lazy-loading 'flavor' on Instance uuid a4374f34-7e78-4e25-9dbf-20c72050b1f2 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:05.798724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28e98c96-8e12-42c4-a04d-cab6ae4f1de6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.289000 Jul 19 20:12:05.808031 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2517/4947] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:12:05 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:12:05.814032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:05.815151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.822751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.823545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.824482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.825186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:05.825775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.835897 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3e7dfc3-e7e5-497c-8c8e-ad5db81c57ad tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1488 microversion: 2.1 time: 0.301235 Jul 19 20:12:05.837148 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2431/4948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:05 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1488 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:05.865924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-788138083"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:05.867729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:05.882445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.882974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:05.883792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:05.884223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.031103 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-346c721d-05bb-48b3-87d9-73382694b1b3 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "PUT /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1060 microversion: 2.1 time: 0.169189 Jul 19 20:12:06.033370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2432/4949] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:12:05 2022] PUT /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1060 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:06.050374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:06.052084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:06.060113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.061533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.063878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.065233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.278267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:06.288771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:06.294078 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0122e347-de77-452b-a15b-065e1bb2473a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1676 microversion: 2.1 time: 0.483582 Jul 19 20:12:06.295106 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2518/4950] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:05 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:06.439391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:06.451693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef72c36c-fef0-47fb-9606-aec9ca30cb7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1487 microversion: 2.1 time: 0.408365 Jul 19 20:12:06.452695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2433/4951] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:06 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1487 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:06.472222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:06.473309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:06.480930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.481626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.482857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.483665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.842831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:06.866563 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f22a63c6-c221-452e-a838-399003e4a3d4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1487 microversion: 2.1 time: 0.400642 Jul 19 20:12:06.868261 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2519/4952] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:06 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1487 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:06.894845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:06.898178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:06.923469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.924435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:06.928373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:06.929495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.008606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:07.271324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5e32736a-b8e4-4068-a135-face501e9d96 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 204 len: 0 microversion: 2.1 time: 0.390217 Jul 19 20:12:07.275388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2434/4953] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:06 2022] DELETE /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:12:07.287089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:07.287749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:07.303335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.303597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.318428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.318875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:07.319355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.319794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:07.336273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.341630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.345137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.346762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.744390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:07.753783 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a019535-74ad-421c-babc-b976b5cbc0fd tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1493 microversion: 2.1 time: 0.476602 Jul 19 20:12:07.754783 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2520/4954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:07 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1493 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:07.826620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:07.843413 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf0f09b1-4797-4d72-8955-6f6be63ce2fe tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1659 microversion: 2.1 time: 0.530122 Jul 19 20:12:07.845091 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2435/4955] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:07 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1659 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:07.867051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:07.867954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:07.876151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.876936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.877983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.878645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.968630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7fff39dd-d80d-4177-8205-385228ebf0a6 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.108131 Jul 19 20:12:07.969544 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2521/4956] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:12:07 2022] POST /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:12:07.977862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:07.978485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:07.991051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.994150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:07.995436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:07.996091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:08.270105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:08.278480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-97d9feb0-3dd5-4766-b5ae-673a0eb30ad0 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1665 microversion: 2.1 time: 0.304555 Jul 19 20:12:08.279499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2436/4957] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:07 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1665 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:08.775593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:08.776596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:08.798648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:08.799291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:08.801342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:08.801867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:09.297227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:09.298738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:09.309409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:09.310211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:09.310895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:09.311685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:09.499553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:09.510057 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c132e16d-e891-4cf7-a9a8-e9ce9c4e5eb5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1493 microversion: 2.1 time: 0.741378 Jul 19 20:12:09.523735 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2522/4958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:08 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1493 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:10.145285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:10.161489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b706021-355d-43a5-9f5e-999352ab3b52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1665 microversion: 2.1 time: 0.868215 Jul 19 20:12:10.163338 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2437/4959] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:09 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1665 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:10.530479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:10.531264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:10.553223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:10.559926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:10.561328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:10.562067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:11.184169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:11.184852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:11.199818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:11.203204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:11.203978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:11.205051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:11.205705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:11.465146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:11.481395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ce41467-97cd-4414-8481-e7a8e3ea086a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1493 microversion: 2.1 time: 0.956339 Jul 19 20:12:11.481984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2523/4960] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:10 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1493 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:12.435641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7a52dcca-1e6a-4f11-95ea-04d485b92095 req-f5aec74c-eea6-4d9a-be20-4ae8e6fb27b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a3417d-7179-4c06-bac7-a85dcdf94ed5", "name": "network-vif-deleted", "tag": "c9008273-5657-4feb-b9a7-12c6f4af6430"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:12.464349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7a52dcca-1e6a-4f11-95ea-04d485b92095 req-f5aec74c-eea6-4d9a-be20-4ae8e6fb27b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.465194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7a52dcca-1e6a-4f11-95ea-04d485b92095 req-f5aec74c-eea6-4d9a-be20-4ae8e6fb27b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:12.543709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7a52dcca-1e6a-4f11-95ea-04d485b92095 req-f5aec74c-eea6-4d9a-be20-4ae8e6fb27b2 service nova] Creating event network-vif-deleted:c9008273-5657-4feb-b9a7-12c6f4af6430 for instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 on n-h1-843834-3 Jul 19 20:12:12.569967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7a52dcca-1e6a-4f11-95ea-04d485b92095 req-f5aec74c-eea6-4d9a-be20-4ae8e6fb27b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140937 Jul 19 20:12:12.571303 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2524/4961] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:12.576886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:12.577490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:12.601702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:12.619227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.619897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:12.624071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.624546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:12.631324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0591357a-33c2-4085-a917-88bddcd52414 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1665 microversion: 2.1 time: 1.453531 Jul 19 20:12:12.646899 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2438/4962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:11 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1665 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:12.798271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:12.798732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:12.799225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lazy-loading 'fault' on Instance uuid e2a3417d-7179-4c06-bac7-a85dcdf94ed5 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:12.932254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:12.940941 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5e5ce960-2e6c-447c-895f-e190b52431e6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 200 len: 1309 microversion: 2.1 time: 0.368243 Jul 19 20:12:12.941614 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2525/4963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:12 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:13.661228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:13.661863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:13.718221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:13.721386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:13.724683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:13.733417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:13.964618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:13.965529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:13.995977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:13.997042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.024226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.026532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.143733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 HTTP/1.1 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e2a3417d-7179-4c06-bac7-a85dcdf94ed5'} Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.152769 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.157101 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3cbcf99-e945-4e9e-9ee3-8e9727628ddf tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 404 len: 111 microversion: 2.1 time: 0.194794 Jul 19 20:12:14.176966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2526/4964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:13 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:14.197896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.203899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.238460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.240835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.243462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.244039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.316038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 HTTP/1.1 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e2a3417d-7179-4c06-bac7-a85dcdf94ed5'} Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.320920 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.326083 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.339881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.341973 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b55f218a-0934-4dcd-9873-4fd4250e95f5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 404 len: 111 microversion: 2.1 time: 0.157032 Jul 19 20:12:14.347153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2527/4965] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:14 2022] DELETE /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:14.356393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.356987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: e2a3417d-7179-4c06-bac7-a85dcdf94ed5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.358450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:14.369974 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-571cc8d5-5ff7-4902-ad44-6c03ab2a5077 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.721674 Jul 19 20:12:14.389030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.389655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.390552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.390704 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2439/4966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:13 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:14.391079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.401715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.402602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.414513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.415473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.417753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.418535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.452703 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 HTTP/1.1 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'e2a3417d-7179-4c06-bac7-a85dcdf94ed5'} Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.454332 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance e2a3417d-7179-4c06-bac7-a85dcdf94ed5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.458830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3d3536f-b40d-4bbc-adda-62ee9df44f88 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5" status: 404 len: 111 microversion: 2.1 time: 0.103773 Jul 19 20:12:14.466050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2528/4967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/servers/e2a3417d-7179-4c06-bac7-a85dcdf94ed5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:14.478123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.484139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.528165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.537577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.538739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.542459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.686291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e HTTP/1.1 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1664ff4b-7ed8-43a2-9f46-9faa7e0d823e'} Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.689343 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.697141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.704429 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a6ff2f4-d3f8-4d7d-b23a-6f40eb30d08a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 404 len: 111 microversion: 2.1 time: 0.229125 Jul 19 20:12:14.704958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2529/4968] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:14 2022] DELETE /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:12:14.722097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.724021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.731949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.737436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.738678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.740530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.784602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:14.793961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b10a8c99-5041-4825-9c8c-9077c891c647 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1668 microversion: 2.1 time: 0.400156 Jul 19 20:12:14.794593 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2440/4969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1668 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:14.811652 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e HTTP/1.1 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1664ff4b-7ed8-43a2-9f46-9faa7e0d823e'} Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.820724 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. Jul 19 20:12:14.825892 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.828283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 1664ff4b-7ed8-43a2-9f46-9faa7e0d823e could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.828908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.829580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43da2188-0aed-483f-a50c-eb44de857a51 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e" status: 404 len: 111 microversion: 2.1 time: 0.123014 Jul 19 20:12:14.830251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.830976 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2530/4970] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/servers/1664ff4b-7ed8-43a2-9f46-9faa7e0d823e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:14.838870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.839656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.840371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.840988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.842561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.845763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.858211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.859526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.862840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.864835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.882232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:14.899620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Working on deleting snapshot 2ae95fed-1d86-485a-8d76-c5b19a0af879 from shelved instance... Jul 19 20:12:14.901122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 HTTP/1.1 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fd39d874-d416-4ad1-8c5f-2bdb89e2c509'} Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:14.902925 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:14.907308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:14.909604 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-148e68d4-7ddc-49e8-b962-1971e42dab7e tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 404 len: 111 microversion: 2.1 time: 0.074233 Jul 19 20:12:14.911624 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2531/4971] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:14 2022] DELETE /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:14.933433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:14.935239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fd39d874-d416-4ad1-8c5f-2bdb89e2c509] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:14.956671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.957657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:14.961171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:14.962361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.024314 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 HTTP/1.1 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fd39d874-d416-4ad1-8c5f-2bdb89e2c509'} Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.026234 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fd39d874-d416-4ad1-8c5f-2bdb89e2c509 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b70313e-3204-4b6a-aa25-7bd72ecbf60b tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509" status: 404 len: 111 microversion: 2.1 time: 0.108835 Jul 19 20:12:15.038516 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2532/4972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:14 2022] GET /compute/v2.1/servers/fd39d874-d416-4ad1-8c5f-2bdb89e2c509 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.043506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.044002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.053212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.058043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.061549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.063987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.116459 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf HTTP/1.1 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '05a2e479-3bd9-4e5d-872b-69983c1a2bdf'} Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.118495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.122372 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.124924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.126046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31f59950-60a3-436f-a558-5083a26090c4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 404 len: 111 microversion: 2.1 time: 0.088445 Jul 19 20:12:15.126820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2533/4973] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:15 2022] DELETE /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:12:15.138682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.140006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 05a2e479-3bd9-4e5d-872b-69983c1a2bdf] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.155203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.155762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.156719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.157258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.176979 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf HTTP/1.1 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '05a2e479-3bd9-4e5d-872b-69983c1a2bdf'} Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.179132 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. Jul 19 20:12:15.183053 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.185215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 05a2e479-3bd9-4e5d-872b-69983c1a2bdf could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.186542 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18c6e765-26ca-4a3a-832f-2cda4127c57a tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf" status: 404 len: 111 microversion: 2.1 time: 0.052987 Jul 19 20:12:15.187867 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2534/4974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/servers/05a2e479-3bd9-4e5d-872b-69983c1a2bdf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.227158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.228427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.259319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.261992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.263820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.264900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.327421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 HTTP/1.1 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c8851427-37ac-47fc-b98d-de35ceab7a40'} Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.331665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.336287 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.338414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.341832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fece2ed9-991d-439f-b569-ab83de7b52a6 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 404 len: 111 microversion: 2.1 time: 0.148919 Jul 19 20:12:15.342712 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2535/4975] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:15 2022] DELETE /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.359358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.360184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: c8851427-37ac-47fc-b98d-de35ceab7a40] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.377360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.378360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.381885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.383143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.410498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 HTTP/1.1 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c8851427-37ac-47fc-b98d-de35ceab7a40'} Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.412865 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. Jul 19 20:12:15.417665 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.419614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance c8851427-37ac-47fc-b98d-de35ceab7a40 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.420718 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aae6e250-4d6e-4c6d-9247-c07e2ab0b4c8 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40" status: 404 len: 111 microversion: 2.1 time: 0.073041 Jul 19 20:12:15.421858 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2536/4976] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/servers/c8851427-37ac-47fc-b98d-de35ceab7a40 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.433647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.439624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.453014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.455253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.457744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.459309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.491031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 HTTP/1.1 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66'} Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.492823 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.496603 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.499963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.501156 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5fee44b-b58d-4da4-af49-670abd57a7e4 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 404 len: 111 microversion: 2.1 time: 0.074815 Jul 19 20:12:15.502466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2537/4977] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:15 2022] DELETE /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.514160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.516128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.530676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.532879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.536808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.537370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.570612 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 HTTP/1.1 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66'} Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.574007 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.581786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.586567 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c9959d7-864f-4621-a425-8b36b0ddd916 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66" status: 404 len: 111 microversion: 2.1 time: 0.074980 Jul 19 20:12:15.589953 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2538/4978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/servers/fac6b0b8-0a1c-444d-8d3f-3294fcb2ce66 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:15.595762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.599201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.617305 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab HTTP/1.1 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '26e28891-5a18-484c-8639-7f6c3aa038ab'} Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.622496 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.627344 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.629985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.633938 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7953ae2b-9947-46f7-b8d3-a7a48a5b6813 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab" status: 404 len: 111 microversion: 2.1 time: 0.039887 Jul 19 20:12:15.637989 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2539/4979] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:15 2022] DELETE /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:12:15.646749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.650774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 26e28891-5a18-484c-8639-7f6c3aa038ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.665626 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab HTTP/1.1 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '26e28891-5a18-484c-8639-7f6c3aa038ab'} Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:15.670979 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 26e28891-5a18-484c-8639-7f6c3aa038ab could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cbbe72ef-3a3e-4585-89f4-173006668ae0 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab" status: 404 len: 111 microversion: 2.1 time: 0.035434 Jul 19 20:12:15.687038 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2540/4980] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/servers/26e28891-5a18-484c-8639-7f6c3aa038ab => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:12:15.692662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.692662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:15.711256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.711773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.712926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:15.713490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:15.755029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:15.939725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb1d83ee-85e8-498b-8d30-b7190af6a6ac tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 204 len: 0 microversion: 2.1 time: 0.253503 Jul 19 20:12:15.952193 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2541/4981] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:15 2022] DELETE /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:12:15.985620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:15.998504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:16.028357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:16.030103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:16.031174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:16.033428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:16.509452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:16.521014 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-956c459e-b033-4574-9e0d-fcb90ceb678d tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1479 microversion: 2.1 time: 0.565239 Jul 19 20:12:16.522020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2542/4982] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:15 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1479 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:17.026840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Doing local delete in cell 20398988-5dca-4cfe-920d-ac0c6c1185cc(cell1) {{(pid=131230) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 20:12:17.028315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:17.035117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:17.035636 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 20:12:17.055761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] deallocate_for_instance() {{(pid=131230) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 20:12:17.544820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:17.546251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:17.571996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:17.605266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:17.607031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:17.609318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:17.610791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:18.211079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:18.215612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:18.236586 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41bbf283-8288-4d3d-88b8-1549d5369984 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1479 microversion: 2.1 time: 0.699677 Jul 19 20:12:18.237643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2543/4983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:17 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1479 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:18.480041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Updating instance_info_cache with network_info: [] {{(pid=131230) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 20:12:18.480807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c83bc2a8-d67d-461a-8cfd-c574c436171a req-463bd845-dc3f-4d2d-968d-f644f3824204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6714c70b-9e2c-44df-9955-cbf1b325a6db", "name": "network-vif-deleted", "tag": "5ef34a19-2fc1-459c-92cd-2c40a940bfb1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:18.549419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:18.555559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c83bc2a8-d67d-461a-8cfd-c574c436171a req-463bd845-dc3f-4d2d-968d-f644f3824204 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:18.556036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c83bc2a8-d67d-461a-8cfd-c574c436171a req-463bd845-dc3f-4d2d-968d-f644f3824204 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:18.582495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.compute.server_external_events [req-c83bc2a8-d67d-461a-8cfd-c574c436171a req-463bd845-dc3f-4d2d-968d-f644f3824204 service nova] Unable to find a host for instance 6714c70b-9e2c-44df-9955-cbf1b325a6db. Dropping event network-vif-deleted {{(pid=131229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:12:18.584189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c83bc2a8-d67d-461a-8cfd-c574c436171a req-463bd845-dc3f-4d2d-968d-f644f3824204 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.109646 Jul 19 20:12:18.591616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2544/4984] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 20:12:18.990612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e60cd82f-3ab2-4543-aa3b-77f4e6b0d5f1 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 204 len: 0 microversion: 2.1 time: 4.174519 Jul 19 20:12:18.995860 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2441/4985] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:14 2022] DELETE /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 0 bytes in 4181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:12:19.004685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.005281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 6714c70b-9e2c-44df-9955-cbf1b325a6db] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:19.035515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.039238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.040148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.040598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.109248 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db HTTP/1.1 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '6714c70b-9e2c-44df-9955-cbf1b325a6db'} Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:19.116952 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. Jul 19 20:12:19.120939 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:19.139265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 404 to user: Instance 6714c70b-9e2c-44df-9955-cbf1b325a6db could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:19.140525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a9d68a8-8767-4eb6-8b88-57a39343a0cc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db" status: 404 len: 111 microversion: 2.1 time: 0.140371 Jul 19 20:12:19.147767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2545/4986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:18 2022] GET /compute/v2.1/servers/6714c70b-9e2c-44df-9955-cbf1b325a6db => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:19.164166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.165709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:19.184121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.185589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.186550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.187124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.265417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:19.281875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.287674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:19.309641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.317664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.319745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.321440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.529776 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e79dcd63-8109-4b77-b0e7-3f3ac7137ce7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 204 len: 0 microversion: 2.1 time: 0.377005 Jul 19 20:12:19.551977 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2442/4987] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:19 2022] DELETE /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:12:19.577354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:19.578063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:19.589095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.591456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.592555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:19.593235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:19.742815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:19.766321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d3a13137-c5e2-46ad-935d-57b1feaf61b5 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1479 microversion: 2.1 time: 0.504826 Jul 19 20:12:19.767595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2546/4988] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:19 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1479 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:19.891783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:19.925528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fefde64-e4b7-4016-a5c2-f82ed15eb410 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1466 microversion: 2.1 time: 0.366135 Jul 19 20:12:19.927618 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2443/4989] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:19 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1466 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:20.174728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-818f3d58-e841-47dc-8e86-bf4abea05ece req-9af67ab7-c4e1-4c0c-92bd-2ad3e79dbb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19937d78-ae5a-450f-b130-b5a5cd17c881", "name": "network-vif-deleted", "tag": "741fe6cf-5ba6-44e1-934d-d8ca480303bd"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:20.191106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-818f3d58-e841-47dc-8e86-bf4abea05ece req-9af67ab7-c4e1-4c0c-92bd-2ad3e79dbb64 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:20.194571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-818f3d58-e841-47dc-8e86-bf4abea05ece req-9af67ab7-c4e1-4c0c-92bd-2ad3e79dbb64 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:20.220093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-818f3d58-e841-47dc-8e86-bf4abea05ece req-9af67ab7-c4e1-4c0c-92bd-2ad3e79dbb64 service nova] Creating event network-vif-deleted:741fe6cf-5ba6-44e1-934d-d8ca480303bd for instance 19937d78-ae5a-450f-b130-b5a5cd17c881 on n-h2-843834-3 Jul 19 20:12:20.227618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-818f3d58-e841-47dc-8e86-bf4abea05ece req-9af67ab7-c4e1-4c0c-92bd-2ad3e79dbb64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056759 Jul 19 20:12:20.234896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2547/4990] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:20.793660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:20.794379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:20.853925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:20.854622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:20.870421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:20.872110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:20.949014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:20.950612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:20.971595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:20.980088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:20.984044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:20.992953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:21.081754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:21.085442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:21.085926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lazy-loading 'fault' on Instance uuid 19937d78-ae5a-450f-b130-b5a5cd17c881 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:21.380841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aed851d7ec4a49a1ea208845829dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9780efcf1d04ba1b27a2bb19005a703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:21.423349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:21.437009 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb36cca8-fb7c-4b85-bb38-705173e3cf48 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 200 len: 1282 microversion: 2.1 time: 0.647526 Jul 19 20:12:21.438436 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2444/4991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:20 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 1282 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:21.461834 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f79d80b6-3f45-4dfd-af92-a5e9fe1fb435 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1466 microversion: 2.1 time: 0.519595 Jul 19 20:12:21.463749 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2548/4992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:20 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1466 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:22.458449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:22.460349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] [instance: 19937d78-ae5a-450f-b130-b5a5cd17c881] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:22.497938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:22.500646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:22.524213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.528975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.531689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.532480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.535238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.536365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.543351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:22.545427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:22.599743 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] HTTP exception thrown: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Request method failure captured: Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 HTTP/1.1 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w7b_XuvEwH-dFLm1EN5XmhTsbA7Mbg9dSjLLWovPMXNJMYosgxj1XFt9HeBUgMBzswFTaDq2lUxxNsFr_zbH-E0Upk0-dQgcJK6ZfXvjC74xIdvlr_fNQRtdV6t-k7BRl-etjPzQawH5b5iGTasbAjM9yrO3ar5K9D946CuJAOjraI Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9780efcf1d04ba1b27a2bb19005a703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersTestJSON-460100916 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e9780efcf1d04ba1b27a2bb19005a703 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersTestJSON-460100916 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersTestJSON-460100916-project Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 65aed851d7ec4a49a1ea208845829dd9 Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersTestJSON-460100916-project Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '19937d78-ae5a-450f-b130-b5a5cd17c881'} Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:22.601785 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. Jul 19 20:12:22.606710 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:22.610375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] Returning 404 to user: Instance 19937d78-ae5a-450f-b130-b5a5cd17c881 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:22.611514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-594a256b-5291-4cee-b3c9-f0c21fae88c2 tempest-ServersTestJSON-460100916 tempest-ServersTestJSON-460100916-project] 10.222.0.23 "GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881" status: 404 len: 111 microversion: 2.1 time: 0.160270 Jul 19 20:12:22.618610 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2445/4993] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:22 2022] GET /compute/v2.1/servers/19937d78-ae5a-450f-b130-b5a5cd17c881 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:22.684612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:22.700021 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6352ec17-fdb3-4fe8-85c9-18f89b0de856 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 200 len: 1466 microversion: 2.1 time: 0.214286 Jul 19 20:12:22.709753 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2549/4994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:22 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:23.324048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2c88fad5-c678-49ae-b1af-9a522dc7100a req-09e134d6-b086-4121-bc2d-8be7de50567a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c561d9d7-d60a-440c-84f2-50a9808e7460", "name": "network-vif-deleted", "tag": "5d49e772-189b-4fb5-82da-5a1941374265"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:23.354127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2c88fad5-c678-49ae-b1af-9a522dc7100a req-09e134d6-b086-4121-bc2d-8be7de50567a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:23.354798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2c88fad5-c678-49ae-b1af-9a522dc7100a req-09e134d6-b086-4121-bc2d-8be7de50567a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:23.419539 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2c88fad5-c678-49ae-b1af-9a522dc7100a req-09e134d6-b086-4121-bc2d-8be7de50567a service nova] Creating event network-vif-deleted:5d49e772-189b-4fb5-82da-5a1941374265 for instance c561d9d7-d60a-440c-84f2-50a9808e7460 on n-h2-843834-3 Jul 19 20:12:23.469833 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2c88fad5-c678-49ae-b1af-9a522dc7100a req-09e134d6-b086-4121-bc2d-8be7de50567a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150204 Jul 19 20:12:23.477585 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2446/4995] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:24.735976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:24.737938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: c561d9d7-d60a-440c-84f2-50a9808e7460] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:24.780513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.781967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:24.783980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.789833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:24.842258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 HTTP/1.1 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c561d9d7-d60a-440c-84f2-50a9808e7460'} Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:24.854339 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. Jul 19 20:12:24.863116 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:24.867262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 404 to user: Instance c561d9d7-d60a-440c-84f2-50a9808e7460 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:24.869286 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7c92579-8ee3-411f-942e-e76283dd4081 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460" status: 404 len: 111 microversion: 2.1 time: 1.154925 Jul 19 20:12:24.878298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2550/4996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:23 2022] GET /compute/v2.1/servers/c561d9d7-d60a-440c-84f2-50a9808e7460 => generated 111 bytes in 1165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:24.891006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:24.891606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:24.915207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.915665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:24.916468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:24.916914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:25.027612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:25.257396 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c70f5713-0c37-416b-b8fd-d9c258b70443 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 204 len: 0 microversion: 2.1 time: 0.373053 Jul 19 20:12:25.258368 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2447/4997] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:24 2022] DELETE /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:12:25.267028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:25.267862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:25.293396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:25.293860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:25.294812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:25.295212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:25.748738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:25.762634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1fe3bbd7-240b-4cd8-a6aa-0fe14533423a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1508 microversion: 2.1 time: 0.500247 Jul 19 20:12:25.776201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2551/4998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:25 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:26.784770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:26.785606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:26.805282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:26.817995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:26.819158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:26.823929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:27.488987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:27.497264 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a88aa82-5dc9-4b24-8e32-e21abceacf12 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1508 microversion: 2.1 time: 0.717391 Jul 19 20:12:27.509843 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2448/4999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:26 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1508 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:28.517692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:28.518935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:28.538803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:28.540142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:28.541521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:28.542274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:29.326690 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:12:29.326958 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 (ip 10.222.0.23) !!! Jul 19 20:12:29.680234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:29.699530 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e57bec84-3630-4dee-b06a-35aaf26c316b tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1508 microversion: 2.1 time: 1.184101 Jul 19 20:12:29.717685 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2552/5000] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:28 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1508 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:29.987166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d5f47a43-842d-46fa-a684-6d2c34de00e0 req-2801bd31-f854-4922-8055-4454da695f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725c01db-ef03-4809-b10a-e01adcc661c2", "name": "network-vif-deleted", "tag": "baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:30.000579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d5f47a43-842d-46fa-a684-6d2c34de00e0 req-2801bd31-f854-4922-8055-4454da695f98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:30.002707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d5f47a43-842d-46fa-a684-6d2c34de00e0 req-2801bd31-f854-4922-8055-4454da695f98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:30.044017 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d5f47a43-842d-46fa-a684-6d2c34de00e0 req-2801bd31-f854-4922-8055-4454da695f98 service nova] Creating event network-vif-deleted:baf1b7d7-4ee2-49cf-b9bc-fb71974f6cf7 for instance 725c01db-ef03-4809-b10a-e01adcc661c2 on n-h1-843834-3 Jul 19 20:12:30.050377 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d5f47a43-842d-46fa-a684-6d2c34de00e0 req-2801bd31-f854-4922-8055-4454da695f98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085944 Jul 19 20:12:30.053191 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2449/5001] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:30.741172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:30.742577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:30.769429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:30.772375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:30.773563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:30.775529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:30.904282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:30.904765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:30.908701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lazy-loading 'fault' on Instance uuid 725c01db-ef03-4809-b10a-e01adcc661c2 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:31.074553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:31.083042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3d6ad164-88a8-4993-903c-c163ad1410fc tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 200 len: 1304 microversion: 2.1 time: 0.348816 Jul 19 20:12:31.097724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2553/5002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:30 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 1304 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:32.109550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:32.111597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 725c01db-ef03-4809-b10a-e01adcc661c2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:32.127918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.128738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:32.132269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.133543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:32.180359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 HTTP/1.1 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '725c01db-ef03-4809-b10a-e01adcc661c2'} Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:32.182646 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. Jul 19 20:12:32.187605 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:32.193508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 404 to user: Instance 725c01db-ef03-4809-b10a-e01adcc661c2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:32.195678 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c33fd6be-9e37-4abe-b4c1-f2cd23554cd2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2" status: 404 len: 111 microversion: 2.1 time: 0.092486 Jul 19 20:12:32.208883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:32.210361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:32.219013 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2450/5003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:32 2022] GET /compute/v2.1/servers/725c01db-ef03-4809-b10a-e01adcc661c2 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:32.224741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.225684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:32.227242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.228782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:32.315260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:32.607128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b859277-59b9-458f-93ec-0b3d62bb1d52 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 204 len: 0 microversion: 2.1 time: 0.399776 Jul 19 20:12:32.608355 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2554/5004] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:32 2022] DELETE /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:12:32.622672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:32.624314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:32.654272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.654802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:32.655682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:32.656810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:33.060268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:33.076031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ea0f6d4-4f4f-4c93-8233-dd5a77797c0c tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1495 microversion: 2.1 time: 0.459740 Jul 19 20:12:33.077172 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2451/5005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:32 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1495 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:34.096429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:34.097233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:34.142694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:34.158797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:34.160592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:34.165839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:35.352927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:35.370779 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4ff483d-54e6-4b58-bb87-039fc288e15a tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1495 microversion: 2.1 time: 1.279773 Jul 19 20:12:35.371470 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2555/5006] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:34 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1495 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:35.751404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e437cf69-92ba-4db6-b363-a800e897aa39 req-0119a85b-9709-4e4a-b807-de2ee9f9f6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c90c01-5f7c-41eb-8bc4-1c64251a40d1", "name": "network-vif-deleted", "tag": "93b8a268-a817-4b32-8e2a-344593e8cd1b"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:35.768814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e437cf69-92ba-4db6-b363-a800e897aa39 req-0119a85b-9709-4e4a-b807-de2ee9f9f6f4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:35.770062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e437cf69-92ba-4db6-b363-a800e897aa39 req-0119a85b-9709-4e4a-b807-de2ee9f9f6f4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:35.811944 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e437cf69-92ba-4db6-b363-a800e897aa39 req-0119a85b-9709-4e4a-b807-de2ee9f9f6f4 service nova] Creating event network-vif-deleted:93b8a268-a817-4b32-8e2a-344593e8cd1b for instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 on n-h1-843834-3 Jul 19 20:12:35.825224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e437cf69-92ba-4db6-b363-a800e897aa39 req-0119a85b-9709-4e4a-b807-de2ee9f9f6f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077164 Jul 19 20:12:35.833176 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2452/5007] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:12:36.388397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:36.389064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:36.409380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:36.421899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:36.424514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:36.425300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:36.580206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:36.580672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:36.581139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lazy-loading 'fault' on Instance uuid 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:12:36.845160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:36.864684 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a477645-efb8-40c3-8acf-1d7fff31c693 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 200 len: 1305 microversion: 2.1 time: 0.478799 Jul 19 20:12:36.869404 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2556/5008] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:36 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 1305 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:37.692051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-258794494", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": "none"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:37.891099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:37.892504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: 99c90c01-5f7c-41eb-8bc4-1c64251a40d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:37.924913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.929271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:37.933653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.934314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:37.965726 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 HTTP/1.1 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '99c90c01-5f7c-41eb-8bc4-1c64251a40d1'} Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:37.969247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 404 to user: Instance 99c90c01-5f7c-41eb-8bc4-1c64251a40d1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:37.974220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0aa93201-e028-4609-94ba-f34494f1a3c2 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1" status: 404 len: 111 microversion: 2.1 time: 0.092255 Jul 19 20:12:37.975484 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2557/5009] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:37 2022] GET /compute/v2.1/servers/99c90c01-5f7c-41eb-8bc4-1c64251a40d1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:37.984197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:37.984820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:37.992793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.993527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:37.994510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:37.995146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:38.041709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:12:38.193628 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f755cce1-8166-40e3-a69e-8bd3e13c9aef tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 204 len: 0 microversion: 2.1 time: 0.213848 Jul 19 20:12:38.196010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2558/5010] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:12:37 2022] DELETE /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:12:38.209229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:38.215093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:38.234822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:38.238632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:38.239874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:38.243885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:38.708539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:38.719695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:38.723929 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6e8ece2-8268-4140-94b1-5d15770904ff tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1674 microversion: 2.1 time: 0.523548 Jul 19 20:12:38.726455 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2559/5011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:38 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1674 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:39.744496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:39.746559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:39.774770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:39.775828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:39.780454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:39.781222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:40.265797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9eba1cc82845ad86f6b97b7f828bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39730f5064e948989e59d72d416ac341', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:40.278485 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89be21f2-807d-45e0-8694-05a5b6b56471 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 200 len: 1674 microversion: 2.1 time: 0.537766 Jul 19 20:12:40.282391 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2560/5012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:39 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 1674 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:40.487381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-298336500", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "b8b8a937-aee1-4c9d-a176-e761624c3699"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:45.811190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:47.713352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:50.270176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:50.379061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:12:50.379657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:12:50.380169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:12:50.380664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:12:50.381187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:12:50.387679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] validate_networks() for [('b8b8a937-aee1-4c9d-a176-e761624c3699', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:12:50.407842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:50.408642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.409680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:50.410793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.437231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Getting quotas for project e36118ddf8604742806c63008611ab4f. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:12:50.445732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Getting quotas for user 5dd03fcf4ce447fb8c4ca08c226b69f6 and project e36118ddf8604742806c63008611ab4f. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:12:50.469277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:12:50.472943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:12:50.516469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:12:50.557735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f86778ca-936b-4537-9711-2172573ca338 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 13.448111 Jul 19 20:12:50.559546 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2453/5013] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 20:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 13451 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:12:50.572134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:50.575898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] [instance: a4374f34-7e78-4e25-9dbf-20c72050b1f2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:50.585707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:50.588411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.589738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:50.590207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.609131 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] HTTP exception thrown: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Request method failure captured: Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 HTTP/1.1 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1w3N_sOGGXgXxzCNqFZhlp1qQzblNdWDHwglafe_2kEz467Fb2xEuM6ypHKdBM2kaKCnWER0miokJ6ykLIusP1zJO41-IIXutei1cAuzbFA3891Y4RiMeOcnadjywiuHKAhxvRpYqHbC_M4WluT3rGe8Ge2jokF63Zm-DvpdDpK-FvQ Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39730f5064e948989e59d72d416ac341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39730f5064e948989e59d72d416ac341"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39730f5064e948989e59d72d416ac341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 39730f5064e948989e59d72d416ac341 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-676389108 Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ce9eba1cc82845ad86f6b97b7f828bec Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-676389108-project Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'a4374f34-7e78-4e25-9dbf-20c72050b1f2'} Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:12:50.612713 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. Jul 19 20:12:50.618376 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:12:50.620047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Returning 404 to user: Instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:12:50.621165 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf96939d-0247-42cd-8349-d055bb8b84d7 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2" status: 404 len: 111 microversion: 2.1 time: 0.059769 Jul 19 20:12:50.622892 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2454/5014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:50 2022] GET /compute/v2.1/servers/a4374f34-7e78-4e25-9dbf-20c72050b1f2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:12:50.629281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-168c27ab-9df7-42f8-88d1-8b9ed8c6b5b7 req-45c254eb-603b-40cb-a039-90f7615e2580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4374f34-7e78-4e25-9dbf-20c72050b1f2", "name": "network-vif-deleted", "tag": "4f7fe04f-f9f0-4d60-95d3-bfae29175c75"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:50.639763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-168c27ab-9df7-42f8-88d1-8b9ed8c6b5b7 req-45c254eb-603b-40cb-a039-90f7615e2580 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:50.640639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-168c27ab-9df7-42f8-88d1-8b9ed8c6b5b7 req-45c254eb-603b-40cb-a039-90f7615e2580 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:50.654951 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-168c27ab-9df7-42f8-88d1-8b9ed8c6b5b7 req-45c254eb-603b-40cb-a039-90f7615e2580 service nova] Creating event network-vif-deleted:4f7fe04f-f9f0-4d60-95d3-bfae29175c75 for instance a4374f34-7e78-4e25-9dbf-20c72050b1f2 on n-h1-843834-3 Jul 19 20:12:50.663061 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-168c27ab-9df7-42f8-88d1-8b9ed8c6b5b7 req-45c254eb-603b-40cb-a039-90f7615e2580 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038660 Jul 19 20:12:50.664095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2455/5015] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:12:50.677183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:50.678683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:50.818865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:50.841804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:50.849518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:50.857275 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30a48500-65e5-4b4e-886a-cbaa002d0a76 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1277 microversion: 2.54 time: 0.191568 Jul 19 20:12:50.857776 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2456/5016] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:50 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:12:50.879840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-562aeefd-3dfc-4875-9423-f39e052e66f5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] Calling method '.version_select at 0x7f23efcba670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:50.918446 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-562aeefd-3dfc-4875-9423-f39e052e66f5 tempest-ServerActionsTestJSON-676389108 tempest-ServerActionsTestJSON-676389108-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098881101" status: 202 len: 0 microversion: 2.1 time: 0.059244 Jul 19 20:12:50.939337 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2457/5017] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 20:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098881101 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:12:51.572891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:12:51.573625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:12:51.573835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:12:51.574243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:12:51.574709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:12:51.598349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.599728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:51.600699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.603739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:51.661091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Getting quotas for project 2a616fe59c114be48583cbd567792152. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:12:51.679036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Getting quotas for user 5e9cc8f6dbb144a48e87954fd2af9e15 and project 2a616fe59c114be48583cbd567792152. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:12:51.750597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:12:51.760830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:12:51.890741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:51.922779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:51.972702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.974999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:51.976164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:51.979990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:51.987015 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f179cda1-a155-49b4-bb2a-623998f8f3e5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.703051 Jul 19 20:12:51.996543 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2561/5018] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 11713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:12:52.004786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b52f5f21-379a-4f26-88f9-39a831395249 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:52.014298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b52f5f21-379a-4f26-88f9-39a831395249 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:52.331379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b52f5f21-379a-4f26-88f9-39a831395249 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:52.344124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b52f5f21-379a-4f26-88f9-39a831395249 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1214 microversion: 2.1 time: 0.345296 Jul 19 20:12:52.344745 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2562/5019] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:51 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:52.346492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:52.362183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:52.372099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:52.375877 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-75b7f5ca-8fc3-4a64-b361-e8ba5f8b3382 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1281 microversion: 2.54 time: 0.499381 Jul 19 20:12:52.376478 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2458/5020] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:51 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1281 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:12:53.362509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40d0d465-540f-423c-af1a-0e7048dd893f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:53.363400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40d0d465-540f-423c-af1a-0e7048dd893f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:53.395044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:53.395858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:53.416317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:53.417517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:53.418720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:53.419263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:53.558960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40d0d465-540f-423c-af1a-0e7048dd893f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:53.570527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40d0d465-540f-423c-af1a-0e7048dd893f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1214 microversion: 2.1 time: 0.211136 Jul 19 20:12:53.571861 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2563/5021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:53 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:53.606764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:53.621230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:53.625510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:53.630007 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-937d71b5-327f-4135-acbf-974d50f81159 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1335 microversion: 2.54 time: 0.238459 Jul 19 20:12:53.632004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2459/5022] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:53 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:12:54.591978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:54.593083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:54.605925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:54.607042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:54.608446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:54.609888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:54.649790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:54.651118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:54.673645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:54.674422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:54.675476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:54.678751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:54.738307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:54.753780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a966d192-0815-4c70-b4f4-2a67cc5ad07b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1210 microversion: 2.1 time: 0.165968 Jul 19 20:12:54.764257 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2564/5023] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:54 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:54.852341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:54.864231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:54.866214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:54.867683 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-814fe1a7-be69-4da1-a7de-4a870ef3b12e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1335 microversion: 2.54 time: 0.221720 Jul 19 20:12:54.868276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2460/5024] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:54 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1335 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:12:55.772387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:55.776118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:55.804266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.805001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.805998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.808541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.887685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:55.889024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:55.904022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.907170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.908292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:55.926874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:55.938698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:55.955110 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19e7ce91-792b-4496-ad2a-a74c4aa16f14 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1274 microversion: 2.1 time: 0.187297 Jul 19 20:12:55.971944 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2565/5025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:55 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:56.119779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:56.147732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:56.164450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:56.176431 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c242ecea-bf9d-40d8-8811-9fac9a8ff3e9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1335 microversion: 2.54 time: 0.293707 Jul 19 20:12:56.179090 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2461/5026] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:55 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:12:56.976873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:56.978480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:56.986235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:56.996112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.000629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:57.001041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.199483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:57.200838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:57.212719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:57.225225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.226434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:57.227183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.278160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:57.312053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-09474b54-cc1b-4237-8c4d-18f39820bca6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1272 microversion: 2.1 time: 0.339434 Jul 19 20:12:57.314370 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2566/5027] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:56 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:12:57.448968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:57.462247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:57.466724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:57.468658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-990f291c-5736-4bb3-b1fb-85b7b66fb95b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1356 microversion: 2.54 time: 0.274065 Jul 19 20:12:57.470168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2462/5028] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:57 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1356 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:12:57.497800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2abe457c-52af-4d41-b827-c57cb6e552fe tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Action: 'create', calling method: .version_select at 0x7f24008e0a60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1969077138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZDtgWwEg4pBMjoR7DIkvuhf1rk0DPQx5ClOCyNMp2f/TuaczUbFFGDbCfwwAP+HwbK9QhFFKFOukCWalYwj7+VOYSsEezVVbzYOPytDmZGEZ+5239hl+7KLT/BqXwgiA=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:57.540178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2abe457c-52af-4d41-b827-c57cb6e552fe tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Getting quotas for project e36118ddf8604742806c63008611ab4f. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:12:57.555385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2abe457c-52af-4d41-b827-c57cb6e552fe tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Getting quotas for user 5dd03fcf4ce447fb8c4ca08c226b69f6 and project e36118ddf8604742806c63008611ab4f. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:12:57.633122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2abe457c-52af-4d41-b827-c57cb6e552fe tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.143478 Jul 19 20:12:57.639632 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2567/5029] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 19 20:12:57 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:12:57.645273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1969077138", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:12:57.647420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:57.674903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:57.676137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.682776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:57.684362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:57.900298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:12:57.901687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:12:57.903057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:12:57.903487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:12:57.906490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:12:58.175312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:58.184878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.185625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.187020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.187639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.246744 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab05dc9a-fd30-4926-9e9b-a5154be26702 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "POST /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0/action" status: 202 len: 1139 microversion: 2.54 time: 0.605271 Jul 19 20:12:58.248714 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2463/5030] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Jul 19 20:12:57 2022] POST /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0/action => generated 1139 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 20:12:58.263453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:58.264071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:58.301209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.301666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.319371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.330256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:58.331338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:58.339812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.359098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.359672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.371514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:58.375612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:58.690417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:58.695439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:58.719446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:58.726032 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb751ab6-b492-4ce2-9e6e-794759e3922c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1272 microversion: 2.1 time: 0.399714 Jul 19 20:12:58.734617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2464/5031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:58 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:12:58.737908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:12:58.739789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28f076f2-7f8c-43af-881a-cc7188405e62 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.480490 Jul 19 20:12:58.748424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2568/5032] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:58 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:12:59.752611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:59.753836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:59.766383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:12:59.767765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:12:59.792531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:59.802790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:59.802790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:59.809519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:59.811172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:59.811954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:12:59.812448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:12:59.814416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:00.192400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:00.209912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:00.211738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:00.226223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1744436-9910-40f2-803f-4702cb4db2f0 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.450717 Jul 19 20:13:00.238675 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2569/5033] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:12:59 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:00.427429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:00.839649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:00.923889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:00.936045 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a5761e5-13d1-49ae-ac66-19e910074e4a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 1.188269 Jul 19 20:13:00.941992 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2465/5034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:12:59 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:01.273952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:01.275301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:01.295203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:01.296194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:01.297250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:01.298378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:01.450650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:01.476548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:01.488352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:01.490361 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c48f32d8-472c-4139-89b1-f6f52095fe68 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.229974 Jul 19 20:13:01.492667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2570/5035] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:01 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:01.958443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:01.959219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:02.012692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.013002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.013800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.014200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.533223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:02.536629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:02.537960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:02.552162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:02.555788 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1cc883b8-c025-44cc-959d-03532c63fb4f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.603692 Jul 19 20:13:02.556832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2466/5036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:01 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:02.561611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.562064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.562861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:02.563335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:02.769617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:02.802585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:02.806040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:02.809101 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90652698-4fac-4bca-9000-5b0a73007507 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.280654 Jul 19 20:13:02.811012 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2571/5037] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:02 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:03.573393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:03.574807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:03.586805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.589583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:03.590667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.593607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:03.829646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:03.830257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:03.841098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.844994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:03.845841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:03.846282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:04.216215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:04.226330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:04.228159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:04.251828 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77b14e2c-8a68-4f41-ab8e-38feeff2976d tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.426036 Jul 19 20:13:04.264550 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2572/5038] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:03 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:04.273583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-49c7f0cf-ad26-4774-bea7-0f9193740c09 req-4c600f3d-0e0d-4a5e-bb66-d205c66781cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cead481-ce3a-4f50-bfec-a39b3981b5d4", "tag": "03250eb9-2563-4ce5-b429-47a72a4db963"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:04.300320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-49c7f0cf-ad26-4774-bea7-0f9193740c09 req-4c600f3d-0e0d-4a5e-bb66-d205c66781cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:04.305207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-49c7f0cf-ad26-4774-bea7-0f9193740c09 req-4c600f3d-0e0d-4a5e-bb66-d205c66781cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:04.323684 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-49c7f0cf-ad26-4774-bea7-0f9193740c09 req-4c600f3d-0e0d-4a5e-bb66-d205c66781cb service nova] Creating event network-changed:03250eb9-2563-4ce5-b429-47a72a4db963 for instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 on n-h2-843834-3 Jul 19 20:13:04.330285 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-49c7f0cf-ad26-4774-bea7-0f9193740c09 req-4c600f3d-0e0d-4a5e-bb66-d205c66781cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063300 Jul 19 20:13:04.341033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2573/5039] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:04.469315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:04.494550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4ed7d80-96c6-48df-9558-5c5166122894 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.911032 Jul 19 20:13:04.496456 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2467/5040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:03 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:05.284697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:05.285561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:05.301650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:05.304699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:05.308746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:05.311205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:05.514806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:05.522686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:05.543271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:05.544067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:05.545079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:05.545678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:05.590038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:05.603432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:05.609566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:05.610883 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6a78e39-5f25-4b09-b93d-0b275da52d9c tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.331631 Jul 19 20:13:05.626023 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2574/5041] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:05 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:05.804458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:05.816178 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-123f0f30-1f4f-4a9a-aa42-aaee525fea97 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.308054 Jul 19 20:13:05.817712 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2468/5042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:05 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:06.633506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:06.634221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:06.643851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.649694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:06.651508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.652247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:06.779373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:06.788885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:06.790610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:06.792258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f15e390-db72-4b22-9ab6-b99839642ce8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.162751 Jul 19 20:13:06.804625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2575/5043] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:06 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:06.838010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:06.839183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:06.854289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.855094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:06.856173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:06.858185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:07.208925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:07.229205 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ebd02ab0-8234-4750-a9f1-23628765183a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.393780 Jul 19 20:13:07.238793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2469/5044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:06 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:07.811643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:07.813026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:07.828347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=14 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:07.839610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:07.859023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:07.860532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:07.861351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:08.128008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:08.168791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:08.170445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:08.171784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a4a5751e-3277-49dd-abe5-efd311950b38 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.364305 Jul 19 20:13:08.172371 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2576/5045] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:07 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:08.247835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:08.249976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:08.285028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:08.287541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:08.295431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:08.296011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:08.771409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:08.787691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05e6cbd1-d56d-4442-809e-7df5428a5467 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.545469 Jul 19 20:13:08.802105 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2470/5046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:08 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:09.191930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:09.192836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:09.213035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.217545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:09.218854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.224570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:09.809552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:09.810364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:09.826464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.834154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:09.835985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:09.844563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:09.849654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:10.074801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:10.090020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:10.092664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:10.103420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3fcd32f-b320-42e3-89fe-ab1feb2d1d5a tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.916065 Jul 19 20:13:10.104582 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2577/5047] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:09 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:10.399882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:10.441736 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41d5f4b8-ab7d-4685-bc9d-36e22d6dab27 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.636541 Jul 19 20:13:10.442418 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2471/5048] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:09 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:13:11.127431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:11.128735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:11.145606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.146588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.147763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.148407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.304082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:11.324321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:11.331396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:11.333395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b582ea00-3f9d-4db5-82aa-2b53923776f2 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.212193 Jul 19 20:13:11.334497 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2578/5049] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:11 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:11.461967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:11.462755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:11.497542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.500056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.506300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:11.507600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:11.872286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:11.892375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8d252c2-e413-4709-9de9-fe1e269b553c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.433486 Jul 19 20:13:11.893095 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2472/5050] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:11 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:12.362025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:12.362717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:12.378191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:12.382038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:12.383298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:12.386784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:12.613896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:12.654116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:12.659524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:12.667522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0daa204c-f545-4b3e-8462-9fffd2a2016f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.303253 Jul 19 20:13:12.668559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2579/5051] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:12 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:12.791245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f7c3799b-efb1-4c26-a879-099af7a9f95a req-830c025b-58dc-4ba2-ba2e-28d04ff8f744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cead481-ce3a-4f50-bfec-a39b3981b5d4", "name": "network-vif-plugged", "status": "completed", "tag": "03250eb9-2563-4ce5-b429-47a72a4db963"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:12.816894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7c3799b-efb1-4c26-a879-099af7a9f95a req-830c025b-58dc-4ba2-ba2e-28d04ff8f744 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:12.817702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7c3799b-efb1-4c26-a879-099af7a9f95a req-830c025b-58dc-4ba2-ba2e-28d04ff8f744 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:12.847700 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f7c3799b-efb1-4c26-a879-099af7a9f95a req-830c025b-58dc-4ba2-ba2e-28d04ff8f744 service nova] Creating event network-vif-plugged:03250eb9-2563-4ce5-b429-47a72a4db963 for instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 on n-h2-843834-3 Jul 19 20:13:12.857486 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f7c3799b-efb1-4c26-a879-099af7a9f95a req-830c025b-58dc-4ba2-ba2e-28d04ff8f744 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076364 Jul 19 20:13:12.859438 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2473/5052] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:12.910241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:12.910901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:12.923334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:12.923809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:12.924829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:12.936664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:13.453816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:13.462534 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d255c80-348b-4c2b-86fb-e6e02cdad3f8 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1314 microversion: 2.1 time: 0.557306 Jul 19 20:13:13.473461 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2580/5053] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:12 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:13.692589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:13.693956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:13.706519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:13.707218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:13.708235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:13.708815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:13.905458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:13.924878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:13.945661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:13.949352 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a042ef13-6d39-4871-9992-22b4a98d6d29 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.264061 Jul 19 20:13:13.950072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2474/5054] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:13 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:14.482107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:14.482799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:14.509311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:14.510311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:14.561778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:14.562642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:14.970559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:14.972488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:15.003065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.004008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.005877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.007839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.053869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:15.058503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=100 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:15.073598 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77ae0d34-1afd-4481-9ecd-ec9a08bcfedd tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1501 microversion: 2.1 time: 0.595602 Jul 19 20:13:15.077309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2581/5055] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:14 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1501 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:15.098055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:15.098759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:15.119142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.119611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.120441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.123080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.321797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:15.337746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:15.343865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:15.347401 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fec3a24-92ad-4adc-ba63-2a4ea5030cbd tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.382161 Jul 19 20:13:15.361928 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2475/5056] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:14 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:15.644414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:15.662202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16492512-1437-48db-aaa1-bb0602d42ec0 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1501 microversion: 2.1 time: 0.568021 Jul 19 20:13:15.663164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2582/5057] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:15 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1501 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:15.688228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:15.688786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:15.706071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.706530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.707384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.707829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.755814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lazy-loading 'flavor' on Instance uuid 9cead481-ce3a-4f50-bfec-a39b3981b5d4 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:13:15.915030 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23aaada3-f703-4a70-a090-72f19b9c9851 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.236019 Jul 19 20:13:15.916360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2476/5058] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:13:15 2022] POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:13:15.924915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:15.925536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:15.936160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.936630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:15.944771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:15.945822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:16.281587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:16.291901 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-245e5028-f59f-4add-a128-2580649154b7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1509 microversion: 2.1 time: 0.370725 Jul 19 20:13:16.295940 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2583/5059] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:15 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:16.373490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:16.374351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:16.391103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:16.394845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:16.395931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:16.398033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:16.738085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:16.750250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:16.757657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:16.765581 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72057d78-c668-4951-91ab-e15d310ca2d4 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.400409 Jul 19 20:13:16.767793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2477/5060] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:16 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:17.327778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:17.328387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:17.342818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.343798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.356008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.356837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.796132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:17.797178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:17.802065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:17.849371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:17.851897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.852658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.859460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.861880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.872916 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de5acfde-194f-4da5-ab34-40131c85b835 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1492 microversion: 2.1 time: 0.547466 Jul 19 20:13:17.876546 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2584/5061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:17 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1492 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:17.916564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:17.922874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:17.953341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.955858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:17.963770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:17.966612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:18.226757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6e11d45-f09e-4e56-8028-734c2d1a15f4 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.321431 Jul 19 20:13:18.231691 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2585/5062] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:13:17 2022] POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:13:18.258789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:18.263913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:18.272491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:18.284748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:18.287904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:18.291190 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-996bc519-ffee-479e-9096-9c83d2c23711 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.502475 Jul 19 20:13:18.293414 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2478/5063] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:17 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:18.297533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:18.298239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:18.300302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:18.302539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:18.794287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:18.809853 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-429885eb-0313-4f8b-91df-98d677f3403d tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1498 microversion: 2.1 time: 0.573099 Jul 19 20:13:18.822281 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2586/5064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:18 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:19.315392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:19.317834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:19.337651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:19.338132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:19.340806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:19.342459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:19.481254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:19.496169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:19.504770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:19.509406 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b9ffed2-dbea-4d90-a585-6d8534feab16 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.200896 Jul 19 20:13:19.518009 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2479/5065] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:19 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:19.829730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:19.830521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:19.844171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:19.844696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:19.845560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:19.851436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:20.384826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:20.409621 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93d2743f-a4ea-4e4e-b5db-39c8bb2e3c03 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1498 microversion: 2.1 time: 0.585279 Jul 19 20:13:20.410231 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2587/5066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:19 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:13:20.529094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:20.529961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:20.541864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:20.542343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:20.570895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:20.579817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:20.933111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:20.949034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:20.951014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:20.952297 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73eb4beb-af8d-41b1-a555-4e9c6e1b0847 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.427684 Jul 19 20:13:20.966665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2480/5067] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:20 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:21.428565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:21.429293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:21.444715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:21.452348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:21.452818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:21.453658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:21.454094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:22.320837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-787336774", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "16983e8b-e51d-4e5f-a9bf-d83162f5c741"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:22.489063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] validate_networks() for [('16983e8b-e51d-4e5f-a9bf-d83162f5c741', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:13:22.633595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:22.644593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c334de14-8b1e-4af6-afe0-782235d31345 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1501 microversion: 2.1 time: 1.221149 Jul 19 20:13:22.645487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2588/5068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:21 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1501 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:22.653494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:22.654457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:22.689147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:22.690254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:22.692108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:22.697612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.048459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:23.062097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:23.067089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:23.069451 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67eb1215-f21c-4ac6-ad27-965385760dc9 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.422625 Jul 19 20:13:23.073623 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2589/5069] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:22 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:23.087381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:23.088257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:23.098606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.099122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.099919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.100402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.146465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lazy-loading 'flavor' on Instance uuid 9cead481-ce3a-4f50-bfec-a39b3981b5d4 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:13:23.302220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-635f0d68-2cb7-44db-ba01-804dbd75e8d7 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.224078 Jul 19 20:13:23.304722 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2590/5070] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:13:23 2022] POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:13:23.326259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:23.331368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:23.353993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.357550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.359934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.362262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.800838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:23.813444 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3a10cff5-2ba3-45c2-bca3-d44eb271e4d9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1509 microversion: 2.1 time: 0.493579 Jul 19 20:13:23.815166 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2591/5071] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:23 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:23.917797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:13:23.917797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:13:23.917797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:13:23.918506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:13:23.918506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:13:23.948673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.949307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:23.950003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:23.950442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.015002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Getting quotas for project 64878c642ab0495e9f47aaa504f8f010. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:13:24.030433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Getting quotas for user 3544b119b1fb44bf8f5eff59541dc73f and project 64878c642ab0495e9f47aaa504f8f010. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:13:24.064363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:13:24.069124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:13:24.090570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:24.091156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:24.101005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.101465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.102308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.102751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.182887 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a93ca393-cbc6-4a19-bcb4-9d921e47f445 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324469 Jul 19 20:13:24.183932 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2481/5072] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:13:24.207587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9605002d-2ecc-4cc0-af88-19c364018424 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:24.207587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9605002d-2ecc-4cc0-af88-19c364018424 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:24.257064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:24.266188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:24.276174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:24.277580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64d3a645-13b6-4d8c-a928-c2730cc4fb2e tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.191979 Jul 19 20:13:24.278157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2592/5073] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:24 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:24.348283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9605002d-2ecc-4cc0-af88-19c364018424 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:24.365643 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9605002d-2ecc-4cc0-af88-19c364018424 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1224 microversion: 2.1 time: 0.173516 Jul 19 20:13:24.366555 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2482/5074] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:24 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:24.836206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:24.838044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:24.858266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.874846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:24.876639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:24.877306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.306115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:25.307561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:25.329805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.331699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.333867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.336208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.464697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:25.475512 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f972f3e4-7e07-4c1d-9606-1bfb3baa24d6 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1492 microversion: 2.1 time: 0.646121 Jul 19 20:13:25.476106 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2593/5075] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:24 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1492 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:25.481284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:25.481904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:25.500143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.500676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.501491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.501926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.518031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:25.557047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:25.565754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:25.576394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f1b141c-3272-4b90-8c9e-863b1078e056 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.275541 Jul 19 20:13:25.577391 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2483/5076] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:25 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:25.584699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:25.592840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:25.600157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.601034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.602035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.602688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.790647 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8d7db7a-54e5-41d3-b4d2-20f6faf06df9 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.211591 Jul 19 20:13:25.817535 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2484/5077] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:13:25 2022] POST /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:13:25.844142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:25.857069 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af07cc05-0c9a-4293-ac03-8f3a59db7295 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1220 microversion: 2.1 time: 0.379646 Jul 19 20:13:25.858493 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2594/5078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:25 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1220 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:25.910367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:25.914582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:25.940192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.940956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:25.942370 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:25.943123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.345885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.364119 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6cd23de9-8ff0-47d2-99a1-4fd07f991f8f tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1498 microversion: 2.1 time: 0.537205 Jul 19 20:13:26.365501 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2485/5079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:25 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1498 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:26.597924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:26.598589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:26.613160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.615241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.616324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.618882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.780994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.785980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:26.800927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.805756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:26.808608 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b72fde5-11bd-4dfc-83fa-7a7d6bcef6ab tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.215865 Jul 19 20:13:26.816650 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2595/5080] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:26 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:26.887219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:26.887918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:26.898406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.901029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:26.905523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:26.906229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.103163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:27.113481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c364e52-1b63-405b-aca4-91cc35397a3f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1282 microversion: 2.1 time: 0.231523 Jul 19 20:13:27.125049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2486/5081] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:26 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:27.394120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:27.394120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:27.429854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.430349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.434573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.435109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.880025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:27.884056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:27.894890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.896546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.898551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:27.899230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:27.990743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:28.338191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:28.368751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:28.373913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:28.375260 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04bd279e-d052-41b2-96b5-7a56a4df952b tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.528174 Jul 19 20:13:28.382444 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2487/5082] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:27 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:28.391123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:28.393291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:28.421378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:28.422158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:28.427677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:28.428449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:28.503152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:28.520308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e90e63bc-9024-4297-9fc5-aa56e3d3b17a tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1498 microversion: 2.1 time: 1.125474 Jul 19 20:13:28.524167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2596/5083] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:27 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1498 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:28.646595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:28.656209 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d37af5e5-2f49-4c9a-bbee-689193cb2067 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1282 microversion: 2.1 time: 0.272161 Jul 19 20:13:28.656813 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2488/5084] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:28 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:29.394340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:29.395294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:29.407943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.412058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.415499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.419835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.543725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:29.545079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:29.572447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.572907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.573806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.574325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.599472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.615441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.617558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:29.619699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8d21159-fb75-4a8c-bce3-44387b75f9c8 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1408 microversion: 2.54 time: 0.229273 Jul 19 20:13:29.630075 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2597/5085] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:29 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:29.679441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:29.685136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:29.711688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.713046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:29.715018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:29.719558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.289190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:30.320668 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35e8e0f0-417d-4a63-b6ba-871f19d49740 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1501 microversion: 2.1 time: 0.785531 Jul 19 20:13:30.353865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2489/5086] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:29 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1501 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:30.393376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:30.407416 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5a02df1-f4f9-4597-9b98-f7aaa4246de3 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 0.737126 Jul 19 20:13:30.419152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:30.420134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:30.422885 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2598/5087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:29 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:30.484756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.488741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.500119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.500771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.651049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:30.652478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:30.676545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.678734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.684737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:30.685408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:30.696695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:30.959626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:30.967628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-398b18c4-d9cd-428a-8911-ee0b477fcb95 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 204 len: 0 microversion: 2.1 time: 0.598320 Jul 19 20:13:30.979183 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2490/5088] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:13:30 2022] DELETE /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:13:30.986378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:30.986904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:30.987796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:30.991117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:30.998219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d209f94b-bd73-4fa4-8c07-ff4c7ebdd3a6 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1426 microversion: 2.54 time: 0.354833 Jul 19 20:13:31.010804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:31.014035 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2599/5089] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:30 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1426 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:13:31.015080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.016340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:31.019859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.429249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:31.430866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:31.449620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:31.450358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.453176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:31.453855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.779596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:31.795874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fd42575-a665-4fc0-a1ac-b396b34b896c tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1507 microversion: 2.1 time: 0.813330 Jul 19 20:13:31.796885 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2491/5090] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:30 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:31.943003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b95a5ab6-c7b6-4a08-ab80-6e1eec2ab38c req-4ea0aa81-f528-4776-97f5-794eda63d6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b600de-b501-48bf-8919-997b52a8d833", "tag": "347e4304-5983-43f8-8dbd-fa3a71fcf797"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:31.968521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b95a5ab6-c7b6-4a08-ab80-6e1eec2ab38c req-4ea0aa81-f528-4776-97f5-794eda63d6c1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:31.968960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b95a5ab6-c7b6-4a08-ab80-6e1eec2ab38c req-4ea0aa81-f528-4776-97f5-794eda63d6c1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:31.995973 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b95a5ab6-c7b6-4a08-ab80-6e1eec2ab38c req-4ea0aa81-f528-4776-97f5-794eda63d6c1 service nova] Creating event network-changed:347e4304-5983-43f8-8dbd-fa3a71fcf797 for instance 87b600de-b501-48bf-8919-997b52a8d833 on n-h1-843834-3 Jul 19 20:13:32.008786 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b95a5ab6-c7b6-4a08-ab80-6e1eec2ab38c req-4ea0aa81-f528-4776-97f5-794eda63d6c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069657 Jul 19 20:13:32.011146 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2492/5091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:32.048995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:32.050105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:32.073660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:32.077492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:32.082671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:32.083446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:32.085888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:32.100791 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7cb1b50-bb4e-437d-93cc-1674e1c36b8d tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 0.675754 Jul 19 20:13:32.102489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2600/5092] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:31 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:32.267448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:32.276629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:32.278333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:32.292820 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4dc3d076-42ab-4773-b755-1c0f61e0e552 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1414 microversion: 2.54 time: 0.269714 Jul 19 20:13:32.293806 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2493/5093] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:32 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1414 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:32.829018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:32.836359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:32.853571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:32.854013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:32.854792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:32.855443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.119380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:33.120695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:33.137215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:33.139239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.141046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:33.141775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:33.985818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:34.193718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:34.207048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d5e2311-2006-40c5-a36e-d32f0d1e3fc5 tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1507 microversion: 2.1 time: 1.396707 Jul 19 20:13:34.207676 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2601/5094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:32 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1507 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:34.231392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:34.232045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:34.255941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:34.256622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:34.257737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:34.258338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:34.353081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:34.600970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:34.617087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1cd3c234-6125-4122-b103-72ce9d18bf6f tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 1.495317 Jul 19 20:13:34.622409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2494/5095] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:33 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:13:34.653315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:34.661975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:34.663621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:34.664752 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60f3cad4-a899-4faa-b722-2c882638913f tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1414 microversion: 2.54 time: 0.437872 Jul 19 20:13:34.676906 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2602/5096] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:34 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1414 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:35.225416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:35.226973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:35.251368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:35.253170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:35.256815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:35.258940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:35.634307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:35.635944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:35.646055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:35.646505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:35.647327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:35.647753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.477297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9cc8f6dbb144a48e87954fd2af9e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a616fe59c114be48583cbd567792152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:36.495558 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4fcdfa15-316e-4409-8536-b78cd6e29acc tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 200 len: 1507 microversion: 2.1 time: 1.274953 Jul 19 20:13:36.513304 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2495/5097] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:35 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 1507 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:36.544827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:36.550239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:36.582856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.584028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.585904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.589882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.777470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:36.793700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:36.796852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:36.800969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d23eca0-32c6-425c-884d-f0b2ef586f50 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1399 microversion: 2.54 time: 0.286367 Jul 19 20:13:36.804929 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2496/5098] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:36 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1399 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:36.806661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:36.811987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b66bac02-196c-4500-87b9-94d031001960 req-6445e1ec-c5dc-4381-aa1c-469d79597251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cead481-ce3a-4f50-bfec-a39b3981b5d4", "name": "network-vif-deleted", "tag": "03250eb9-2563-4ce5-b429-47a72a4db963"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:36.821220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae5af33e-7a2d-47ef-845c-3cc9a5a5cdcb tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 1.190827 Jul 19 20:13:36.821837 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2603/5099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:35 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:36.829082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b66bac02-196c-4500-87b9-94d031001960 req-6445e1ec-c5dc-4381-aa1c-469d79597251 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.830575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b66bac02-196c-4500-87b9-94d031001960 req-6445e1ec-c5dc-4381-aa1c-469d79597251 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.849853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4bd30f1-02e0-4ff9-814f-b122d46ae9ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '.version_select at 0x7f23ee1d4ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:36.856468 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b66bac02-196c-4500-87b9-94d031001960 req-6445e1ec-c5dc-4381-aa1c-469d79597251 service nova] Creating event network-vif-deleted:03250eb9-2563-4ce5-b429-47a72a4db963 for instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 on n-h2-843834-3 Jul 19 20:13:36.866121 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b66bac02-196c-4500-87b9-94d031001960 req-6445e1ec-c5dc-4381-aa1c-469d79597251 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058050 Jul 19 20:13:36.894889 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2497/5100] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:36.921983 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4bd30f1-02e0-4ff9-814f-b122d46ae9ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1969077138" status: 204 len: 0 microversion: 2.54 time: 0.088539 Jul 19 20:13:36.923122 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2604/5101] 10.222.0.23 () {60 vars in 1318 bytes} [Tue Jul 19 20:13:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1969077138 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:13:36.939454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:36.940624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:36.952707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.953713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:36.954744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:36.955389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.005348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:37.173323 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6072176b-add2-4289-aac4-b121de3aa011 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 204 len: 0 microversion: 2.54 time: 0.238832 Jul 19 20:13:37.181208 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2498/5102] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 20:13:36 2022] DELETE /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:13:37.188795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:37.189716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:37.211036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.211182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.211974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.214613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.432872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.459289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.464844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:37.473767 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e18ebf6-d20f-41e3-bc8d-0c66d58508ae tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1405 microversion: 2.54 time: 0.292077 Jul 19 20:13:37.486943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2605/5103] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:37 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:37.519878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:37.521123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] [instance: 9cead481-ce3a-4f50-bfec-a39b3981b5d4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:37.550630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.551120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.551995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.562645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.588398 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] HTTP exception thrown: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Request method failure captured: Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 HTTP/1.1 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xA0cpQIwx73MZ3VRWCfOobdMjKF18jQe4V9Uw3tDOCBfVC7NpeQq4wDDL09PLUwkFo6HqrcYWQkW2dDPGNjUnafxekUlWMM8W4yCVUVxcR_pGWRJbRhsLAx4omj1RUsuVf8mBBvrxa_8iXBPO2LH4kYy2kMgOIguZy1qbzneAVGf50 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2a616fe59c114be48583cbd567792152 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestServerAdvancedOps-494513649 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a616fe59c114be48583cbd567792152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2a616fe59c114be48583cbd567792152"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2a616fe59c114be48583cbd567792152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a616fe59c114be48583cbd567792152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestServerAdvancedOps-494513649 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2a616fe59c114be48583cbd567792152 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestServerAdvancedOps-494513649 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestServerAdvancedOps-494513649-project Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 5e9cc8f6dbb144a48e87954fd2af9e15 Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestServerAdvancedOps-494513649-project Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '9cead481-ce3a-4f50-bfec-a39b3981b5d4'} Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:37.590550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. Jul 19 20:13:37.595587 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:37.597055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] Returning 404 to user: Instance 9cead481-ce3a-4f50-bfec-a39b3981b5d4 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:37.599999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a83eb7b4-22bd-45d4-8bf0-9b0ca076a55b tempest-TestServerAdvancedOps-494513649 tempest-TestServerAdvancedOps-494513649-project] 10.222.0.23 "GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4" status: 404 len: 111 microversion: 2.1 time: 0.086149 Jul 19 20:13:37.604108 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2499/5104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:37 2022] GET /compute/v2.1/servers/9cead481-ce3a-4f50-bfec-a39b3981b5d4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:13:37.838865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:37.840354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:37.854038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.855030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:37.856079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:37.861910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:38.252914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:38.269845 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c9e9644-31d2-40ab-a28b-e1b0a8b95529 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 0.435926 Jul 19 20:13:38.273317 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2606/5105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:37 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:38.501081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:38.501720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:38.516699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:38.523180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:38.528414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:38.529147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:38.713595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:38.744347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:38.747421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:38.748894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-31cd013b-016b-402d-afdd-161c8dc48b01 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1405 microversion: 2.54 time: 0.252020 Jul 19 20:13:38.750031 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2500/5106] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:38 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:39.034064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a0d8f705-af98-416f-9e74-0a5ffd2f54b7 req-e8f32c6b-85ed-4b9d-9595-39cd1c085781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b600de-b501-48bf-8919-997b52a8d833", "name": "network-vif-plugged", "status": "completed", "tag": "347e4304-5983-43f8-8dbd-fa3a71fcf797"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:39.066263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a0d8f705-af98-416f-9e74-0a5ffd2f54b7 req-e8f32c6b-85ed-4b9d-9595-39cd1c085781 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.066729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a0d8f705-af98-416f-9e74-0a5ffd2f54b7 req-e8f32c6b-85ed-4b9d-9595-39cd1c085781 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.099517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a0d8f705-af98-416f-9e74-0a5ffd2f54b7 req-e8f32c6b-85ed-4b9d-9595-39cd1c085781 service nova] Creating event network-vif-plugged:347e4304-5983-43f8-8dbd-fa3a71fcf797 for instance 87b600de-b501-48bf-8919-997b52a8d833 on n-h1-843834-3 Jul 19 20:13:39.144116 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a0d8f705-af98-416f-9e74-0a5ffd2f54b7 req-e8f32c6b-85ed-4b9d-9595-39cd1c085781 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099498 Jul 19 20:13:39.147852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2607/5107] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:13:39.290937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:39.294817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:39.313298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.313874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.315067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.315637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.770303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:39.771109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:39.787482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.788007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.790063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.790515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.910134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:39.910716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:39.911644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lazy-loading 'fault' on Instance uuid d2dd2684-dca0-49cd-801a-fc663e4b8ac0 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:13:39.945450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:39.960905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-89085717-50e0-42c9-a219-edb83c0886d5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 0.674114 Jul 19 20:13:39.968606 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2501/5108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:39 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:40.065393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:40.136403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:40.140812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd03fcf4ce447fb8c4ca08c226b69f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36118ddf8604742806c63008611ab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:40.142613 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f303442-e5a7-475d-a072-e32bde69f637 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 200 len: 1410 microversion: 2.54 time: 0.377422 Jul 19 20:13:40.144969 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2608/5109] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:39 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 1410 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:13:40.988536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:40.989158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:41.020876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:41.021338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:41.022170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:41.022563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:41.166880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:41.168464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] [instance: d2dd2684-dca0-49cd-801a-fc663e4b8ac0] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:41.183214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:41.184159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:41.192615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:41.193257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:41.238622 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] HTTP exception thrown: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Request method failure captured: Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 HTTP/1.1 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xA0-ch8S4fHLD333NIbUa0EVoY9fyTBqhiKv6TuVMKgAm5QJD-pkDOTRH-Pacqa_xDyzFqSUCWAKDcnQgDvTRqfwLrAcUaljifxBaU5xuDTXFjZogRFjAPIeO4m1qUG_KdD2EeBYQhGCxxwc1DQw2Novhtb4Z5AbhTZ_O513r_7aTM Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.54 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e36118ddf8604742806c63008611ab4f Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerShowV254Test-718057817 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e36118ddf8604742806c63008611ab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e36118ddf8604742806c63008611ab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e36118ddf8604742806c63008611ab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e36118ddf8604742806c63008611ab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerShowV254Test-718057817 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e36118ddf8604742806c63008611ab4f Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerShowV254Test-718057817 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerShowV254Test-718057817-project Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 5dd03fcf4ce447fb8c4ca08c226b69f6 Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerShowV254Test-718057817-project Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'd2dd2684-dca0-49cd-801a-fc663e4b8ac0'} Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:41.263378 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. Jul 19 20:13:41.268247 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:41.270236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] Returning 404 to user: Instance d2dd2684-dca0-49cd-801a-fc663e4b8ac0 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:41.281589 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c40f08b-ef6d-4a31-8d08-9dae04547620 tempest-ServerShowV254Test-718057817 tempest-ServerShowV254Test-718057817-project] 10.222.0.23 "GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0" status: 404 len: 111 microversion: 2.54 time: 0.123711 Jul 19 20:13:41.282770 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2609/5110] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:13:41 2022] GET /compute/v2.1/servers/d2dd2684-dca0-49cd-801a-fc663e4b8ac0 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:13:41.572840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:41.578959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:41.589177 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e1f27e67-052c-41ec-8865-edc6f14b8b98 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1324 microversion: 2.1 time: 0.610254 Jul 19 20:13:41.590470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2502/5111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:40 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:42.608628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:42.609242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:42.621965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:42.642657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:42.644084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:42.645017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.148957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:43.157525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a65e5085-7f58-41a1-b6f0-6fcbe9b53b28 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1522 microversion: 2.1 time: 0.552884 Jul 19 20:13:43.158168 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2610/5112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:42 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:43.182019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:43.183350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:43.200302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.206091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.207336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.209430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.250541 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] HTTP exception thrown: Instance is not a member of specified network Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Request method failure captured: Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833/ips/invalid HTTP/1.1 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xBhtrxAJFe0xyq9SQoFirSAXcJJtlKDvOIL0RoNHRqBP22Iz08jvXtl1udG2qXHjeC_02EYOdleu5IBzFeP3_NhzAnpcU1RFoHVl9otrxE7oaXdD7pdSNTCNKHePVVv_tfX9vniQTVz9QQnxLemTsW88GU2m7XHPuzh12ycPiD1eg4 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3544b119b1fb44bf8f5eff59541dc73f Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance is not a member of specified network Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '87b600de-b501-48bf-8919-997b52a8d833', 'id': 'invalid'} Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 19 20:13:43.255701 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.260635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:43.261582 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a1f6dc42-f636-4686-a6fc-77d072aa980c tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.087350 Jul 19 20:13:43.262936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2503/5113] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 20:13:43 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833/ips/invalid => generated 91 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:13:43.275501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:43.276349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Failed to fetch instance by id 999 {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 20:13:43.277027 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] HTTP exception thrown: Instance 999 could not be found. Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Request method failure captured: Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xBhtrxAJFe0xyq9SQoFirSAXcJJtlKDvOIL0RoNHRqBP22Iz08jvXtl1udG2qXHjeC_02EYOdleu5IBzFeP3_NhzAnpcU1RFoHVl9otrxE7oaXdD7pdSNTCNKHePVVv_tfX9vniQTVz9QQnxLemTsW88GU2m7XHPuzh12ycPiD1eg4 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3544b119b1fb44bf8f5eff59541dc73f Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 999 could not be found. Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '999'} Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 20:13:43.279497 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:13:43.284387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:43.284387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f136f5b7-dc3d-4a4c-b4a9-c759efba82d9 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012998 Jul 19 20:13:43.284387 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2611/5114] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 19 20:13:43 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:13:43.295865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:43.296707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:43.306078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.307541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.309050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.309576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.434090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:13:43.684987 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4921831-88c7-4559-93dc-5152f8753110 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 204 len: 0 microversion: 2.1 time: 0.386067 Jul 19 20:13:43.686079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2504/5115] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:13:43 2022] DELETE /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:13:43.706153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:43.709914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:43.741163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.746026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:43.748704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:43.750250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:44.209586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:44.218471 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-061205b9-88a4-400a-b98c-94c0e2552245 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1528 microversion: 2.1 time: 0.525617 Jul 19 20:13:44.219101 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2612/5116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:43 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:45.238036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:45.240805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:45.321794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:45.336123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:45.353364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:45.368291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:46.396917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:46.457849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5ef605ad-ec84-4d7c-beb5-fea261048a35 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1528 microversion: 2.1 time: 1.224299 Jul 19 20:13:46.458482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2505/5117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:45 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1528 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:47.477968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:47.479436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:47.494632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:47.497035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:47.499336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:47.502129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:47.554060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1b340913-5b2f-42fe-a95c-d4342447c321 req-082c5780-7e38-474c-84a9-6e7d2e264e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b600de-b501-48bf-8919-997b52a8d833", "name": "network-vif-deleted", "tag": "347e4304-5983-43f8-8dbd-fa3a71fcf797"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:13:47.609971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b340913-5b2f-42fe-a95c-d4342447c321 req-082c5780-7e38-474c-84a9-6e7d2e264e68 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:47.610674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b340913-5b2f-42fe-a95c-d4342447c321 req-082c5780-7e38-474c-84a9-6e7d2e264e68 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:47.653514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1b340913-5b2f-42fe-a95c-d4342447c321 req-082c5780-7e38-474c-84a9-6e7d2e264e68 service nova] Creating event network-vif-deleted:347e4304-5983-43f8-8dbd-fa3a71fcf797 for instance 87b600de-b501-48bf-8919-997b52a8d833 on n-h1-843834-3 Jul 19 20:13:47.659611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1b340913-5b2f-42fe-a95c-d4342447c321 req-082c5780-7e38-474c-84a9-6e7d2e264e68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110943 Jul 19 20:13:47.660903 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2506/5118] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:13:47.983317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544b119b1fb44bf8f5eff59541dc73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64878c642ab0495e9f47aaa504f8f010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:13:47.988044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41b78d5a-9322-4b18-96ce-961a45d7f0b0 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 200 len: 1486 microversion: 2.1 time: 0.515748 Jul 19 20:13:47.992633 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2613/5119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:47 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 1486 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:13:49.012836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:13:49.013705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] [instance: 87b600de-b501-48bf-8919-997b52a8d833] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:13:49.023316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:13:49.049962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:49.050456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:49.052713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:13:49.052713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:13:49.137518 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] HTTP exception thrown: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Request method failure captured: Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 HTTP/1.1 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xBhtrxAJFe0xyq9SQoFirSAXcJJtlKDvOIL0RoNHRqBP22Iz08jvXtl1udG2qXHjeC_02EYOdleu5IBzFeP3_NhzAnpcU1RFoHVl9otrxE7oaXdD7pdSNTCNKHePVVv_tfX9vniQTVz9QQnxLemTsW88GU2m7XHPuzh12ycPiD1eg4 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64878c642ab0495e9f47aaa504f8f010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 64878c642ab0495e9f47aaa504f8f010 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-852482661 Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3544b119b1fb44bf8f5eff59541dc73f Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-852482661-project Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '87b600de-b501-48bf-8919-997b52a8d833'} Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:49.139582 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. Jul 19 20:13:49.144744 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:13:49.156131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] Returning 404 to user: Instance 87b600de-b501-48bf-8919-997b52a8d833 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:13:49.158066 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e64c9e04-8074-4c3e-9cd4-9aed0fe149e5 tempest-ServerAddressesNegativeTestJSON-852482661 tempest-ServerAddressesNegativeTestJSON-852482661-project] 10.222.0.23 "GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833" status: 404 len: 111 microversion: 2.1 time: 0.151889 Jul 19 20:13:49.159423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2507/5120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:13:49 2022] GET /compute/v2.1/servers/87b600de-b501-48bf-8919-997b52a8d833 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:14:16.881481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:16.883309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=90 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:17.784644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2034003151", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "6981c0c9-6eed-487b-9d73-7a7fb9a508c9"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:17.947141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] validate_networks() for [('6981c0c9-6eed-487b-9d73-7a7fb9a508c9', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:14:19.488714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:14:19.489377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:14:19.489562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:14:19.491678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:14:19.492715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:14:19.513800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.517256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:19.525462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:19.527645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:19.577451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Getting quotas for project 2c8b5261815d4f3e839aa785b2abada9. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:14:19.590482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Getting quotas for user 86b0d71357f24c1e95a88d4a2f13a217 and project 2c8b5261815d4f3e839aa785b2abada9. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:14:19.638367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:14:19.646143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:14:19.789209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f1a1924-64d0-40cf-adc4-261b56e178a2 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.911948 Jul 19 20:14:19.789942 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2614/5121] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 19 20:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 19 20:14:19.813671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:19.821303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:19.880222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:21.070582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.110330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.143658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:21.145050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-471b3ddb-ca4d-4796-b934-e3783d9c7df0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1262 microversion: 2.26 time: 1.347127 Jul 19 20:14:21.145650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2508/5122] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:19 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1262 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:22.164644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:22.165257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:22.202761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:22.203493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:22.204393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:22.204851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:23.524955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:23.545604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:23.552770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:23.568882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef4c4275-f42c-4a9f-ab29-57236b80c237 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1314 microversion: 2.26 time: 1.407606 Jul 19 20:14:23.602267 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2615/5123] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:22 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1314 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:24.595775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:24.596476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:24.628468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:24.628951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:24.629790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:24.645671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:25.362658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:25.403617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:25.417114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:25.428671 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-457566b8-848e-4eac-ae5d-6e54b5b5f185 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1320 microversion: 2.26 time: 0.843674 Jul 19 20:14:25.449128 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2509/5124] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:24 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1320 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:26.466746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:26.469111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:26.493002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:26.499086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:26.500667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:26.504566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:26.732831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:26.751387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:26.752943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:26.754196 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd0e4bc1-fbd9-40a2-925c-1d25f04e82c9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1320 microversion: 2.26 time: 0.292170 Jul 19 20:14:26.787433 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2616/5125] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:26 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:27.774332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:27.774974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:27.797713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:27.798318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:27.802074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:27.802749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:28.859546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:28.873518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:28.880459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:28.881832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d031d8a5-3f86-4e10-b2b9-a5a1da915d0e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 1.111868 Jul 19 20:14:28.884368 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2510/5126] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:27 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:29.912190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:29.912977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:29.927640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:29.928721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:29.933609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:29.937467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:29.939779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:29.940487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:30.617014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:30.638545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:30.640122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:30.641306 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ffca70dc-13fa-4664-b186-d838baac1345 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.733613 Jul 19 20:14:30.641894 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2617/5127] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:29 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:31.652359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-87e5b784-daca-4501-beca-b033969fdd82 req-0e2ea8a9-0eea-45a9-9697-aff4d601e81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3b1477-2f27-49f8-b09b-35ceecca8714", "tag": "017031e8-3a0a-45ad-9fda-a2c1624817ce"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:31.660964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:31.662082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:31.694104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:31.697599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:31.703691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:31.708074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:31.708883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:31.721971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87e5b784-daca-4501-beca-b033969fdd82 req-0e2ea8a9-0eea-45a9-9697-aff4d601e81b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:31.732808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87e5b784-daca-4501-beca-b033969fdd82 req-0e2ea8a9-0eea-45a9-9697-aff4d601e81b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:31.802395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-87e5b784-daca-4501-beca-b033969fdd82 req-0e2ea8a9-0eea-45a9-9697-aff4d601e81b service nova] Creating event network-changed:017031e8-3a0a-45ad-9fda-a2c1624817ce for instance ae3b1477-2f27-49f8-b09b-35ceecca8714 on n-h1-843834-3 Jul 19 20:14:31.832478 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-87e5b784-daca-4501-beca-b033969fdd82 req-0e2ea8a9-0eea-45a9-9697-aff4d601e81b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195637 Jul 19 20:14:31.834518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2511/5128] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:14:32.250331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:32.284272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:32.288183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:32.291603 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c2f789b7-ef5b-4a15-9ee8-438f403a3965 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.635585 Jul 19 20:14:32.303138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2618/5129] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:31 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:33.321379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:33.323427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:33.332878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:33.335858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:33.341255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:33.342346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:33.641531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:33.659613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:33.666986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:33.669253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12906506-0c3d-4f8e-a0af-c1cbc1a18289 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.355520 Jul 19 20:14:33.672253 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2512/5130] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:33 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:34.703522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:34.704098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:34.735284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:34.748294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:34.753095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:34.755344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:35.113785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:35.144035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:35.145832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:35.160502 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6b60744-808a-4469-bae9-f11eaaade657 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.462106 Jul 19 20:14:35.170946 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2619/5131] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:34 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:14:36.183776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:36.184579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:36.198959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:36.200077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:36.201698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:36.203458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:36.692548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:36.719407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:36.721261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:36.722672 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56f16ee3-c52e-4bc7-ae60-b2d7e6b5eef6 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.544650 Jul 19 20:14:36.724563 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2513/5132] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:36 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:36.791723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4f718cc3-2127-4245-9e60-11fbddcb13b6 req-c4358535-696e-4096-be78-dc9c1305bf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3b1477-2f27-49f8-b09b-35ceecca8714", "name": "network-vif-plugged", "status": "completed", "tag": "017031e8-3a0a-45ad-9fda-a2c1624817ce"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:36.817311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4f718cc3-2127-4245-9e60-11fbddcb13b6 req-c4358535-696e-4096-be78-dc9c1305bf69 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:36.818119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4f718cc3-2127-4245-9e60-11fbddcb13b6 req-c4358535-696e-4096-be78-dc9c1305bf69 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:36.853824 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4f718cc3-2127-4245-9e60-11fbddcb13b6 req-c4358535-696e-4096-be78-dc9c1305bf69 service nova] Creating event network-vif-plugged:017031e8-3a0a-45ad-9fda-a2c1624817ce for instance ae3b1477-2f27-49f8-b09b-35ceecca8714 on n-h1-843834-3 Jul 19 20:14:36.875228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4f718cc3-2127-4245-9e60-11fbddcb13b6 req-c4358535-696e-4096-be78-dc9c1305bf69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085901 Jul 19 20:14:36.892282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2620/5133] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:14:37.742886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:37.743556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:37.772721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:37.773894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:37.775318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:37.775958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:38.181560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:38.193735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:38.199249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:38.200465 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d10b910-ee92-4457-a18b-87af054cabbe tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1362 microversion: 2.26 time: 0.462181 Jul 19 20:14:38.205551 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2514/5134] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:37 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:39.223195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:39.223903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:39.235932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.236388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.237186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.237625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.785184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:39.800113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:39.808799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:39.816346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0475ad5d-3e40-4235-81e1-fb8f9b8634fc tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1546 microversion: 2.26 time: 0.595206 Jul 19 20:14:39.819105 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2621/5135] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:39 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1546 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:39.857661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef4255e0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:39.885488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.891163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.894706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:39.909677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.910202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.912176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.912681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:39.977468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:39.978426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.003055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.004708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.145936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:40.186455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-551e2722-b614-415f-815d-bffd57cf0ba9 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1298254916" status: 201 len: 0 microversion: 2.26 time: 0.345925 Jul 19 20:14:40.197327 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2515/5136] 10.222.0.23 () {62 vars in 1379 bytes} [Tue Jul 19 20:14:39 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1298254916 => generated 0 bytes in 353 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 20:14:40.203379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ca7c3b35-e247-4ac5-b2f1-3bdc043e2f15 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1d4ee0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.217739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca7c3b35-e247-4ac5-b2f1-3bdc043e2f15 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.218325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ca7c3b35-e247-4ac5-b2f1-3bdc043e2f15 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.263618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ca7c3b35-e247-4ac5-b2f1-3bdc043e2f15 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1298254916" status: 204 len: 0 microversion: 2.26 time: 0.061114 Jul 19 20:14:40.265644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2622/5137] 10.222.0.23 () {60 vars in 1360 bytes} [Tue Jul 19 20:14:40 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1298254916 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:40.274410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef313670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.308063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.308552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.309142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:40.327617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.328211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.330235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.336708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.400355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.411853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.449714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:40.489901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7f5be35f-2de3-4bff-b647-eace3d19567f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 204 len: 0 microversion: 2.26 time: 0.219798 Jul 19 20:14:40.491228 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2516/5138] 10.222.0.23 () {60 vars in 1294 bytes} [Tue Jul 19 20:14:40 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:40.502268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b3e7c85-c687-4ec3-95e6-2c911f5cbf7e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1d4f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.523883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c85-c687-4ec3-95e6-2c911f5cbf7e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.524334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c85-c687-4ec3-95e6-2c911f5cbf7e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.558275 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b3e7c85-c687-4ec3-95e6-2c911f5cbf7e tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 12 microversion: 2.26 time: 0.059572 Jul 19 20:14:40.561068 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2623/5139] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 20:14:40 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:40.571512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef43a670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.586659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.588838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.590192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:40.610903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.612332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.613373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.614353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.680692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.681157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.709740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.710207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.798792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:40.858429 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e58dc219-2cc0-4890-a981-4d589ace50f5 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-873837331" status: 201 len: 0 microversion: 2.26 time: 0.291317 Jul 19 20:14:40.863650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2517/5140] 10.222.0.23 () {62 vars in 1376 bytes} [Tue Jul 19 20:14:40 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-873837331 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 20:14:40.870067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bf9e7c47-bc35-48fc-b919-56fc65de6fdd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1e0820>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.885463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf9e7c47-bc35-48fc-b919-56fc65de6fdd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.885923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf9e7c47-bc35-48fc-b919-56fc65de6fdd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.926696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bf9e7c47-bc35-48fc-b919-56fc65de6fdd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 35 microversion: 2.26 time: 0.061455 Jul 19 20:14:40.928841 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2624/5141] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 20:14:40 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 35 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:40.952171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef930b80>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:40.965445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:40.981406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:40.982672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:41.004524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.005001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.005851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.006295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.065319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.066838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.166118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:41.211313 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b4e2ed9-1f87-4fab-b631-b950f9ff4386 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-873837331" status: 204 len: 0 microversion: 2.26 time: 0.277371 Jul 19 20:14:41.214983 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2518/5142] 10.222.0.23 () {60 vars in 1360 bytes} [Tue Jul 19 20:14:40 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-873837331 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:41.225102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-468a6356-4a9a-4971-8922-ff0d60378fa0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1cdb80>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:41.243874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-468a6356-4a9a-4971-8922-ff0d60378fa0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.248603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-468a6356-4a9a-4971-8922-ff0d60378fa0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.274321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-468a6356-4a9a-4971-8922-ff0d60378fa0 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 12 microversion: 2.26 time: 0.045786 Jul 19 20:14:41.277333 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2625/5143] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 20:14:41 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:41.287585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef930e50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:41.299347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.306996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.307763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:41.315163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.316164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.318893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.320316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.377007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.377798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.392476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:41.431375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d09c4856-be36-4ef4-998f-59cceb949a7f tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 204 len: 0 microversion: 2.26 time: 0.148339 Jul 19 20:14:41.432359 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2519/5144] 10.222.0.23 () {60 vars in 1294 bytes} [Tue Jul 19 20:14:41 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:41.445061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1e0700>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:41.457391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.458207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.459447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:41.468322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.469323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.470438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.471222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.504284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.505087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.517867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.518667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.595583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:41.663414 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bcc0eb49-2d3e-474d-a9c3-4efac28edb34 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-261388003" status: 201 len: 0 microversion: 2.26 time: 0.225006 Jul 19 20:14:41.675676 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2626/5145] 10.222.0.23 () {62 vars in 1376 bytes} [Tue Jul 19 20:14:41 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-261388003 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 20:14:41.678354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef5d4a60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:41.699530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.700396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.701567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:41.723529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.726576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.727988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.729082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.830099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:41.845407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.846765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:41.904222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:41.909726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.008952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:42.036359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3aedc297-0a0a-46ef-a238-bc524b0ab2e4 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-770297402" status: 201 len: 0 microversion: 2.26 time: 0.362943 Jul 19 20:14:42.038190 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2520/5146] 10.222.0.23 () {62 vars in 1376 bytes} [Tue Jul 19 20:14:41 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-770297402 => generated 0 bytes in 365 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 20:14:42.048483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee1e0c10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.066074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.066986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.067714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:42.081186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.082090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.085252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.086141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.142942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.143857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.181460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:42.236898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf96390a-5650-44e0-8d07-d4f2267e7b4a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 204 len: 0 microversion: 2.26 time: 0.193675 Jul 19 20:14:42.240960 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2627/5147] 10.222.0.23 () {60 vars in 1294 bytes} [Tue Jul 19 20:14:42 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:42.253174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0feef139-5eb6-4ede-8d5a-819eb7bf13cd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23efbaa820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.289738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0feef139-5eb6-4ede-8d5a-819eb7bf13cd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.291987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0feef139-5eb6-4ede-8d5a-819eb7bf13cd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.328998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0feef139-5eb6-4ede-8d5a-819eb7bf13cd tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 12 microversion: 2.26 time: 0.079794 Jul 19 20:14:42.349550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee330af0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.352944 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2521/5148] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 20:14:42 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 12 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:42.378133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.378689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.380431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:42.397421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.397894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.398702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.403033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.486308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.488758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.519615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:42.611032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6336f795-b4d4-4e45-8fdb-4c506eb9281a tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 204 len: 0 microversion: 2.26 time: 0.260199 Jul 19 20:14:42.614935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2628/5149] 10.222.0.23 () {60 vars in 1294 bytes} [Tue Jul 19 20:14:42 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:42.626089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ef406820>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.646565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.647072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.647553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:42.689720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.690272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.694133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.694975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.772387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.772846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.800434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.800913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.858446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:42.903839 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b563c0cd-b5ea-40ab-ba87-a5cab409fd56 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1470162398" status: 201 len: 0 microversion: 2.26 time: 0.283449 Jul 19 20:14:42.904913 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2522/5150] 10.222.0.23 () {62 vars in 1379 bytes} [Tue Jul 19 20:14:42 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-1470162398 => generated 0 bytes in 286 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 20:14:42.914438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee248670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:42.933007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.933467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.933968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:42.965430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.965893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:42.966679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:42.987107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.083619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.084087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.152001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.155526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.225976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:43.257992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:43.327527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3122c07d-d015-443b-843a-e18532cc0f63 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-786068798" status: 201 len: 0 microversion: 2.26 time: 0.417073 Jul 19 20:14:43.338987 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2629/5151] 10.222.0.23 () {62 vars in 1376 bytes} [Tue Jul 19 20:14:42 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags/tempest-tag-786068798 => generated 0 bytes in 429 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 20:14:43.352732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Action: 'update_all', calling method: .version_select at 0x7f23ef406040>, body: {"tags": ["tempest-tag-81838429", "tempest-tag-1984805657"]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:43.383716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.384681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.389052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:43.410542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.412940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.413926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.414824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.484290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.484717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.521054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:43.544690 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-192f1888-09fd-4da0-b531-ef1a589d0b28 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 60 microversion: 2.26 time: 0.198043 Jul 19 20:14:43.546089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2523/5152] 10.222.0.23 () {62 vars in 1311 bytes} [Tue Jul 19 20:14:43 2022] PUT /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 60 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:43.556033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7c29caf-d0ef-475d-9540-d50f33fdbf18 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f23ee238e50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:43.576282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7c29caf-d0ef-475d-9540-d50f33fdbf18 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.579137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7c29caf-d0ef-475d-9540-d50f33fdbf18 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.593750 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7c29caf-d0ef-475d-9540-d50f33fdbf18 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 200 len: 60 microversion: 2.26 time: 0.041825 Jul 19 20:14:43.605783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '.version_select at 0x7f2400a51ca0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:43.608640 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2630/5153] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 19 20:14:43 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 60 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:14:43.628383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.628851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.629341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:43.648932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.649393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.650304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.650758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.760135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.764115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.808437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lazy-loading 'flavor' on Instance uuid ae3b1477-2f27-49f8-b09b-35ceecca8714 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:14:43.861534 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e1d95e8-5b9c-4ff8-96b4-dc216fd34ea8 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags" status: 204 len: 0 microversion: 2.26 time: 0.251043 Jul 19 20:14:43.872858 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2524/5154] 10.222.0.23 () {60 vars in 1294 bytes} [Tue Jul 19 20:14:43 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714/tags => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 20:14:43.880543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:43.881315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:43.891203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.891667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:43.892487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:43.892914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:44.007119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:14:44.440278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-febff5f5-a0ae-44e9-a9a0-94c137973095 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 204 len: 0 microversion: 2.26 time: 0.566682 Jul 19 20:14:44.442372 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2631/5155] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 19 20:14:43 2022] DELETE /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:14:44.477192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:44.478510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:44.527232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:44.530667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:44.537532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:44.539256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:45.548200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:45.564974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:45.577560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:45.588903 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04363de7-db51-447d-b206-5dd8488e7210 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1552 microversion: 2.26 time: 1.132748 Jul 19 20:14:45.595983 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2525/5156] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:44 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1552 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:46.613721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:46.615104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:46.667135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:46.667874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:46.672458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:46.673068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:47.450372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:47.482445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:47.487263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:47.492202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9cb8d9df-0700-42b3-8d3e-c771b0851faf tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1552 microversion: 2.26 time: 0.882075 Jul 19 20:14:47.496876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2632/5157] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:46 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1552 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:48.532085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:48.532928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:48.585869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:48.588861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:48.592795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:48.613421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:48.661675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-de807c04-4c52-4906-8809-68058a7c4bb2 req-3903c59a-5778-4782-bf50-2206f5557154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3b1477-2f27-49f8-b09b-35ceecca8714", "name": "network-vif-deleted", "tag": "017031e8-3a0a-45ad-9fda-a2c1624817ce"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:48.676873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:48.722686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de807c04-4c52-4906-8809-68058a7c4bb2 req-3903c59a-5778-4782-bf50-2206f5557154 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:48.727178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de807c04-4c52-4906-8809-68058a7c4bb2 req-3903c59a-5778-4782-bf50-2206f5557154 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:48.796141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-de807c04-4c52-4906-8809-68058a7c4bb2 req-3903c59a-5778-4782-bf50-2206f5557154 service nova] Creating event network-vif-deleted:017031e8-3a0a-45ad-9fda-a2c1624817ce for instance ae3b1477-2f27-49f8-b09b-35ceecca8714 on n-h1-843834-3 Jul 19 20:14:48.852768 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-de807c04-4c52-4906-8809-68058a7c4bb2 req-3903c59a-5778-4782-bf50-2206f5557154 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190762 Jul 19 20:14:48.858501 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2633/5158] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:14:49.024353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:49.045702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:49.054424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b0d71357f24c1e95a88d4a2f13a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8b5261815d4f3e839aa785b2abada9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:14:49.057116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa62d332-cc8b-4dab-9883-8713d53567b1 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 200 len: 1510 microversion: 2.26 time: 0.542494 Jul 19 20:14:49.063952 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2526/5159] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:48 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:14:50.087356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:14:50.088700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] [instance: ae3b1477-2f27-49f8-b09b-35ceecca8714] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:14:50.109964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:50.111954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:50.113901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:14:50.115281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:14:50.155170 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] HTTP exception thrown: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Request method failure captured: Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 HTTP/1.1 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xCYg8KaLruP2PxJ_QUz7gMJqIzLli0Q1n5tPvv_YlFhzTgV7fKy5UrGtTNJPq5C4lRWILcxbz7c_E2z4wM70tabZr7zWAj_Q6zfOEP5p5X1pXV8AVA1OzC13Ac9PKitZFRVr8s4Zo8YC1bN5vRQMzQpgBZlQILTRhWUrkBUSe_4Xwg Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Openstack-Nova-Api-Version: 2.26 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2c8b5261815d4f3e839aa785b2abada9 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerTagsTestJSON-1237076987 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c8b5261815d4f3e839aa785b2abada9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c8b5261815d4f3e839aa785b2abada9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c8b5261815d4f3e839aa785b2abada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c8b5261815d4f3e839aa785b2abada9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerTagsTestJSON-1237076987 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2c8b5261815d4f3e839aa785b2abada9 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerTagsTestJSON-1237076987 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerTagsTestJSON-1237076987-project Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 86b0d71357f24c1e95a88d4a2f13a217 Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerTagsTestJSON-1237076987-project Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ae3b1477-2f27-49f8-b09b-35ceecca8714'} Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:14:50.161494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. Jul 19 20:14:50.167250 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:14:50.168953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] Returning 404 to user: Instance ae3b1477-2f27-49f8-b09b-35ceecca8714 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:14:50.170031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b8811ac-7d52-4578-a252-b652ed0c4288 tempest-ServerTagsTestJSON-1237076987 tempest-ServerTagsTestJSON-1237076987-project] 10.222.0.23 "GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714" status: 404 len: 111 microversion: 2.26 time: 0.089744 Jul 19 20:14:50.177050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2634/5160] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 19 20:14:50 2022] GET /compute/v2.1/servers/ae3b1477-2f27-49f8-b09b-35ceecca8714 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:14:52.093159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-248e59ad-5bdf-4a4d-af1b-bc837acc2e4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: .version_select at 0x7f23ef43a940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1309579391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrbR9pBMwEyBzOJrLvn7TSKrDmrq5vLSnkn+L1EUpRjUEtpf+2UmlmprpOfJCo8l26xDw2oxaD81+ETDLs5WAMWpZBMlD7QMBV7RzR1l88tAXTdnYcOwFCaaRW7SrEe0g=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:52.100465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=60 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:14:52.137856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-248e59ad-5bdf-4a4d-af1b-bc837acc2e4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:14:52.155027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-248e59ad-5bdf-4a4d-af1b-bc837acc2e4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:14:52.211896 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-248e59ad-5bdf-4a4d-af1b-bc837acc2e4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.123586 Jul 19 20:14:52.212578 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2527/5161] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:14:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:14:58.454822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1893404993", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "1e9a1e8c-ca24-4c5e-bac7-3e26b57db3e9"}], "key_name": "tempest-TestNetworkBasicOps-1309579391", "security_groups": [{"name": "tempest-secgroup-smoke-2113933066"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:14:59.379685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] validate_networks() for [('1e9a1e8c-ca24-4c5e-bac7-3e26b57db3e9', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:15:00.152620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:00.695329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:15:00.696029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:15:00.696715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:15:00.697080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:15:00.697823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:15:00.727972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:00.728548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:00.729472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:00.729949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:00.794325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:15:00.821518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:15:00.890549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:15:00.895780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:15:01.011551 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-865f37c4-bf6d-4b0e-836d-40afef08dc0e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.563239 Jul 19 20:15:01.013573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2635/5162] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:14:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:15:01.023608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9693a64-c354-4387-919f-98bd858b175a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:01.024234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9693a64-c354-4387-919f-98bd858b175a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:01.034169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=57,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:01.250403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9693a64-c354-4387-919f-98bd858b175a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:01.265055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9693a64-c354-4387-919f-98bd858b175a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1249 microversion: 2.1 time: 0.245473 Jul 19 20:15:01.268915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2528/5163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:01 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1249 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:02.284018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:02.285300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:02.307158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:02.308084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:02.309396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:02.309846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:02.547741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:02.565797 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f9c675d7-95d8-4fb9-af86-a066e4669450 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1245 microversion: 2.1 time: 0.286111 Jul 19 20:15:02.571954 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2636/5164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:02 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1245 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:03.591508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:03.592236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:03.621339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:03.621804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:03.622658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:03.623184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:03.830307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:03.841614 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27921cfe-0066-4897-be97-af40322ac672 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1307 microversion: 2.1 time: 0.254192 Jul 19 20:15:03.851157 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2529/5165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:03 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:04.864446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:04.865009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:04.882931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:04.883331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:04.884366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:04.884986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:05.222780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:05.243886 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-966a98a2-a7a0-482e-9988-28487766c588 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1307 microversion: 2.1 time: 0.383541 Jul 19 20:15:05.259829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2637/5166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:04 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:06.269708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:06.271099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:06.302325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:06.302325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:06.302760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:06.302901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:06.582555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:06.593537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30614ba4-6220-4a38-8c19-9e84431d4099 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1307 microversion: 2.1 time: 0.327997 Jul 19 20:15:06.598771 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2530/5167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:06 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:07.649378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:07.653798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:07.724610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:07.733259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:07.738171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:07.747451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:08.456273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:08.495799 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df4a3667-509d-43a7-86dd-5f43dce794d9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 0.867409 Jul 19 20:15:08.509272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2638/5168] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:07 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:09.516898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:09.517489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:09.565246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:09.565968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:09.566828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:09.567329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:10.873519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:10.884832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0a2acdf-9c2f-4ddd-a0de-c325cf6a4ac5 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 1.372306 Jul 19 20:15:10.885447 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2531/5169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:09 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:11.298111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b8c9bc17-7311-48e6-9630-c34975a5f7a2 req-5174bbd1-2d5b-4244-9a78-71bc9c29b945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc983637-de5a-4459-b7e2-f6dd3f3d4447", "tag": "cb55af91-1965-4dac-bc75-253611e02e02"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:11.321731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:11.322953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:11.342221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8c9bc17-7311-48e6-9630-c34975a5f7a2 req-5174bbd1-2d5b-4244-9a78-71bc9c29b945 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:11.348371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8c9bc17-7311-48e6-9630-c34975a5f7a2 req-5174bbd1-2d5b-4244-9a78-71bc9c29b945 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:11.384721 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b8c9bc17-7311-48e6-9630-c34975a5f7a2 req-5174bbd1-2d5b-4244-9a78-71bc9c29b945 service nova] Creating event network-changed:cb55af91-1965-4dac-bc75-253611e02e02 for instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 on n-h2-843834-3 Jul 19 20:15:11.411010 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b8c9bc17-7311-48e6-9630-c34975a5f7a2 req-5174bbd1-2d5b-4244-9a78-71bc9c29b945 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118439 Jul 19 20:15:11.415077 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2639/5170] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:11.903992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:11.905288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:11.908620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:11.945755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:11.946967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:11.958533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:11.959441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:13.144949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:13.164293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4861f3a-544c-47f0-994e-07beaa30d5c3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 1.265903 Jul 19 20:15:13.174440 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2532/5171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:11 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:14.182425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:14.183280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:14.192509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:14.193204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:14.208740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:14.209609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:14.781831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:14.798666 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd00f62c-589e-4936-a541-4b0bc21f2e7e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 0.620518 Jul 19 20:15:14.808340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2640/5172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:14 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:15.839790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:15.841512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:15.917807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.935143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:15.938035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:15.941365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:16.516799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:16.536611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e09cf91-b1d9-4570-964c-5ee2368bdb62 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 0.708750 Jul 19 20:15:16.548824 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2533/5173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:15 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:17.555152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:17.556439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:17.581760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:17.584299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:17.597408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:17.598053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:18.246838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:18.277380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57294e5c-44f8-48dc-ac5f-47ff135015a6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 0.723751 Jul 19 20:15:18.278544 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2641/5174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:17 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:18.814297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-78bcbda8-e3c1-4537-a8e2-6d9a4e4d17d3 req-c8dfe808-a657-4598-9850-07ffdff870c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc983637-de5a-4459-b7e2-f6dd3f3d4447", "name": "network-vif-plugged", "status": "completed", "tag": "cb55af91-1965-4dac-bc75-253611e02e02"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:18.864539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-78bcbda8-e3c1-4537-a8e2-6d9a4e4d17d3 req-c8dfe808-a657-4598-9850-07ffdff870c9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:18.868095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-78bcbda8-e3c1-4537-a8e2-6d9a4e4d17d3 req-c8dfe808-a657-4598-9850-07ffdff870c9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:18.909594 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-78bcbda8-e3c1-4537-a8e2-6d9a4e4d17d3 req-c8dfe808-a657-4598-9850-07ffdff870c9 service nova] Creating event network-vif-plugged:cb55af91-1965-4dac-bc75-253611e02e02 for instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 on n-h2-843834-3 Jul 19 20:15:18.916073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-78bcbda8-e3c1-4537-a8e2-6d9a4e4d17d3 req-c8dfe808-a657-4598-9850-07ffdff870c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106331 Jul 19 20:15:18.917590 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2534/5175] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:19.295073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:19.296322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:19.315041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:19.317937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:19.325397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:19.326767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:19.327657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:20.057822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:20.070175 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a38a11d8-5cb9-4efa-8489-a4fb145d2547 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1375 microversion: 2.1 time: 0.776795 Jul 19 20:15:20.071157 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2642/5176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:19 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1375 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:21.090311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:21.091868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:21.106070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:21.118649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:21.125127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:21.126858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:22.697827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:22.710288 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fa70b72-4ca5-4b51-b0ac-b263871acffb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1547 microversion: 2.1 time: 1.625384 Jul 19 20:15:22.715163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2535/5177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:21 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1547 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:22.728491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:22.729717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:22.741840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.746691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:22.752297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:22.752795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:23.173835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:23.182633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9308a46b-ae4f-4f74-8480-386e2ffe339d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1547 microversion: 2.1 time: 0.459378 Jul 19 20:15:23.184433 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2643/5178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:22 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1547 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:31.105800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:31.215631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-905a6204-d850-4afa-85c3-85d290482261 req-efe60997-e476-426d-ae8e-bd3119407527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc983637-de5a-4459-b7e2-f6dd3f3d4447", "tag": "cb55af91-1965-4dac-bc75-253611e02e02"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:31.293930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-905a6204-d850-4afa-85c3-85d290482261 req-efe60997-e476-426d-ae8e-bd3119407527 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:31.295764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-905a6204-d850-4afa-85c3-85d290482261 req-efe60997-e476-426d-ae8e-bd3119407527 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:31.332083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=39 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:31.340523 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-905a6204-d850-4afa-85c3-85d290482261 req-efe60997-e476-426d-ae8e-bd3119407527 service nova] Creating event network-changed:cb55af91-1965-4dac-bc75-253611e02e02 for instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 on n-h2-843834-3 Jul 19 20:15:31.355111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-905a6204-d850-4afa-85c3-85d290482261 req-efe60997-e476-426d-ae8e-bd3119407527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466430 Jul 19 20:15:31.359073 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2536/5179] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:38.641844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:38.643673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=46 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:38.812242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1396751030", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "09436614-7d6a-4c86-b568-377cdcacfe03"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:38.885741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] validate_networks() for [('09436614-7d6a-4c86-b568-377cdcacfe03', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:15:40.458705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:15:40.459434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:15:40.459681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:15:40.460333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:15:40.460961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:15:40.512529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:40.513268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:40.514669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:40.515497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:40.570612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Getting quotas for project 6a67c0231ee04ff8bd58306f9b6f2011. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:15:40.597004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Getting quotas for user 3942396b03ea4e16a590b0e50db52c4e and project 6a67c0231ee04ff8bd58306f9b6f2011. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:15:40.621713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:15:40.625097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:15:40.720147 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ee781b1-7427-42db-a687-531799dc76ec tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.083984 Jul 19 20:15:40.721933 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2644/5180] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:15:40.734134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73f72653-97aa-455c-9b59-56421e479f5d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:40.734997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-73f72653-97aa-455c-9b59-56421e479f5d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:40.949329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73f72653-97aa-455c-9b59-56421e479f5d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:40.969014 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73f72653-97aa-455c-9b59-56421e479f5d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1228 microversion: 2.1 time: 0.238759 Jul 19 20:15:40.969472 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2537/5181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:40 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1228 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:41.993994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:41.994651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:42.032236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:42.032706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:42.033529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:42.050126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:42.390794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:42.399323 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2e843143-2dd0-4049-80fb-35725e4869b9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1224 microversion: 2.1 time: 0.414151 Jul 19 20:15:42.423317 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2645/5182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:41 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1224 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:43.419542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:43.420208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:43.422619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:43.448939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:43.451247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:43.454445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:43.455127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:43.685801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:43.702209 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7fa32565-debd-4836-a1bf-e513f4ae0ef9 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1286 microversion: 2.1 time: 0.281493 Jul 19 20:15:43.702797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2538/5183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:43 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:15:44.727202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:44.727920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:44.735895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:44.746824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:44.749338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:44.750385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:45.198780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:45.216591 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd420085-4160-4422-a250-e72704121880 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1286 microversion: 2.1 time: 0.493577 Jul 19 20:15:45.220232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2646/5184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:44 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1286 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:46.240028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:46.241474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:46.257317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:46.258062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:46.259077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:46.267179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:46.541510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:46.542633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:46.557689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:46.558163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:46.559055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:46.559508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:46.670274 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3c8fe4c6-9464-4645-9ac5-323b5d6822ee tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447/action" status: 200 len: 24571 microversion: 2.1 time: 0.133444 Jul 19 20:15:46.670988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2647/5185] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:15:46 2022] POST /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447/action => generated 24571 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:15:46.843704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:46.861820 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af7d7005-f71a-4a10-ad32-48f96fc7533f tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.622724 Jul 19 20:15:46.872469 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2539/5186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:46 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:47.883565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:47.884544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:47.900979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:47.905454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:47.906852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:47.907588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:48.338645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:48.365334 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb0e26b4-e7e0-4e0e-8143-94072cc7eb56 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.486691 Jul 19 20:15:48.367234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2648/5187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:47 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:48.923133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6ce2c717-5c71-4318-9a82-fb616ce394da req-f3d2a284-2f40-4a89-8c7d-9c8252a65ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4decf7-fb55-436c-b44a-14c5a3c8a629", "tag": "f823cd2d-e907-49e2-a807-2fdd39711f69"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:48.956145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6ce2c717-5c71-4318-9a82-fb616ce394da req-f3d2a284-2f40-4a89-8c7d-9c8252a65ed3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:48.956609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6ce2c717-5c71-4318-9a82-fb616ce394da req-f3d2a284-2f40-4a89-8c7d-9c8252a65ed3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:48.987584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6ce2c717-5c71-4318-9a82-fb616ce394da req-f3d2a284-2f40-4a89-8c7d-9c8252a65ed3 service nova] Creating event network-changed:f823cd2d-e907-49e2-a807-2fdd39711f69 for instance df4decf7-fb55-436c-b44a-14c5a3c8a629 on n-h1-843834-3 Jul 19 20:15:49.004882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6ce2c717-5c71-4318-9a82-fb616ce394da req-f3d2a284-2f40-4a89-8c7d-9c8252a65ed3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085520 Jul 19 20:15:49.005844 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2540/5188] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:49.382800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:49.384172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:49.392554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:49.393284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:49.394291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:49.394928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:49.705214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:49.715989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d94cfdc2-a2aa-4bb2-9cf6-1f4f7dac02dc tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.337128 Jul 19 20:15:49.716999 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2649/5189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:49 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:50.754958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:50.757099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:50.768094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:50.769356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:50.770423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:50.771143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:50.957979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:51.148561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:51.173642 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83f224e9-8b44-4010-9b17-59dfaf2c4fdf tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.439229 Jul 19 20:15:51.175698 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2541/5190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:50 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:52.194020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:52.195255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:52.202998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:52.204474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:15:52.206961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:52.207730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:52.209131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:52.209961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:52.516339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:52.531406 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee58a9fe-6f70-49ea-b819-4d54e87fc633 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.340489 Jul 19 20:15:52.541963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2650/5191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:52 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:53.550119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:53.559816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:53.569412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:53.570359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:53.572299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:53.575355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:53.858677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:53.868006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-03ac1ed4-ca21-4fa5-bd81-d40d374c385d tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.322978 Jul 19 20:15:53.869278 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2542/5192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:53 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:54.886217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:54.887134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:54.901895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:54.909970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:54.915172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:54.916267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:55.375737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:55.394764 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-22d1d6ea-ccf4-4ce4-a898-55cc3aba7fea tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.512362 Jul 19 20:15:55.409365 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2651/5193] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:54 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:56.026561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8924021d-b489-4373-a847-71243aad0381 req-db14cc88-e2cf-4f23-aa9c-c79aa9d59c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4decf7-fb55-436c-b44a-14c5a3c8a629", "name": "network-vif-plugged", "status": "completed", "tag": "f823cd2d-e907-49e2-a807-2fdd39711f69"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:15:56.054817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8924021d-b489-4373-a847-71243aad0381 req-db14cc88-e2cf-4f23-aa9c-c79aa9d59c43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:56.055247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8924021d-b489-4373-a847-71243aad0381 req-db14cc88-e2cf-4f23-aa9c-c79aa9d59c43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.143616 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8924021d-b489-4373-a847-71243aad0381 req-db14cc88-e2cf-4f23-aa9c-c79aa9d59c43 service nova] Creating event network-vif-plugged:f823cd2d-e907-49e2-a807-2fdd39711f69 for instance df4decf7-fb55-436c-b44a-14c5a3c8a629 on n-h1-843834-3 Jul 19 20:15:56.159296 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8924021d-b489-4373-a847-71243aad0381 req-db14cc88-e2cf-4f23-aa9c-c79aa9d59c43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297375 Jul 19 20:15:56.162793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2543/5194] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:15:56.420837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:56.423365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:56.448459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:56.452891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.456624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:56.460144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:56.730664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:56.746558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e06b59f9-d17f-485c-85aa-6630e55c6d85 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1328 microversion: 2.1 time: 0.333993 Jul 19 20:15:56.760191 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2652/5195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:56 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:57.768204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:57.769931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:57.810822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.812571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:57.815996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:57.816863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:58.730138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:15:58.763048 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-722eca1f-1155-4b3f-90c2-9169b314e32a tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1528 microversion: 2.1 time: 1.000809 Jul 19 20:15:58.763677 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2544/5196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:57 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1528 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:15:58.813183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:15:58.814343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:15:58.839121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:58.839868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:15:58.841173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:15:58.857480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:00.179918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:00.190648 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f01118a-fb92-4403-894c-496cd488360b tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1528 microversion: 2.1 time: 1.389220 Jul 19 20:16:00.192897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2653/5197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:15:58 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1528 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:00.431185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:00.433410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:00.450279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:00.452255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:00.453493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:00.454703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:00.476762 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] HTTP exception thrown: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Request method failure captured: Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 HTTP/1.1 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xDqN29et5aHTBUttA8QCaA3AlyMBQlMjOpK00HnnyPSsfomTCleNB78OwknZLTs-fsE7xBHGI3LpTZ2UulCTH6VuWNz__bunZERCYAJzJSgLm4cIZGSjkI7meHB88SGOlHCcEdIGn29YEzn4mtHvoj9wGPkAWQWHOdMpElBtl6oqjs Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f484b4707b2c4f2fbce8b2590bf5fac7 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f484b4707b2c4f2fbce8b2590bf5fac7 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1529737112-project Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4fb115ee6ce24d8c8d2bfb328ba61cb1 Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112-project Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'df4decf7-fb55-436c-b44a-14c5a3c8a629'} Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:00.478783 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:00.483946 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:00.487095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Returning 404 to user: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:00.498321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7d952ec-a897-490e-9828-af642cae53f5 tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 404 len: 111 microversion: 2.1 time: 0.288435 Jul 19 20:16:00.498948 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2545/5198] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:16:00 2022] DELETE /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:00.509022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:00.510027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:00.522712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:00.523229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:00.524042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:00.524525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.450944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:01.464725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7594d75b-88fb-4809-bb8d-00001f3fa445 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1528 microversion: 2.1 time: 0.959985 Jul 19 20:16:01.471257 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2654/5199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:00 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1528 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:01.489949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Action: 'update', calling method: >, body: {"server": {"name": "df4decf7-fb55-436c-b44a-14c5a3c8a629_new"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:01.491323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:01.503167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=23 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:01.514406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.514902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.516047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.516493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.545735 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] HTTP exception thrown: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Request method failure captured: Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: request: PUT /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 HTTP/1.1 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 64 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xDqN29et5aHTBUttA8QCaA3AlyMBQlMjOpK00HnnyPSsfomTCleNB78OwknZLTs-fsE7xBHGI3LpTZ2UulCTH6VuWNz__bunZERCYAJzJSgLm4cIZGSjkI7meHB88SGOlHCcEdIGn29YEzn4mtHvoj9wGPkAWQWHOdMpElBtl6oqjs Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f484b4707b2c4f2fbce8b2590bf5fac7 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f484b4707b2c4f2fbce8b2590bf5fac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f484b4707b2c4f2fbce8b2590bf5fac7 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1529737112-project Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4fb115ee6ce24d8c8d2bfb328ba61cb1 Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1529737112-project Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: {"server": {"name": "df4decf7-fb55-436c-b44a-14c5a3c8a629_new"}} Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'df4decf7-fb55-436c-b44a-14c5a3c8a629', 'body': {'server': {'name': 'df4decf7-fb55-436c-b44a-14c5a3c8a629_new'}}} Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 20:16:01.557463 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:16:01.563380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] Returning 404 to user: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:01.566167 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6d65293-6c37-4f68-8479-6ead253c42fa tempest-ServersNegativeTestMultiTenantJSON-1529737112 tempest-ServersNegativeTestMultiTenantJSON-1529737112-project] 10.222.0.23 "PUT /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 404 len: 111 microversion: 2.1 time: 0.077320 Jul 19 20:16:01.566167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2546/5200] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:16:01 2022] PUT /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:16:01.577240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:01.577876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:01.587941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.590592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.591593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.594112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.681640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:16:01.882041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a41de957-cb16-479d-aca2-abc6a4fdff03 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 204 len: 0 microversion: 2.1 time: 0.310322 Jul 19 20:16:01.883478 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2655/5201] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:16:01 2022] DELETE /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:16:01.892910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:01.893679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:01.907550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.909260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:01.910194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:01.911678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:03.358780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:03.375000 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d5917eed-a79c-4e52-81d2-8d5159a8d421 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1534 microversion: 2.1 time: 1.487034 Jul 19 20:16:03.388465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2547/5202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:01 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1534 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:04.219617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-413289ec-bb79-4626-8e62-444d17c90098 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: .version_select at 0x7f23ee278a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1802686451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoWRHa2SJibG95fLXgP6pz8uvmqkQ0zsagCuth1+FzwIchVDZtMYpdXZCPlsu4WjD/eJIKTlxXsm/Skw51ypqS4ZuXRTXoUdjB7jF0pn7ExpYaI8h9Ns+wPDDmekJ7+7w=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:04.262575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-413289ec-bb79-4626-8e62-444d17c90098 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:04.288444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-413289ec-bb79-4626-8e62-444d17c90098 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:04.370161 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-413289ec-bb79-4626-8e62-444d17c90098 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.154594 Jul 19 20:16:04.372565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2656/5203] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:16:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:04.397242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:04.397946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:04.436444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:04.437388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:04.451051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:04.463028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:06.263011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:06.272374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-37d9e81c-c249-4ed4-9137-47526d515e91 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1534 microversion: 2.1 time: 1.879007 Jul 19 20:16:06.273061 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2548/5204] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:04 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1534 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:07.289602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:07.299897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:07.316770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:07.317211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:07.318018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:07.318463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:07.665158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1c9d7e09-137f-4f3e-9daf-55992f14c226 req-5ab9b413-1b35-47be-885f-d38a6e86466e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4decf7-fb55-436c-b44a-14c5a3c8a629", "name": "network-vif-deleted", "tag": "f823cd2d-e907-49e2-a807-2fdd39711f69"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:07.703236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1c9d7e09-137f-4f3e-9daf-55992f14c226 req-5ab9b413-1b35-47be-885f-d38a6e86466e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:07.705436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1c9d7e09-137f-4f3e-9daf-55992f14c226 req-5ab9b413-1b35-47be-885f-d38a6e86466e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:07.744574 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1c9d7e09-137f-4f3e-9daf-55992f14c226 req-5ab9b413-1b35-47be-885f-d38a6e86466e service nova] Creating event network-vif-deleted:f823cd2d-e907-49e2-a807-2fdd39711f69 for instance df4decf7-fb55-436c-b44a-14c5a3c8a629 on n-h1-843834-3 Jul 19 20:16:07.765221 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1c9d7e09-137f-4f3e-9daf-55992f14c226 req-5ab9b413-1b35-47be-885f-d38a6e86466e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106377 Jul 19 20:16:07.769505 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2549/5205] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:08.456903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1699038010", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "d44488e0-df49-4c70-8e26-33f13d2ef8e3"}], "key_name": "tempest-TestNetworkBasicOps-1802686451", "security_groups": [{"name": "tempest-secgroup-smoke-759116721"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:08.480671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3942396b03ea4e16a590b0e50db52c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a67c0231ee04ff8bd58306f9b6f2011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:08.496005 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4857af3-9f77-43d3-b9e2-7820bb300770 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 200 len: 1492 microversion: 2.1 time: 1.209967 Jul 19 20:16:08.505979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2657/5206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:07 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 1492 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:09.116563 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] validate_networks() for [('d44488e0-df49-4c70-8e26-33f13d2ef8e3', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:16:09.513045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:09.514312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] [instance: df4decf7-fb55-436c-b44a-14c5a3c8a629] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:09.525957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:09.528568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:09.539889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:09.541041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:09.545454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:09.549550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:09.640836 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] HTTP exception thrown: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Request method failure captured: Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 HTTP/1.1 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xDWf_zxT95xCoUBFOSjgxcxt9moR8esx7n3lfmnfBwe8AquYCK8m6sdgx1iCkaq3Nlr82i_zWcq5ak_NiUMnqaRPwH_lWNnWxF-mZatyNBVIeCjdMPs9NJpv6vgSwQ6tPKctSsBHKj9So-Pa_Ae_Q-6Ou7eQEHpjqCRE6ZHr3gXBqc Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 6a67c0231ee04ff8bd58306f9b6f2011 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1233135379 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6a67c0231ee04ff8bd58306f9b6f2011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6a67c0231ee04ff8bd58306f9b6f2011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6a67c0231ee04ff8bd58306f9b6f2011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6a67c0231ee04ff8bd58306f9b6f2011"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1233135379 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 6a67c0231ee04ff8bd58306f9b6f2011 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1233135379 Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1233135379-project Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 3942396b03ea4e16a590b0e50db52c4e Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1233135379-project Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'df4decf7-fb55-436c-b44a-14c5a3c8a629'} Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:09.646373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. Jul 19 20:16:09.651401 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:16:09.655321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] Returning 404 to user: Instance df4decf7-fb55-436c-b44a-14c5a3c8a629 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:16:09.672028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64001c4f-50ee-43b1-ab5a-452f217193d6 tempest-ServersNegativeTestMultiTenantJSON-1233135379 tempest-ServersNegativeTestMultiTenantJSON-1233135379-project] 10.222.0.23 "GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629" status: 404 len: 111 microversion: 2.1 time: 0.162832 Jul 19 20:16:09.675457 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2658/5207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:09 2022] GET /compute/v2.1/servers/df4decf7-fb55-436c-b44a-14c5a3c8a629 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:16:11.976857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:16:11.983112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:16:11.983969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:16:11.984631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:16:11.985248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:16:11.997703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:11.998522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:12.000327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:12.001048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:12.028223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:12.035259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:12.052495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:16:12.056238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:16:12.138841 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22935f61-8c40-4206-bac4-80b48eb1aa00 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.712115 Jul 19 20:16:12.141756 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2550/5208] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 3716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:16:12.153869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b16ccde8-5d2d-4aa6-a9f1-e652de88fbf6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:12.154470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b16ccde8-5d2d-4aa6-a9f1-e652de88fbf6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:12.655101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b16ccde8-5d2d-4aa6-a9f1-e652de88fbf6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:12.673851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b16ccde8-5d2d-4aa6-a9f1-e652de88fbf6 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1249 microversion: 2.1 time: 0.523377 Jul 19 20:16:12.677132 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2659/5209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:12 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1249 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:13.696979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:13.697711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:13.732984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:13.738020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:13.740480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:13.742379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:13.839690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=55 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:13.966316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:13.982821 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ce0f9f9-251b-4599-89d6-08afcdf26f42 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1245 microversion: 2.1 time: 0.292694 Jul 19 20:16:13.984340 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2551/5210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:13 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1245 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:15.007828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:15.009872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:15.081560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.082073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.087980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:15.088535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:15.790355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:15.815453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f098096-9eb2-4bd0-afd0-e52008b623e3 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1307 microversion: 2.1 time: 0.808158 Jul 19 20:16:15.818817 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2660/5211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:14 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1307 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:16.844100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:16.845022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:16.870633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:16.871463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:16.874935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:16.875767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:17.270562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:17.283608 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0763ade3-5907-4378-8914-1cccfccdd21c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1307 microversion: 2.1 time: 0.446444 Jul 19 20:16:17.288144 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2552/5212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:16 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:18.320206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:18.321150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:18.338835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:18.339488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:18.340461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:18.342999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:19.816050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:19.838528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9aa709b-9c82-4445-bce8-7ee34093e3a0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 1.525094 Jul 19 20:16:19.839458 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2661/5213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:18 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:20.874000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:20.876516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:20.891684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:20.930544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:20.932250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:20.933052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:21.578600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:21.648750 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-662f2ce1-eb6a-41e0-9474-03d4117b5f4b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 0.791233 Jul 19 20:16:21.672319 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2553/5214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:20 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:21.988959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2d8d4bdd-c2bd-4b65-9862-534417d22631 req-b408369a-e1a8-4c7a-8914-2de392eb91dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293518e3-3ee2-4c64-bf92-1a62b91f56a4", "tag": "30223ee6-3904-4b87-8667-0cbf48a9d071"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:22.027060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2d8d4bdd-c2bd-4b65-9862-534417d22631 req-b408369a-e1a8-4c7a-8914-2de392eb91dc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.036427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2d8d4bdd-c2bd-4b65-9862-534417d22631 req-b408369a-e1a8-4c7a-8914-2de392eb91dc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.066698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2d8d4bdd-c2bd-4b65-9862-534417d22631 req-b408369a-e1a8-4c7a-8914-2de392eb91dc service nova] Creating event network-changed:30223ee6-3904-4b87-8667-0cbf48a9d071 for instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 on n-h1-843834-3 Jul 19 20:16:22.080356 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2d8d4bdd-c2bd-4b65-9862-534417d22631 req-b408369a-e1a8-4c7a-8914-2de392eb91dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096617 Jul 19 20:16:22.084182 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2662/5215] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:22.666903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:22.667622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:22.670969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:22.674471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:22.692731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.693309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:22.702410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:22.703078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:23.081786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:23.104854 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e4fb7188-98cd-4e98-8ad8-0474c4d1e02a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 0.442215 Jul 19 20:16:23.138356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2554/5216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:22 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:24.124810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:24.125462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:24.128889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:24.166775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:24.172118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:24.177137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:24.179777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:25.256044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:25.279254 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e1f90eb5-5a11-4666-88c7-3f7ba6127d81 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 1.157359 Jul 19 20:16:25.283104 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2663/5217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:24 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:26.300372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:26.301777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:26.316108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.317848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:26.320529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:26.322204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:27.037727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:27.048020 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5518777a-613d-4929-a5ec-6ae955b79b9f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 0.753843 Jul 19 20:16:27.050991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2555/5218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:26 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:27.793196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4d4b2028-8124-4c3d-ad84-b572b01740c5 req-515999a4-b86d-4b96-9a1e-35ac05914631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293518e3-3ee2-4c64-bf92-1a62b91f56a4", "name": "network-vif-plugged", "status": "completed", "tag": "30223ee6-3904-4b87-8667-0cbf48a9d071"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:27.821901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4d4b2028-8124-4c3d-ad84-b572b01740c5 req-515999a4-b86d-4b96-9a1e-35ac05914631 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:27.824585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4d4b2028-8124-4c3d-ad84-b572b01740c5 req-515999a4-b86d-4b96-9a1e-35ac05914631 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:27.868705 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4d4b2028-8124-4c3d-ad84-b572b01740c5 req-515999a4-b86d-4b96-9a1e-35ac05914631 service nova] Creating event network-vif-plugged:30223ee6-3904-4b87-8667-0cbf48a9d071 for instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 on n-h1-843834-3 Jul 19 20:16:27.885242 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4d4b2028-8124-4c3d-ad84-b572b01740c5 req-515999a4-b86d-4b96-9a1e-35ac05914631 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096262 Jul 19 20:16:27.887731 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2664/5219] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:28.086640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:28.087869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:28.105771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:28.112080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:28.125436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:28.136573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:28.575303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:28.585029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-50f503f6-c577-4ab4-b4f6-13847e371da9 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1374 microversion: 2.1 time: 0.515568 Jul 19 20:16:28.598310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2556/5220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:28 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1374 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:29.539687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Calling method '.version_select at 0x7f23ee1b0430>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:29.541158 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:16:29.541158 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:16:29.546539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.547192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.590428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.591039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.603884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:29.605898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:29.617490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.617953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.618756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.619226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.625679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.627041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.641598 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7bac9813-4410-4852-b45b-bf5b12d693fa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1104100398-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.455382 Jul 19 20:16:29.653374 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2665/5221] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 20:16:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:16:29.920089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:29.936220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2ff85f4-c727-4da2-afb5-18dbf0d342e2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1547 microversion: 2.1 time: 0.334310 Jul 19 20:16:29.939123 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2557/5222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:29 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1547 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:29.959593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:29.960805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:29.985491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.995989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:29.997412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:29.998622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:30.631124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:30.647790 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3a7364f-a19e-4e4b-8c95-838587b23cfc tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1547 microversion: 2.1 time: 0.695794 Jul 19 20:16:30.648398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2666/5223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:29 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1547 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:45.405734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:45.406512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=41 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:45.788806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8343c84c-33d1-43f3-8d20-1f4e70ed9764 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: .version_select at 0x7f23ef4ea430>, body: {"keypair": {"name": "tempest-keypair-716368233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1rxmAtsxQbCRXTKnrNBZuUa7tA9jUsVf0cdy2k0XMMgvVx00MskRi+7vuOlwKeT5y827ux8cMfIPfsJoDidMQYz5judsdgbtnQ0Oev+2K+MWbdwM9DILFbbvU7Opvq7Q=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:45.836470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8343c84c-33d1-43f3-8d20-1f4e70ed9764 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:45.852630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-8343c84c-33d1-43f3-8d20-1f4e70ed9764 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:45.922855 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8343c84c-33d1-43f3-8d20-1f4e70ed9764 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.525903 Jul 19 20:16:45.923534 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2558/5224] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:16:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:16:52.010951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1278673506", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d951e469-ec97-4bb2-a85a-d97852653bf0"}], "security_groups": [{"name": "tempest-securitygroup--1545477594"}], "key_name": "tempest-keypair-716368233", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:16:52.032826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=21 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:52.033590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=35 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:16:52.197745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] validate_networks() for [('d951e469-ec97-4bb2-a85a-d97852653bf0', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:16:53.399602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:16:53.401512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:16:53.402769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:16:53.403772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:16:53.404950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:16:53.427951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.428912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.430028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:53.430664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:53.457287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:16:53.465528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:16:53.503019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:16:53.519639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:16:53.705315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ea441b6-9307-45fe-8c71-c4c83c85ea97 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.697810 Jul 19 20:16:53.706062 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2667/5225] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:16:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:16:53.720259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6de2121-2648-452e-8545-491cf7d15a22 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:53.720881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6de2121-2648-452e-8545-491cf7d15a22 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:54.043845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6de2121-2648-452e-8545-491cf7d15a22 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:54.060187 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6de2121-2648-452e-8545-491cf7d15a22 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1241 microversion: 2.1 time: 0.345628 Jul 19 20:16:54.061513 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2559/5226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:53 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1241 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:16:55.101222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65043722-4a18-4946-a89b-506b3163d105 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:55.103411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65043722-4a18-4946-a89b-506b3163d105 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:55.311087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-65043722-4a18-4946-a89b-506b3163d105 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:55.326117 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65043722-4a18-4946-a89b-506b3163d105 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1241 microversion: 2.1 time: 0.235642 Jul 19 20:16:55.329627 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2668/5227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:55 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:56.357291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:56.360415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:56.385647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:56.387387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:56.390081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:56.390846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:56.792685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:56.801806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c65b56ae-f63c-4acb-956f-a8c58c55aa24 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1301 microversion: 2.1 time: 0.459122 Jul 19 20:16:56.803439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2560/5228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:56 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1301 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:57.834325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:57.837315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:57.851408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.852417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:57.853884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:57.854520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.132720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:58.162712 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d852e55c-1eea-4fd4-b6b4-be334aa30704 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1299 microversion: 2.1 time: 0.335657 Jul 19 20:16:58.163831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2669/5229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:57 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1299 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:16:58.886498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:58.889942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:58.913763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.917789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.924873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:58.925541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:58.973018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:16:59.185999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7cafb90-e3b2-4e0c-a39e-e475359adbba tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 204 len: 0 microversion: 2.1 time: 0.308290 Jul 19 20:16:59.194398 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2561/5230] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:16:58 2022] DELETE /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:16:59.196591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:59.197528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:59.201515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:16:59.203041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:16:59.212217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.213428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.216447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.217229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.227331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.228106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.229540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:16:59.230585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:16:59.902744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:16:59.921465 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3091b558-4adb-496d-bbf1-ca1d6adb4c59 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.730758 Jul 19 20:16:59.935017 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2670/5231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:59 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:00.036826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:00.050277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5ccf51e-b5b8-4d09-95c1-4186f762469d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1553 microversion: 2.1 time: 0.854004 Jul 19 20:17:00.060786 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2562/5232] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:16:59 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1553 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:00.946539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:00.948053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:00.974792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.977167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:00.981920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:00.983528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:01.068572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:01.069549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:01.086358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:01.086842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:01.087696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:01.088148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:02.594415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:02.639744 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c1a84e21-5676-4866-b37d-d6e4da988239 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 1.700464 Jul 19 20:17:02.641154 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2671/5233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:00 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:02.785361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:02.800283 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4b59cab-e473-4652-99d2-b713a36eb7c8 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1553 microversion: 2.1 time: 1.735379 Jul 19 20:17:02.800905 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2563/5234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:01 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1553 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:03.663585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:03.665149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:03.675601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:03.688745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.697313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.701624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.704915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.820961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:03.821791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:03.839571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.841048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:03.843232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:03.843812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.059852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:04.207195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:04.220626 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30f05c97-b5f2-41c7-b90c-fb9173955bf0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1486 microversion: 2.1 time: 0.403490 Jul 19 20:17:04.221479 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2564/5235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:03 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1486 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:04.243612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-89b04d82-a4f9-48f4-8616-9df3dd25382e req-6a07d3fb-6bb0-41b9-ad27-c9cca84647e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daba30af-3561-4993-850b-32e5155474ab", "tag": "1c641054-a414-4894-bc7c-2a02b9e0daad"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:04.258336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-89b04d82-a4f9-48f4-8616-9df3dd25382e req-6a07d3fb-6bb0-41b9-ad27-c9cca84647e9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:04.259312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-89b04d82-a4f9-48f4-8616-9df3dd25382e req-6a07d3fb-6bb0-41b9-ad27-c9cca84647e9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:04.278847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-89b04d82-a4f9-48f4-8616-9df3dd25382e req-6a07d3fb-6bb0-41b9-ad27-c9cca84647e9 service nova] Creating event network-changed:1c641054-a414-4894-bc7c-2a02b9e0daad for instance daba30af-3561-4993-850b-32e5155474ab on n-h1-843834-3 Jul 19 20:17:04.290058 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-89b04d82-a4f9-48f4-8616-9df3dd25382e req-6a07d3fb-6bb0-41b9-ad27-c9cca84647e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055855 Jul 19 20:17:04.292538 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2565/5236] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:04.485901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:04.502179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a07fc0e4-6c96-43e0-9c11-003af6da385b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.845692 Jul 19 20:17:04.511827 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2672/5237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:03 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:05.255613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:05.260049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:05.290302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.294611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.297858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.299497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.425248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.425913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.426592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lazy-loading 'fault' on Instance uuid 293518e3-3ee2-4c64-bf92-1a62b91f56a4 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:17:05.521675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:05.523526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:05.527165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:05.544076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.546763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.548462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:05.552058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:05.644415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:05.661693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e4d92bf1-e336-43ad-b3ea-9f66df1e0b2f tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 200 len: 1339 microversion: 2.1 time: 0.425417 Jul 19 20:17:05.662311 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2566/5238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:05 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:06.024081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:06.033908 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-60d368c5-c4e3-4d3f-a965-9e1801a9e583 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.516842 Jul 19 20:17:06.035345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2673/5239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:05 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:06.338354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ec6ccf6c-9149-4b7e-abc1-9651f6b47c43 req-11c73d00-506b-42fe-954b-8604c521ae2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293518e3-3ee2-4c64-bf92-1a62b91f56a4", "name": "network-vif-deleted", "tag": "30223ee6-3904-4b87-8667-0cbf48a9d071"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:06.370324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ec6ccf6c-9149-4b7e-abc1-9651f6b47c43 req-11c73d00-506b-42fe-954b-8604c521ae2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:06.370324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ec6ccf6c-9149-4b7e-abc1-9651f6b47c43 req-11c73d00-506b-42fe-954b-8604c521ae2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:06.410056 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ec6ccf6c-9149-4b7e-abc1-9651f6b47c43 req-11c73d00-506b-42fe-954b-8604c521ae2d service nova] Creating event network-vif-deleted:30223ee6-3904-4b87-8667-0cbf48a9d071 for instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 on n-h1-843834-3 Jul 19 20:17:06.417651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ec6ccf6c-9149-4b7e-abc1-9651f6b47c43 req-11c73d00-506b-42fe-954b-8604c521ae2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088995 Jul 19 20:17:06.423635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2567/5240] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:06.679959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:06.681257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: 293518e3-3ee2-4c64-bf92-1a62b91f56a4] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:06.697404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:06.698942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:06.700494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:06.701917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.053329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:07.054128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:07.072942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.073955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.075614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:07.080001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:07.111443 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] HTTP exception thrown: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Request method failure captured: Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 HTTP/1.1 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xColpKymrCjArW9TsoSHc6W-LsUCNJ3dCUH3nq_jdPqmqEVqyZBhAl4ZKKC2jMPZSQpC6mOBwTAdsMw_3Sa0TyG67u0RJh3mHcwQbqEVyw3UcQ_cDxPYh264qHLh1JDG47-GxrPQ42Evmtq_zBNj_E1kIYCrK-vhMZAL2ISKjBG1gg Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_886e14e167f7461fa15b89413e982f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: e0b392e28e7a4f98852d0362ef3ae3b3 Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '293518e3-3ee2-4c64-bf92-1a62b91f56a4'} Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:07.113635 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. Jul 19 20:17:07.118571 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:17:07.122198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Returning 404 to user: Instance 293518e3-3ee2-4c64-bf92-1a62b91f56a4 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:17:07.122643 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d87261da-c1ca-427c-8dfa-0303035b90ca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4" status: 404 len: 111 microversion: 2.1 time: 0.447778 Jul 19 20:17:07.127204 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2674/5241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:06 2022] GET /compute/v2.1/servers/293518e3-3ee2-4c64-bf92-1a62b91f56a4 => generated 111 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:17:07.527788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:07.541294 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-96edf8cf-9a36-45ae-b4cf-f207703b6c74 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.491314 Jul 19 20:17:07.555685 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2568/5242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:07 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:07.742577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6165b53-f377-4e87-80a9-1364d443a170 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '.version_select at 0x7f23ee140af0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:07.802807 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6165b53-f377-4e87-80a9-1364d443a170 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1802686451" status: 202 len: 0 microversion: 2.1 time: 0.064471 Jul 19 20:17:07.808318 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2675/5243] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 20:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1802686451 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:17:08.571999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:08.573302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:08.585270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:08.595643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:08.597473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:08.598187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:09.313073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:09.327037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-059caa85-db2f-4dd4-9132-5d02760a2e44 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.762825 Jul 19 20:17:09.328396 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2569/5244] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:08 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:10.289954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-eccc1c6f-6b9b-4772-9471-1a250690e416 req-d05e9883-ddcd-400c-bec1-02cd96b6697c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daba30af-3561-4993-850b-32e5155474ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c641054-a414-4894-bc7c-2a02b9e0daad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:10.348191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:10.348999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:10.350201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eccc1c6f-6b9b-4772-9471-1a250690e416 req-d05e9883-ddcd-400c-bec1-02cd96b6697c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:10.350656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eccc1c6f-6b9b-4772-9471-1a250690e416 req-d05e9883-ddcd-400c-bec1-02cd96b6697c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:10.383038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:10.384191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:10.388865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:10.394559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:10.404983 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-eccc1c6f-6b9b-4772-9471-1a250690e416 req-d05e9883-ddcd-400c-bec1-02cd96b6697c service nova] Creating event network-vif-plugged:1c641054-a414-4894-bc7c-2a02b9e0daad for instance daba30af-3561-4993-850b-32e5155474ab on n-h1-843834-3 Jul 19 20:17:10.442972 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-eccc1c6f-6b9b-4772-9471-1a250690e416 req-d05e9883-ddcd-400c-bec1-02cd96b6697c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153546 Jul 19 20:17:10.445109 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2676/5245] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:11.746231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:11.757607 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e0c3ca0-7184-4b80-9c47-05d037ae0337 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 1.416688 Jul 19 20:17:11.769222 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2570/5246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:10 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:12.783756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:12.784556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:12.794270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:12.794854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:12.796894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:12.797516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:13.016335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:13.025434 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-43e8771d-2155-41c9-985a-043c74a77584 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1367 microversion: 2.1 time: 0.250998 Jul 19 20:17:13.035721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2677/5247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:12 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:14.050452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:14.051098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:14.067131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.072040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.073410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.074202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.333030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:14.359029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d905c8d-bced-4111-af4d-bc818c8b6918 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1558 microversion: 2.1 time: 0.312652 Jul 19 20:17:14.359943 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2571/5248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:14 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1558 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:14.377018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:14.378177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:14.393859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.394612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.397895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.398865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.550977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:14.551857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:14.555442 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d86b82c0-6357-4235-8c20-6858ae8f531d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183155 Jul 19 20:17:14.556388 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2678/5249] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:17:14 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:14.566807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.581152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.582734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.583596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.651667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:17:14.849319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-401dd437-901c-4bcd-bd48-ca0e1a449e4e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 204 len: 0 microversion: 2.1 time: 0.301942 Jul 19 20:17:14.855330 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2572/5250] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:17:14 2022] DELETE /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:17:14.867026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:14.880186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:14.896302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d4686628-ff64-4be8-a114-1ce6055ebea0 req-3b573fd7-f5f0-47d9-b2a0-0efb32b89dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc983637-de5a-4459-b7e2-f6dd3f3d4447", "tag": "cb55af91-1965-4dac-bc75-253611e02e02"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:14.906405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.913858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.915914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.918210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4686628-ff64-4be8-a114-1ce6055ebea0 req-3b573fd7-f5f0-47d9-b2a0-0efb32b89dcd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:14.927906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.929168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4686628-ff64-4be8-a114-1ce6055ebea0 req-3b573fd7-f5f0-47d9-b2a0-0efb32b89dcd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:14.973271 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d4686628-ff64-4be8-a114-1ce6055ebea0 req-3b573fd7-f5f0-47d9-b2a0-0efb32b89dcd service nova] Creating event network-changed:cb55af91-1965-4dac-bc75-253611e02e02 for instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 on n-h2-843834-3 Jul 19 20:17:14.983244 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d4686628-ff64-4be8-a114-1ce6055ebea0 req-3b573fd7-f5f0-47d9-b2a0-0efb32b89dcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408036 Jul 19 20:17:14.991797 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2679/5251] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:17:15.578522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:15.590073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f767a200-442e-4277-8813-49d1ea14ea20 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1672 microversion: 2.1 time: 0.729340 Jul 19 20:17:15.593168 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2573/5252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:14 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1672 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:16.615234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:16.616559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:16.656808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:16.657500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:16.659237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:16.660141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:17.457675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:17.479696 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1bf59ffc-3a6a-4bee-94f2-7ff58d3026f7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1672 microversion: 2.1 time: 0.865666 Jul 19 20:17:17.482645 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2680/5253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:16 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1672 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:17.822037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ccf5707f-9c64-42ed-a86e-ba703c955086 req-e098415f-ddc2-44ef-8a15-e887a253775e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc983637-de5a-4459-b7e2-f6dd3f3d4447", "name": "network-vif-deleted", "tag": "cb55af91-1965-4dac-bc75-253611e02e02"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:17.830107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:17.857268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ccf5707f-9c64-42ed-a86e-ba703c955086 req-e098415f-ddc2-44ef-8a15-e887a253775e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:17.858284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ccf5707f-9c64-42ed-a86e-ba703c955086 req-e098415f-ddc2-44ef-8a15-e887a253775e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:17.869363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:17.882783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ccf5707f-9c64-42ed-a86e-ba703c955086 req-e098415f-ddc2-44ef-8a15-e887a253775e service nova] Creating event network-vif-deleted:cb55af91-1965-4dac-bc75-253611e02e02 for instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 on n-h2-843834-3 Jul 19 20:17:17.890679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ccf5707f-9c64-42ed-a86e-ba703c955086 req-e098415f-ddc2-44ef-8a15-e887a253775e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072927 Jul 19 20:17:17.892006 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2574/5254] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:18.514179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:18.514814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:18.545468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:18.558888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:18.559793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:18.560233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:18.590605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4dd2e62e-0290-435b-8927-3bd803d15302 req-bcd394d3-6a45-4b81-af8d-11306118e114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daba30af-3561-4993-850b-32e5155474ab", "tag": "1c641054-a414-4894-bc7c-2a02b9e0daad"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:18.653646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4dd2e62e-0290-435b-8927-3bd803d15302 req-bcd394d3-6a45-4b81-af8d-11306118e114 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:18.657995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4dd2e62e-0290-435b-8927-3bd803d15302 req-bcd394d3-6a45-4b81-af8d-11306118e114 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:18.709705 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4dd2e62e-0290-435b-8927-3bd803d15302 req-bcd394d3-6a45-4b81-af8d-11306118e114 service nova] Creating event network-changed:1c641054-a414-4894-bc7c-2a02b9e0daad for instance daba30af-3561-4993-850b-32e5155474ab on n-h1-843834-3 Jul 19 20:17:18.727728 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4dd2e62e-0290-435b-8927-3bd803d15302 req-bcd394d3-6a45-4b81-af8d-11306118e114 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141409 Jul 19 20:17:18.729953 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2575/5255] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:18.749506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:18.750419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:18.751086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lazy-loading 'fault' on Instance uuid fc983637-de5a-4459-b7e2-f6dd3f3d4447 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:17:18.829837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:18.842049 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3e05ecd6-e05c-4f68-8578-5a0c000668d7 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 200 len: 1490 microversion: 2.1 time: 0.344768 Jul 19 20:17:18.857587 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2681/5256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:18 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 1490 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:19.875553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:19.876954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: fc983637-de5a-4459-b7e2-f6dd3f3d4447] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:19.897615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:19.898386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:19.904147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:19.904855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:19.941841 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] HTTP exception thrown: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Request method failure captured: Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 HTTP/1.1 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xColpKymrCjArW9TsoSHc6W-LsUCNJ3dCUH3nq_jdPqmqEVqyZBhAl4ZKKC2jMPZSQpC6mOBwTAdsMw_3Sa0TyG67u0RJh3mHcwQbqEVyw3UcQ_cDxPYh264qHLh1JDG47-GxrPQ42Evmtq_zBNj_E1kIYCrK-vhMZAL2ISKjBG1gg Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_886e14e167f7461fa15b89413e982f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: e0b392e28e7a4f98852d0362ef3ae3b3 Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'fc983637-de5a-4459-b7e2-f6dd3f3d4447'} Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:17:19.953987 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Returning 404 to user: Instance fc983637-de5a-4459-b7e2-f6dd3f3d4447 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:17:19.959470 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a989c211-fb7a-4f5f-af08-06744390a4b0 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447" status: 404 len: 111 microversion: 2.1 time: 0.087866 Jul 19 20:17:19.960980 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2576/5257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:19 2022] GET /compute/v2.1/servers/fc983637-de5a-4459-b7e2-f6dd3f3d4447 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:17:20.949190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-086c56d2-0be5-4713-abcd-3ab1b9afa961 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '.version_select at 0x7f23ee2488b0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:20.981624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-086c56d2-0be5-4713-abcd-3ab1b9afa961 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1309579391" status: 202 len: 0 microversion: 2.1 time: 0.037594 Jul 19 20:17:20.983402 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2682/5258] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 20:17:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1309579391 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:17:42.825203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-75f489e3-6c6f-443b-8310-74b762e9217a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: .version_select at 0x7f23ef2cc700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1363193095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFpfOkXUo3DwEhFct5PY0+px+9JhEu5eSs4no6LqL/+5M7tBSfiqdqeERzW0t4mElfjCbQP9KlCoR4vJe7hrs2a0w4v89v0D6p/3Jr/tS13inj0p9HDF/YatLf4TtSfQ=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:42.849169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:42.849836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:42.903726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-75f489e3-6c6f-443b-8310-74b762e9217a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:17:42.941595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-75f489e3-6c6f-443b-8310-74b762e9217a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:17:43.001999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-75f489e3-6c6f-443b-8310-74b762e9217a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.187903 Jul 19 20:17:43.015164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2577/5259] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:17:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:46.209160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:46.209743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:46.247943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=62 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:46.248764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:46.272118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.278615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.282797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:46.283299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:46.441032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5fe40572-98f1-422c-9441-0ab922ae07ef tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/ips" status: 200 len: 151 microversion: 2.1 time: 0.225730 Jul 19 20:17:46.441032 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2683/5260] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:17:46 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/ips => generated 151 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:46.792585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1534575356", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "aabdf4c6-be3d-44cc-a61f-117b6c8b10c6"}], "key_name": "tempest-TestNetworkBasicOps-1363193095", "security_groups": [{"name": "tempest-secgroup-smoke-1179699850"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:47.053549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] validate_networks() for [('aabdf4c6-be3d-44cc-a61f-117b6c8b10c6', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:17:48.724055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:17:48.724696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:17:48.725079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:17:48.725499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:17:48.725918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:17:48.748963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:48.749456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:48.750328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:48.750779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:48.804143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:17:48.829928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Getting quotas for user e0b392e28e7a4f98852d0362ef3ae3b3 and project 886e14e167f7461fa15b89413e982f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:17:48.867951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:17:48.879474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:17:49.033070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e547654-0fc3-4db0-b66a-9690a0a2ac63 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.246542 Jul 19 20:17:49.038805 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2578/5261] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:17:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:17:49.050892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-242ef949-0918-4590-9cc3-ae4375b7f28e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:49.052233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-242ef949-0918-4590-9cc3-ae4375b7f28e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:49.295346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-242ef949-0918-4590-9cc3-ae4375b7f28e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:49.325576 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-242ef949-0918-4590-9cc3-ae4375b7f28e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1249 microversion: 2.1 time: 0.279821 Jul 19 20:17:49.328472 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2684/5262] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:49 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1249 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:50.347149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:50.347797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:50.364637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.371492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:50.372496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.372967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:50.485450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:50.506640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3f9369d-21c5-41de-856f-42d7e0fd73eb tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1245 microversion: 2.1 time: 0.163774 Jul 19 20:17:50.507731 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2579/5263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:50 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1245 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:50.715722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f5e318-ff7b-4574-a200-941cd6df17c0"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:50.718137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:50.741491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.741962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:50.744026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:50.747495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:51.272669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-057e805f-9854-4f94-9351-67fae5fcaf73 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562036 Jul 19 20:17:51.273351 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2685/5264] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:17:50 2022] POST /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:51.536243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:51.536869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:51.553143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:51.557532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:51.558741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:51.559215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:51.895047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:51.931362 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0b35c873-7690-4d18-a7c9-050d7680c17a tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1307 microversion: 2.1 time: 0.400562 Jul 19 20:17:51.932650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2580/5265] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:51 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:17:52.960628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:52.962393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:52.992168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:52.992797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:52.994106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:52.994608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:53.930049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:53.953634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd88cbd9-8061-4b61-bcc8-b66773e61868 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 1.005388 Jul 19 20:17:53.975358 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2686/5266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:52 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:54.983061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:54.983834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:54.991349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:55.005194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:55.006220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:55.007571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:55.420894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-225e3989-6875-454a-a79f-22ccd2894706 req-aba6bb2e-5030-4433-9418-03c8a57d3837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debb517e-216f-4a7b-a910-d3f3fa7159a8", "tag": "fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:17:55.474141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-225e3989-6875-454a-a79f-22ccd2894706 req-aba6bb2e-5030-4433-9418-03c8a57d3837 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:55.474598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-225e3989-6875-454a-a79f-22ccd2894706 req-aba6bb2e-5030-4433-9418-03c8a57d3837 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:55.525503 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-225e3989-6875-454a-a79f-22ccd2894706 req-aba6bb2e-5030-4433-9418-03c8a57d3837 service nova] Creating event network-changed:fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7 for instance debb517e-216f-4a7b-a910-d3f3fa7159a8 on n-h2-843834-3 Jul 19 20:17:55.541801 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-225e3989-6875-454a-a79f-22ccd2894706 req-aba6bb2e-5030-4433-9418-03c8a57d3837 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125405 Jul 19 20:17:55.542724 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2687/5267] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:17:55.926753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:55.976520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-74fb9551-beb9-4f96-8996-664857905cff tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 0.997597 Jul 19 20:17:55.977559 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2581/5268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:54 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:57.003501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:57.007911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:57.027623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:57.028503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:57.029489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:57.030021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:57.421329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:57.445186 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86bbf7cf-d2be-4d84-94f0-8b36a3985c6e tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 0.451155 Jul 19 20:17:57.459612 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2688/5269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:56 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:17:58.482505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:17:58.483586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:17:58.532758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:58.538719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:58.540979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:17:58.542030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:17:58.773634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:58.853497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:17:59.773227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:17:59.791770 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb98abd4-f2c9-416f-860f-b3122b42862c tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 1.315684 Jul 19 20:17:59.792763 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2582/5270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:17:58 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:00.814494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:00.815679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:00.832454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:00.834811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:00.838250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:00.841475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:00.842443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:01.188684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:01.204823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61c1a458-2c24-439a-9986-958c7f947597 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 0.397292 Jul 19 20:18:01.207659 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2689/5271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:00 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:01.621190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-25bb2ad8-0125-4275-a740-3da09e300a7f req-d8bce07b-a83d-4c28-bc88-5ef304ae362e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debb517e-216f-4a7b-a910-d3f3fa7159a8", "name": "network-vif-plugged", "status": "completed", "tag": "fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:01.638731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-25bb2ad8-0125-4275-a740-3da09e300a7f req-d8bce07b-a83d-4c28-bc88-5ef304ae362e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:01.643228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-25bb2ad8-0125-4275-a740-3da09e300a7f req-d8bce07b-a83d-4c28-bc88-5ef304ae362e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:01.688562 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-25bb2ad8-0125-4275-a740-3da09e300a7f req-d8bce07b-a83d-4c28-bc88-5ef304ae362e service nova] Creating event network-vif-plugged:fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7 for instance debb517e-216f-4a7b-a910-d3f3fa7159a8 on n-h2-843834-3 Jul 19 20:18:01.698576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-25bb2ad8-0125-4275-a740-3da09e300a7f req-d8bce07b-a83d-4c28-bc88-5ef304ae362e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081941 Jul 19 20:18:01.701655 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2583/5272] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:02.224630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:02.225928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:02.270182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:02.273277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:02.279866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:02.284185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:02.624749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:02.687291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89376989-215e-450c-886a-d2303b756d56 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1375 microversion: 2.1 time: 0.467094 Jul 19 20:18:02.688943 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2690/5273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:02 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1375 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:03.711644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:03.712756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:03.732629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.735212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:03.737071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:03.740451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:04.036084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:04.058034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92105d33-b08f-4371-9875-cc481a738d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1548 microversion: 2.1 time: 0.353493 Jul 19 20:18:04.059137 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2584/5274] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:03 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1548 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:04.081261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:04.095881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:04.135113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:04.142948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:04.148132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:04.148552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:04.434550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:04.445070 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad573b52-1cc2-4bfc-87bb-972a091df069 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1548 microversion: 2.1 time: 0.371665 Jul 19 20:18:04.459308 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2691/5275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:04 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1548 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:07.976243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d5459779-6116-49de-b9fe-fd576cf2e248 req-ade60414-7235-40ca-8921-28556345f86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debb517e-216f-4a7b-a910-d3f3fa7159a8", "tag": "fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:08.002830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d5459779-6116-49de-b9fe-fd576cf2e248 req-ade60414-7235-40ca-8921-28556345f86d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:08.003453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d5459779-6116-49de-b9fe-fd576cf2e248 req-ade60414-7235-40ca-8921-28556345f86d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:08.045604 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d5459779-6116-49de-b9fe-fd576cf2e248 req-ade60414-7235-40ca-8921-28556345f86d service nova] Creating event network-changed:fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7 for instance debb517e-216f-4a7b-a910-d3f3fa7159a8 on n-h2-843834-3 Jul 19 20:18:08.054345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d5459779-6116-49de-b9fe-fd576cf2e248 req-ade60414-7235-40ca-8921-28556345f86d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082219 Jul 19 20:18:08.055023 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2585/5276] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:09.554410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e28c8587-b4ec-460c-ae44-e4caa1a81196 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: .version_select at 0x7f23ee2bb700>, body: {"keypair": {"name": "tempest-keypair-875601109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnIRS5y0KYorACVhBfhF1tYWip327KnnWxma5n0PQp92w25F56BlkiKC7TJcMj0dLlp9+2dqI5Il7RC2g3sj/aK7SWihIS1zkVTcLipDpHRaxhROhpEqrdCNjojZwaGdg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:09.619766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e28c8587-b4ec-460c-ae44-e4caa1a81196 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:18:09.642782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e28c8587-b4ec-460c-ae44-e4caa1a81196 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:18:09.734087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e28c8587-b4ec-460c-ae44-e4caa1a81196 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183927 Jul 19 20:18:09.738468 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2692/5277] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:18:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:12.270055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176100655", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d951e469-ec97-4bb2-a85a-d97852653bf0"}], "security_groups": [{"name": "tempest-securitygroup--1742795738"}], "key_name": "tempest-keypair-875601109", "user_data": "}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:12.417122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] validate_networks() for [('d951e469-ec97-4bb2-a85a-d97852653bf0', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:18:12.910480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:18:12.910903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:18:12.911425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:18:12.911841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:18:12.912257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:18:12.914446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:12.924142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.924592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:12.925461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:12.926013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:12.933662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=37 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:12.946938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:18:12.954549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:18:12.970762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:18:12.973469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:18:13.069920 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c77e508-9870-43da-a4d5-d936b491803c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.809459 Jul 19 20:18:13.071177 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2586/5278] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:18:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:18:13.086403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ec4091a-d2d4-44bd-90ec-aff490076946 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:13.087164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ec4091a-d2d4-44bd-90ec-aff490076946 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:13.163265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ec4091a-d2d4-44bd-90ec-aff490076946 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:13.170960 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ec4091a-d2d4-44bd-90ec-aff490076946 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1240 microversion: 2.1 time: 0.093675 Jul 19 20:18:13.171573 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2693/5279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:13 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:14.189505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:14.190245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:14.206425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.206985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:14.207855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:14.208347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:14.362108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:14.372107 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22ed4e76-bc8c-48fd-9b9c-80620e833806 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1292 microversion: 2.1 time: 0.187221 Jul 19 20:18:14.375011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2587/5280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:14 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1292 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:15.393506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:15.394954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:15.398216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:15.424068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.424549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.425446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:15.426144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:15.767766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:15.787501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-737eb795-a9d1-47c3-848e-10e1c597eb83 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1298 microversion: 2.1 time: 0.397155 Jul 19 20:18:15.789770 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2694/5281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:15 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1298 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:16.809650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:16.810366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:16.821885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.827862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:16.831049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:16.832209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:17.891553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:17.915926 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2ef09fa1-f728-4567-854b-73d8d0b399f2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 1.110132 Jul 19 20:18:17.946450 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2588/5282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:16 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:18.287898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-fec0a511-0ce6-4a55-ad32-585a4ad0e562 req-509c4f4c-3c6d-4f98-b8b2-80c9f790ca9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6575f5-38cf-4bca-a382-2ceffacb087c", "tag": "82d44a3c-e83f-4deb-9ecb-c683adcd3374"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:18.314612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fec0a511-0ce6-4a55-ad32-585a4ad0e562 req-509c4f4c-3c6d-4f98-b8b2-80c9f790ca9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:18.315108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fec0a511-0ce6-4a55-ad32-585a4ad0e562 req-509c4f4c-3c6d-4f98-b8b2-80c9f790ca9f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:18.346809 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-fec0a511-0ce6-4a55-ad32-585a4ad0e562 req-509c4f4c-3c6d-4f98-b8b2-80c9f790ca9f service nova] Creating event network-changed:82d44a3c-e83f-4deb-9ecb-c683adcd3374 for instance ed6575f5-38cf-4bca-a382-2ceffacb087c on n-h1-843834-3 Jul 19 20:18:18.369321 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-fec0a511-0ce6-4a55-ad32-585a4ad0e562 req-509c4f4c-3c6d-4f98-b8b2-80c9f790ca9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085092 Jul 19 20:18:18.373355 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2695/5283] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:18.959768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:18.962692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:18.990126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:18.993013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:18.995633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:19.000328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:19.426080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:19.463784 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7bb13d77-affc-4735-b050-5613f5604873 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 0.506936 Jul 19 20:18:19.469762 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2589/5284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:18 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:20.496665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:20.498008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:20.501878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:20.512590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:20.513420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:20.514877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:20.515782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:21.210858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:21.219278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdf51116-3c92-4237-b601-084cf7666538 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 0.726975 Jul 19 20:18:21.219888 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2696/5285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:20 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:22.236532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:22.238559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:22.251560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:22.255049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:22.257260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:22.258577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:22.497760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:22.507443 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a34e08be-aaa0-4eb9-bd05-a72ff0433305 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 0.274966 Jul 19 20:18:22.508050 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2590/5286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:22 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:23.533394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:23.534945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:23.537940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:23.546397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:23.547241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:23.548429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:23.549096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:23.794028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:23.803569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-54340abf-a128-49aa-944d-bf0417adaefe tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 0.275696 Jul 19 20:18:23.805430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-c30e3d23-ae53-4d0e-9ac0-eadf2518b2bd req-7d68b731-b59b-4aaa-a0ff-df990556d69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6575f5-38cf-4bca-a382-2ceffacb087c", "name": "network-vif-plugged", "status": "completed", "tag": "82d44a3c-e83f-4deb-9ecb-c683adcd3374"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:23.814460 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2697/5287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:23 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:23.820111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:23.820876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:23.831826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c30e3d23-ae53-4d0e-9ac0-eadf2518b2bd req-7d68b731-b59b-4aaa-a0ff-df990556d69c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:23.832686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-c30e3d23-ae53-4d0e-9ac0-eadf2518b2bd req-7d68b731-b59b-4aaa-a0ff-df990556d69c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:23.848421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-c30e3d23-ae53-4d0e-9ac0-eadf2518b2bd req-7d68b731-b59b-4aaa-a0ff-df990556d69c service nova] Creating event network-vif-plugged:82d44a3c-e83f-4deb-9ecb-c683adcd3374 for instance ed6575f5-38cf-4bca-a382-2ceffacb087c on n-h1-843834-3 Jul 19 20:18:23.864150 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-c30e3d23-ae53-4d0e-9ac0-eadf2518b2bd req-7d68b731-b59b-4aaa-a0ff-df990556d69c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062466 Jul 19 20:18:23.864842 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2591/5288] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:24.823678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:24.824331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:24.845372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:24.846054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:24.847083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:24.850747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:25.455506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:25.479681 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5633b381-4368-436b-9b23-b3baaf1ada43 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1366 microversion: 2.1 time: 0.661907 Jul 19 20:18:25.485486 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2698/5289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:24 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:26.519615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:26.520360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:26.529993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.530359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.531209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.531672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.742446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:26.757953 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-59ce84b4-6ac8-467a-bd2d-5e62cca8fc71 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1557 microversion: 2.1 time: 0.242997 Jul 19 20:18:26.758703 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2592/5290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:26 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1557 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:18:26.775234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:26.775783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:26.815325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.816001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.816815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:26.817319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:26.957219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1874769-ad45-4323-be02-eb10a88e8044 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186565 Jul 19 20:18:26.958183 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2699/5291] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:18:26 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:29.170064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4ba3df0e-393f-4e6c-9694-0d7097575efa req-af26ed98-dbcb-4abc-a681-ae40a32d1fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6575f5-38cf-4bca-a382-2ceffacb087c", "tag": "82d44a3c-e83f-4deb-9ecb-c683adcd3374"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:29.200783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4ba3df0e-393f-4e6c-9694-0d7097575efa req-af26ed98-dbcb-4abc-a681-ae40a32d1fa7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:29.204022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4ba3df0e-393f-4e6c-9694-0d7097575efa req-af26ed98-dbcb-4abc-a681-ae40a32d1fa7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:29.222589 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4ba3df0e-393f-4e6c-9694-0d7097575efa req-af26ed98-dbcb-4abc-a681-ae40a32d1fa7 service nova] Creating event network-changed:82d44a3c-e83f-4deb-9ecb-c683adcd3374 for instance ed6575f5-38cf-4bca-a382-2ceffacb087c on n-h1-843834-3 Jul 19 20:18:29.230479 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4ba3df0e-393f-4e6c-9694-0d7097575efa req-af26ed98-dbcb-4abc-a681-ae40a32d1fa7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064501 Jul 19 20:18:29.232052 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2593/5292] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:30.630127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:30.632262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:30.645661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:30.646676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:30.648158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:30.648762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:30.710515 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3d437a0-1206-416f-9488-c2b31b41b79d tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8/action" status: 200 len: 24575 microversion: 2.1 time: 0.086313 Jul 19 20:18:30.719696 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2700/5293] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:30 2022] POST /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8/action => generated 24575 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:18:41.955059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:41.956733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=35 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:41.962776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:41.964835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:42.001279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:42.006274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:42.008688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:42.010271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:42.089602 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df6c2386-e084-4e2a-80b3-cac1038d81ec tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "POST /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8/action" status: 200 len: 32643 microversion: 2.1 time: 0.136262 Jul 19 20:18:42.090280 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2594/5294] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:18:41 2022] POST /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8/action => generated 32643 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:18:43.976123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-523613c7-1fae-4c41-a117-f24fb4d1f784 req-d8182407-14e6-44f5-b11f-6f44729b454b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debb517e-216f-4a7b-a910-d3f3fa7159a8", "tag": "fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:43.977749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:43.978353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:43.981793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:43.984697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:43.996063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-523613c7-1fae-4c41-a117-f24fb4d1f784 req-d8182407-14e6-44f5-b11f-6f44729b454b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.000318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-523613c7-1fae-4c41-a117-f24fb4d1f784 req-d8182407-14e6-44f5-b11f-6f44729b454b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.003459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.003926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.004740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.005186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.027911 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-523613c7-1fae-4c41-a117-f24fb4d1f784 req-d8182407-14e6-44f5-b11f-6f44729b454b service nova] Creating event network-changed:fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7 for instance debb517e-216f-4a7b-a910-d3f3fa7159a8 on n-h2-843834-3 Jul 19 20:18:44.047817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-523613c7-1fae-4c41-a117-f24fb4d1f784 req-d8182407-14e6-44f5-b11f-6f44729b454b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074642 Jul 19 20:18:44.051875 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2595/5295] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:44.075281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:18:44.214091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-672d0cce-f326-4929-aa62-0c44695080d2 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 204 len: 0 microversion: 2.1 time: 0.245653 Jul 19 20:18:44.215660 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2701/5296] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:18:43 2022] DELETE /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:18:44.225897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:44.226630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:44.284595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.288993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.293837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:44.296009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:44.641822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:44.655702 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1bc4883b-5514-4122-80dd-61da94aa6231 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1672 microversion: 2.1 time: 0.435402 Jul 19 20:18:44.656300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2596/5297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:44 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1672 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:45.675500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:45.677756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:45.695210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:45.699059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:45.700432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:45.701645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:46.275010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b392e28e7a4f98852d0362ef3ae3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e14e167f7461fa15b89413e982f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:18:46.287327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5ea0d8b9-280b-4242-b93b-4d8f08e71eca tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 200 len: 1672 microversion: 2.1 time: 0.617073 Jul 19 20:18:46.287962 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2702/5298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:45 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 1672 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:18:46.677661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-56635c79-c07e-4d8a-8004-334c6ea35ee4 req-c1072a15-a4e4-43b2-8bbd-a464138f1193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debb517e-216f-4a7b-a910-d3f3fa7159a8", "name": "network-vif-deleted", "tag": "fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:46.688059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-56635c79-c07e-4d8a-8004-334c6ea35ee4 req-c1072a15-a4e4-43b2-8bbd-a464138f1193 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:46.688650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-56635c79-c07e-4d8a-8004-334c6ea35ee4 req-c1072a15-a4e4-43b2-8bbd-a464138f1193 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:46.706762 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-56635c79-c07e-4d8a-8004-334c6ea35ee4 req-c1072a15-a4e4-43b2-8bbd-a464138f1193 service nova] Creating event network-vif-deleted:fbbca3cb-f9fd-44fb-9b90-00b7caa28fb7 for instance debb517e-216f-4a7b-a910-d3f3fa7159a8 on n-h2-843834-3 Jul 19 20:18:46.719151 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-56635c79-c07e-4d8a-8004-334c6ea35ee4 req-c1072a15-a4e4-43b2-8bbd-a464138f1193 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045659 Jul 19 20:18:46.725436 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2597/5299] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:18:47.316255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:47.319476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] [instance: debb517e-216f-4a7b-a910-d3f3fa7159a8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:18:47.358497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.359334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.361903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:18:47.363154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:18:47.404350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] HTTP exception thrown: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Request method failure captured: Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 HTTP/1.1 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xColpKymrCjArW9TsoSHc6W-LsUCNJ3dCUH3nq_jdPqmqEVqyZBhAl4ZKKC2jMPZSQpC6mOBwTAdsMw_3Sa0TyG67u0RJh3mHcwQbqEVyw3UcQ_cDxPYh264qHLh1JDG47-GxrPQ42Evmtq_zBNj_E1kIYCrK-vhMZAL2ISKjBG1gg Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_886e14e167f7461fa15b89413e982f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/886e14e167f7461fa15b89413e982f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkBasicOps-546030490 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 886e14e167f7461fa15b89413e982f6c Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkBasicOps-546030490 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: e0b392e28e7a4f98852d0362ef3ae3b3 Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkBasicOps-546030490-project Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'debb517e-216f-4a7b-a910-d3f3fa7159a8'} Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:18:47.410069 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. Jul 19 20:18:47.417754 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:18:47.420422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Returning 404 to user: Instance debb517e-216f-4a7b-a910-d3f3fa7159a8 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:18:47.421947 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91ae32bd-d8dd-41df-8bdc-2aedd2018b47 tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8" status: 404 len: 111 microversion: 2.1 time: 0.113924 Jul 19 20:18:47.429237 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2703/5300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:18:47 2022] GET /compute/v2.1/servers/debb517e-216f-4a7b-a910-d3f3fa7159a8 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:18:47.719396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43847de8-0762-475d-ad54-782b936a8d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] Calling method '.version_select at 0x7f23eea1b670>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:18:47.787943 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43847de8-0762-475d-ad54-782b936a8d1b tempest-TestNetworkBasicOps-546030490 tempest-TestNetworkBasicOps-546030490-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1363193095" status: 202 len: 0 microversion: 2.1 time: 0.081275 Jul 19 20:18:47.791331 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2598/5301] 10.222.0.23 () {58 vars in 1256 bytes} [Tue Jul 19 20:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1363193095 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:18:59.380498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:59.381216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:18:59.830795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-735c20ed-aaf5-46cd-81ca-3f31164530df tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Action: 'create', calling method: .version_select at 0x7f23ee1409d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-466787029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEwWdzCzrHN4pNLA2qsXCIbrh6hCRq5eqLLu0eKL39tSGU4buoBOGtPA9WiRYMvOIsno3q33NXcyUeOE3tHkftuDqsKkUfnhJQRD+LiNEpXH00mE4/cyxb21h+UxPe0EQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:18:59.876987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-735c20ed-aaf5-46cd-81ca-3f31164530df tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for project 4c41fa9accff44a7967c943efdc72d02. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:18:59.893915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-735c20ed-aaf5-46cd-81ca-3f31164530df tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for user a213ab5dc97549c4b9c75e6dab1b2de7 and project 4c41fa9accff44a7967c943efdc72d02. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:18:59.944806 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-735c20ed-aaf5-46cd-81ca-3f31164530df tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.570370 Jul 19 20:18:59.946201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2704/5302] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:18:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:02.109106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:02.113382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:02.166271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:02.168721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:02.196934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.211655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.215045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.216271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.303794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6d487913-c9c4-4a9b-9c1c-bb3bcc18e91d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/ips" status: 200 len: 151 microversion: 2.1 time: 0.201994 Jul 19 20:19:02.304713 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2599/5303] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:19:02 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/ips => generated 151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:02.317318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f5e318-ff7b-4574-a200-941cd6df17c0"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:02.318746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:02.342954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.343430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.349775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.350443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.684504 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/os-volume_attachments HTTP/1.1 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 74 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: {"volumeAttachment": {"volumeId": "06f5e318-ff7b-4574-a200-941cd6df17c0"}} Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': 'ed6575f5-38cf-4bca-a382-2ceffacb087c', 'body': {'volumeAttachment': {'volumeId': '06f5e318-ff7b-4574-a200-941cd6df17c0'}}} Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:02.689362 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab Jul 19 20:19:02.698005 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:19:02.706731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 400 to user: Invalid volume: volume 06f5e318-ff7b-4574-a200-941cd6df17c0 is already attached to instances: daba30af-3561-4993-850b-32e5155474ab {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:02.724178 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bfba62ba-f032-44d2-b1aa-b1c68ac98b32 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.407861 Jul 19 20:19:02.789508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:02.799900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:02.819600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2705/5304] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:19:02 2022] POST /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c/os-volume_attachments => generated 174 bytes in 507 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:19:02.856338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.856805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.860234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:02.860843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:02.982557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:19:03.396087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8b01839c-eb6a-42a5-bc79-80ab5ddc9c20 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 204 len: 0 microversion: 2.1 time: 0.607779 Jul 19 20:19:03.402757 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2600/5305] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:19:02 2022] DELETE /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:19:03.409282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:03.410484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:03.436484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.437858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.445854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:03.446700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:03.904607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:03.936170 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78e98f4e-31ae-4a81-b9ae-6612a89c2590 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1682 microversion: 2.1 time: 0.531949 Jul 19 20:19:03.950089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2706/5306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:03 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1682 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:04.974358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:04.977608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:05.019464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:05.024285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:05.028826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:05.039807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:05.536341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:05.573874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7a8c4472-b1c4-4236-9cc3-78602bde106d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1682 microversion: 2.1 time: 0.609892 Jul 19 20:19:05.582176 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2601/5307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:04 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1682 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:06.600744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:06.601366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:06.615418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:06.615884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:06.618770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:06.619345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:07.263623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:07.304630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3d26a42-0d00-4af3-a6f3-ab5f900a5024 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1682 microversion: 2.1 time: 0.707541 Jul 19 20:19:07.359160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2707/5308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:06 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1682 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:08.340987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:08.351522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:08.425041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.428606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:08.441770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:08.447989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:09.019416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:09.064459 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-266dcf24-abe8-4034-93d4-e5a051114266 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 200 len: 1614 microversion: 2.1 time: 0.732651 Jul 19 20:19:09.080203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2602/5309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:08 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 1614 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:09.117616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5aee7509-3d29-41f9-9b57-e6f41060b06e req-853186cb-5ed6-4b59-b037-1b2d496c721d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6575f5-38cf-4bca-a382-2ceffacb087c", "name": "network-vif-deleted", "tag": "82d44a3c-e83f-4deb-9ecb-c683adcd3374"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:09.186019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5aee7509-3d29-41f9-9b57-e6f41060b06e req-853186cb-5ed6-4b59-b037-1b2d496c721d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:09.189301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5aee7509-3d29-41f9-9b57-e6f41060b06e req-853186cb-5ed6-4b59-b037-1b2d496c721d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:09.282712 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5aee7509-3d29-41f9-9b57-e6f41060b06e req-853186cb-5ed6-4b59-b037-1b2d496c721d service nova] Creating event network-vif-deleted:82d44a3c-e83f-4deb-9ecb-c683adcd3374 for instance ed6575f5-38cf-4bca-a382-2ceffacb087c on n-h1-843834-3 Jul 19 20:19:09.313089 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5aee7509-3d29-41f9-9b57-e6f41060b06e req-853186cb-5ed6-4b59-b037-1b2d496c721d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207684 Jul 19 20:19:09.323672 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2708/5310] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:09.420247 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:19:09.420803 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:19:10.113547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:10.120658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:10.208878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:10.212247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:10.222927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:10.233339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:10.364455 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c HTTP/1.1 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ed6575f5-38cf-4bca-a382-2ceffacb087c'} Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:10.371940 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:19:10.381754 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:10.387170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:10.388239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5c789a57-a75d-4f67-bd03-172bb7a0ef5e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 404 len: 111 microversion: 2.1 time: 0.283404 Jul 19 20:19:10.388832 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2603/5311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:10 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:10.401642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b3d65ac-a8b9-4cca-8d8c-1cc4c5f79ff2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '.version_select at 0x7f23ee265f70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:10.417879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:10.501295 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b3d65ac-a8b9-4cca-8d8c-1cc4c5f79ff2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875601109" status: 202 len: 0 microversion: 2.1 time: 0.099420 Jul 19 20:19:10.507325 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2709/5312] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875601109 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:19:12.988753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:12.991349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:13.031354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.037679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.046821 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.048169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.454310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lazy-loading 'services' on Instance uuid daba30af-3561-4993-850b-32e5155474ab {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:19:13.789618 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d826f37c-aa5b-4c8a-9d77-c12198a27131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments/06f5e318-ff7b-4574-a200-941cd6df17c0" status: 202 len: 0 microversion: 2.1 time: 0.844873 Jul 19 20:19:13.793918 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2604/5313] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:19:12 2022] DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments/06f5e318-ff7b-4574-a200-941cd6df17c0 => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:19:13.803272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:13.805258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:13.900687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.909115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:13.918088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:13.919194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:14.099470 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1eff1b02-1297-4c59-beef-635a51ea6162 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.302634 Jul 19 20:19:14.102541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2710/5314] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:13 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:15.135277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:15.141497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:15.160654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.163672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.165490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:15.166569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:15.456504 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b69e205e-9398-43b3-a47d-dec4bf7a7e18 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.333004 Jul 19 20:19:15.459409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2605/5315] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:15 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:16.472478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:16.474546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:16.511085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.516173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.521062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:16.529220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:16.719560 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f6e73b51-b5bf-457e-977f-3da627adb871 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236779 Jul 19 20:19:16.728263 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2711/5316] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:16 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:17.366480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1357363623-access_point-1870135869", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "9df96327-6bae-4f2c-a5ce-57ba687c1272"}], "key_name": "tempest-TestSecurityGroupsBasicOps-466787029", "security_groups": [{"name": "tempest-secgroup_access--1344513170"}, {"name": "tempest-secgroup_general--433948671"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:17.759637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:17.762228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:17.787142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.787991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.791896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:17.792800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:17.894335 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2fbcfc64-e921-409d-8e46-34fe5d02af1f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154732 Jul 19 20:19:17.895950 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2712/5317] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:17 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:18.198829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] validate_networks() for [('9df96327-6bae-4f2c-a5ce-57ba687c1272', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:19:18.908249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:18.910013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:18.930455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.934289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:18.938939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:18.939597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:19.163229 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6540fc5a-c6fb-4a4b-8c6f-d4c88a72370a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247002 Jul 19 20:19:19.163636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2713/5318] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:18 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:20.102338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:19:20.104020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:19:20.105361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:19:20.106302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:19:20.107337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:19:20.165127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.165857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.167438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.167958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.180567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.188023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.199619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for project 4c41fa9accff44a7967c943efdc72d02. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:19:20.211405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for user a213ab5dc97549c4b9c75e6dab1b2de7 and project 4c41fa9accff44a7967c943efdc72d02. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:19:20.217958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.221853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.226449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:20.228307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:20.239152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:19:20.242132 n-d-843834-3 devstack@n-api.service[131230]: WARNING nova.utils [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1357363623-access_point-1870135869 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1357363623-ac Jul 19 20:19:20.243402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:19:20.326421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e0630694-4318-4e8b-9d49-85cebb183ef5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.963691 Jul 19 20:19:20.327659 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2606/5319] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:19:17 2022] POST /compute/v2.1/servers => generated 457 bytes in 2966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:19:20.378223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-851f47b1-30ed-40d2-86aa-74fa17d81897 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:20.382121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-851f47b1-30ed-40d2-86aa-74fa17d81897 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:20.426237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55152a7a-2ac1-4175-a930-252224e39bab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251398 Jul 19 20:19:20.435123 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2714/5320] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:20.630211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-851f47b1-30ed-40d2-86aa-74fa17d81897 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:20.640447 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-851f47b1-30ed-40d2-86aa-74fa17d81897 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1294 microversion: 2.1 time: 0.292780 Jul 19 20:19:20.649973 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2607/5321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:20 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1294 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:21.446688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:21.447846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:21.461980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:21.465777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:21.480886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:21.482369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:21.568565 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aae257cb-07bd-47f1-b08c-cf3a105f05c1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127724 Jul 19 20:19:21.584275 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2715/5322] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:21 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:21.679771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9d3b162-4ac3-4e04-849e-f349bbe190a2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:21.680910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9d3b162-4ac3-4e04-849e-f349bbe190a2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:22.527832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9d3b162-4ac3-4e04-849e-f349bbe190a2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:22.536248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9d3b162-4ac3-4e04-849e-f349bbe190a2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1294 microversion: 2.1 time: 0.872938 Jul 19 20:19:22.542935 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2608/5323] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:21 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1294 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:22.603521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:22.605363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:22.621681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.622781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.624218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:22.625380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:22.722498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7e7d778-f18d-4865-baba-ae0a5d7a9dab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130030 Jul 19 20:19:22.726086 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2716/5324] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:22 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:23.561835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:23.571783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:23.604577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.605355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.610536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.613432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.714576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:23.724721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88e66e4b-90bc-4c34-bffd-effd427206e6 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1364 microversion: 2.1 time: 0.166968 Jul 19 20:19:23.726889 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2609/5325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:23 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:23.739673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:23.741754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:23.767843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.768630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.769711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:23.770324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:23.816787 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14cfd29d-d012-4df4-9a93-f1506426e482 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082668 Jul 19 20:19:23.823630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2717/5326] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:23 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:24.764576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:24.766580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:24.832384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:24.834178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:24.834327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.836083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:24.837524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.842548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:24.856446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.857296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:24.859769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:24.860725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:24.939744 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-466e373d-5d06-4850-849a-d7d486cdd443 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113099 Jul 19 20:19:24.948783 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2718/5327] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:24 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:25.178185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:25.208376 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99b0d10a-45af-49b0-9822-2aa8e043d4b5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1352 microversion: 2.1 time: 0.452629 Jul 19 20:19:25.212308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2610/5328] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:24 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1352 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:25.961659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:25.964103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:26.005442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.008533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.012920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.016812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.150201 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e9403f5f-712d-4146-ad28-9612f2f86b05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196812 Jul 19 20:19:26.154376 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2719/5329] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:25 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:26.251540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:26.252790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:26.294380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.296804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:26.300897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:26.304865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.053438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:27.092037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0eeaf4cf-bf3c-4e48-b8e3-cc97e2fbe864 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 0.855739 Jul 19 20:19:27.096060 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2611/5330] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:26 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:27.169664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:27.170735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:27.197733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:27.198263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.199297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:27.199839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.309997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3bda4910-87ac-49aa-ba58-4b8a1366913a req-c1e54316-6236-467f-9770-bc2d488b5849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09c6545-a3ff-4c40-87d7-02c29aea286b", "tag": "4dd17dd2-4be2-42d9-bbb6-066d7e521bbe"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:27.354165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3bda4910-87ac-49aa-ba58-4b8a1366913a req-c1e54316-6236-467f-9770-bc2d488b5849 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:27.356273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3bda4910-87ac-49aa-ba58-4b8a1366913a req-c1e54316-6236-467f-9770-bc2d488b5849 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:27.394460 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-535315f1-e4cc-4b7b-a08c-7875a022c809 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231969 Jul 19 20:19:27.398679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3bda4910-87ac-49aa-ba58-4b8a1366913a req-c1e54316-6236-467f-9770-bc2d488b5849 service nova] Creating event network-changed:4dd17dd2-4be2-42d9-bbb6-066d7e521bbe for instance f09c6545-a3ff-4c40-87d7-02c29aea286b on n-h2-843834-3 Jul 19 20:19:27.404283 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2720/5331] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:27 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:27.424966 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3bda4910-87ac-49aa-ba58-4b8a1366913a req-c1e54316-6236-467f-9770-bc2d488b5849 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119220 Jul 19 20:19:27.426877 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2612/5332] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:28.142481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:28.144165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:28.163491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.165004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.168134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.170041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.416392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:28.418501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:28.470357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.471986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.476078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.477979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.606224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0bb23e6-e7d3-48f0-8fcb-d25062a9b1d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201816 Jul 19 20:19:28.607587 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2613/5333] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:19:28 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:19:28.723922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:28.724752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:28.747530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.755224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.756294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:28.756951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:28.825334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:19:29.009195 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d517d14-b6ee-4e1a-a577-13e94294bb26 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 204 len: 0 microversion: 2.1 time: 0.290317 Jul 19 20:19:29.011237 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2614/5334] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:19:28 2022] DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:19:29.032314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:29.041183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:29.051618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.052491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.053803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:29.054828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:29.384895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.395600 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5e728aac-422c-427c-8564-cc7a2134be17 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 1.270804 Jul 19 20:19:29.410081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2721/5335] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:28 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:29.625418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:29.636397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:29.649058 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e45d73ac-d636-477d-a34b-c9244f6d2f8a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1683 microversion: 2.1 time: 0.628914 Jul 19 20:19:29.650633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2615/5336] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:29 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1683 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:30.419571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:30.425082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:30.435149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:30.460896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.462150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.463866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.464922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.480782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:30.673665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:30.678002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:30.714872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:30.722355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.727300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:30.728905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:30.733553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:31.497129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.523599 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-500c4af1-6d31-4518-a58e-bda52845a80a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 1.112242 Jul 19 20:19:31.533657 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2722/5337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:30 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:31.786967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:31.840561 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9028b0b6-8668-4e76-b62e-13993f8b37a9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1683 microversion: 2.1 time: 1.170161 Jul 19 20:19:31.853202 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2616/5338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:30 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1683 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:32.556200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.557428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.581842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.582630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.584136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.584915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.868294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:32.882410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:32.886272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:32.894945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:32.925037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.926471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:32.930608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:32.935174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:34.480797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.496395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c82e1375-8110-4cc5-97fe-15cc76f1f87f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 1.949635 Jul 19 20:19:34.499767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2723/5339] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:34.543736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:34.575962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f65bd5b5-a5d3-4053-91d9-0aa2167e65b1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1683 microversion: 2.1 time: 1.709442 Jul 19 20:19:34.581695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2617/5340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:32 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1683 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:35.530458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:35.536746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:35.563552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b737132d-3479-4147-8912-9cce3b7f29d5 req-d84ca76c-8bf3-446a-ae43-23f7bc3b452b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daba30af-3561-4993-850b-32e5155474ab", "name": "network-vif-deleted", "tag": "1c641054-a414-4894-bc7c-2a02b9e0daad"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:35.571265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.572660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.574464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.579276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.598609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b737132d-3479-4147-8912-9cce3b7f29d5 req-d84ca76c-8bf3-446a-ae43-23f7bc3b452b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.601700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b737132d-3479-4147-8912-9cce3b7f29d5 req-d84ca76c-8bf3-446a-ae43-23f7bc3b452b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.620490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b737132d-3479-4147-8912-9cce3b7f29d5 req-d84ca76c-8bf3-446a-ae43-23f7bc3b452b service nova] Creating event network-vif-deleted:1c641054-a414-4894-bc7c-2a02b9e0daad for instance daba30af-3561-4993-850b-32e5155474ab on n-h1-843834-3 Jul 19 20:19:35.629656 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b737132d-3479-4147-8912-9cce3b7f29d5 req-d84ca76c-8bf3-446a-ae43-23f7bc3b452b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083970 Jul 19 20:19:35.631315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2618/5341] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:35.637970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:35.639734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:35.651334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.655456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.657347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:35.658064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:35.989528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.030782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-818fbd85-5c0b-4f4c-abdc-affda830890e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 200 len: 1326 microversion: 2.1 time: 0.397294 Jul 19 20:19:36.042897 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2619/5342] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:35 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 1326 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:36.825510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:36.847310 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-601c3984-2ce7-41b7-81a0-c5af2fd1b832 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 1.323658 Jul 19 20:19:36.872515 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2724/5343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:35 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:37.075458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.081326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.111986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.112567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.113539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.125822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.166998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab HTTP/1.1 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'daba30af-3561-4993-850b-32e5155474ab'} Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:19:37.172331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:19:37.180473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8fe4fa36-8873-4a61-8ed4-1b498bc0729f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 404 len: 111 microversion: 2.1 time: 0.107508 Jul 19 20:19:37.183426 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2620/5344] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:37 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:19:37.187492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ff136a47-4676-49cc-9e4e-75396c4b4a00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '.version_select at 0x7f23eed9c310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.321034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ff136a47-4676-49cc-9e4e-75396c4b4a00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716368233" status: 202 len: 0 microversion: 2.1 time: 0.140726 Jul 19 20:19:37.326558 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2725/5345] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716368233 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:19:37.880937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:37.881786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:37.896619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.897601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.898774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.904579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:37.959558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9ed1b388-988a-4585-bf57-a05ecb1be4b5 req-bca23ff0-9cbe-4ff1-9ef0-54f0ff59e350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09c6545-a3ff-4c40-87d7-02c29aea286b", "name": "network-vif-plugged", "status": "completed", "tag": "4dd17dd2-4be2-42d9-bbb6-066d7e521bbe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:37.993506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9ed1b388-988a-4585-bf57-a05ecb1be4b5 req-bca23ff0-9cbe-4ff1-9ef0-54f0ff59e350 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:37.994083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9ed1b388-988a-4585-bf57-a05ecb1be4b5 req-bca23ff0-9cbe-4ff1-9ef0-54f0ff59e350 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:38.032848 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9ed1b388-988a-4585-bf57-a05ecb1be4b5 req-bca23ff0-9cbe-4ff1-9ef0-54f0ff59e350 service nova] Creating event network-vif-plugged:4dd17dd2-4be2-42d9-bbb6-066d7e521bbe for instance f09c6545-a3ff-4c40-87d7-02c29aea286b on n-h2-843834-3 Jul 19 20:19:38.044875 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9ed1b388-988a-4585-bf57-a05ecb1be4b5 req-bca23ff0-9cbe-4ff1-9ef0-54f0ff59e350 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090202 Jul 19 20:19:38.047388 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2726/5346] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:39.215691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:39.231290 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfe54de3-ae02-47f2-91ee-693fb5b96697 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1471 microversion: 2.1 time: 1.354234 Jul 19 20:19:39.234972 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2621/5347] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:37 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1471 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:40.255686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:40.257146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:40.274640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.278305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:40.279660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:40.281574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.001673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-86b1c884-0d44-4c6b-a891-2325a576a579 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: .version_select at 0x7f23ee9d5ee0>, body: {"keypair": {"name": "tempest-keypair-816552407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5F4fwRYdEKPcA5GrjPAgO6HTW2Tc+MX/wJ01TvuVtyCxYZzyZ+bqZByqI99Sd20PlmIJRlzLO8yHvXMFwDfdSJWC1cFVUrnZRNdXm1y3dQa3EGv+Mrn3g4ciaUfxoPBw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:41.063795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-86b1c884-0d44-4c6b-a891-2325a576a579 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:19:41.090052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-86b1c884-0d44-4c6b-a891-2325a576a579 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:19:41.136348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.145498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-965248b1-625e-4a8e-9aa3-888f4edda95b tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1642 microversion: 2.1 time: 0.896314 Jul 19 20:19:41.158758 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2727/5348] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:40 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1642 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:41.190101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:41.190750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:41.210713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.212471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.215616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.216138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.220228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-86b1c884-0d44-4c6b-a891-2325a576a579 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222433 Jul 19 20:19:41.221342 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2622/5349] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:19:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:19:41.750431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:41.776567 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5f17241-e498-49af-a2d4-afacbd9f7930 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1642 microversion: 2.1 time: 0.605992 Jul 19 20:19:41.778837 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2728/5350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:41 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1642 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:41.809964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:41.811593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:41.828077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.829020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:41.831757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:41.832521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:42.788528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-380fc9ac-8baa-40e5-9ccf-108076f56db0 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1793 microversion: 2.1 time: 0.987343 Jul 19 20:19:42.793982 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2623/5351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:41 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1793 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:49.139233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-950138820", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d951e469-ec97-4bb2-a85a-d97852653bf0"}], "security_groups": [{"name": "tempest-securitygroup--1355007880"}], "key_name": "tempest-keypair-816552407", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:49.625273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] validate_networks() for [('d951e469-ec97-4bb2-a85a-d97852653bf0', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:19:51.689141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e5cd58e9-7174-4b42-8417-8d8a6c1ae0f9 req-08a04bd7-416b-4be8-9a50-9db6fb8fb956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09c6545-a3ff-4c40-87d7-02c29aea286b", "tag": "4dd17dd2-4be2-42d9-bbb6-066d7e521bbe"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:19:51.727967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:51.732963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e5cd58e9-7174-4b42-8417-8d8a6c1ae0f9 req-08a04bd7-416b-4be8-9a50-9db6fb8fb956 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:51.737752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e5cd58e9-7174-4b42-8417-8d8a6c1ae0f9 req-08a04bd7-416b-4be8-9a50-9db6fb8fb956 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:51.771055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=31 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:19:51.819410 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e5cd58e9-7174-4b42-8417-8d8a6c1ae0f9 req-08a04bd7-416b-4be8-9a50-9db6fb8fb956 service nova] Creating event network-changed:4dd17dd2-4be2-42d9-bbb6-066d7e521bbe for instance f09c6545-a3ff-4c40-87d7-02c29aea286b on n-h2-843834-3 Jul 19 20:19:51.846134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e5cd58e9-7174-4b42-8417-8d8a6c1ae0f9 req-08a04bd7-416b-4be8-9a50-9db6fb8fb956 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163423 Jul 19 20:19:51.848090 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2624/5352] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:19:51.960663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:19:51.961961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:19:51.963306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:19:51.964440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:19:51.965412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:19:52.005431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:52.014766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:52.017023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:52.022186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:52.111419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:19:52.196855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:19:52.272056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:19:52.278005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:19:52.515710 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2c021e5-0a15-4aba-965a-97da6e5a71b9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.380048 Jul 19 20:19:52.517522 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2729/5353] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:19:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:19:52.528530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf15257d-1397-482a-81a1-a9263c677a9b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:52.529707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf15257d-1397-482a-81a1-a9263c677a9b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:52.709079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf15257d-1397-482a-81a1-a9263c677a9b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:52.723247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf15257d-1397-482a-81a1-a9263c677a9b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1240 microversion: 2.1 time: 0.199090 Jul 19 20:19:52.733649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2625/5354] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:52 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:53.743335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:53.744954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:53.763064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:53.763540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:53.764397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:53.764853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:53.933350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:53.942684 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-349e9118-d2ed-49cc-87ea-270ccfd14486 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1236 microversion: 2.1 time: 0.204885 Jul 19 20:19:53.949780 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2730/5355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:53 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1236 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:19:54.967469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:54.968145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:54.983531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:54.984324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:54.985363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:54.986900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:55.307036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:55.322706 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b017dce5-aed7-467b-a8b8-5e572ff80d00 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1310 microversion: 2.1 time: 0.359221 Jul 19 20:19:55.340889 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2626/5356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:54 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1310 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:56.377869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:56.380403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:56.418284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:56.420073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:56.428247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:56.428876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:57.048256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:57.059217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-100a9ce9-f536-46c5-a5b7-39ec81095494 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1298 microversion: 2.1 time: 0.690885 Jul 19 20:19:57.069297 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2731/5357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:56 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1298 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:58.104439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:58.108308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:58.164730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:58.165602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:58.177965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:58.179138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:58.842957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:19:58.876017 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c298d415-db95-4007-b0e0-7577bc2b0092 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.774069 Jul 19 20:19:58.878261 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2627/5358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:58 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:19:59.934646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:19:59.939239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:19:59.975455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:59.976644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:19:59.978480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:19:59.979633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:01.041165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:01.072859 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4263dbf0-05f9-421e-9c95-54e89b9a0074 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 1.176391 Jul 19 20:20:01.077542 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2732/5359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:19:59 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:02.148769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:02.157580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:02.164091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:02.218459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:02.219941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:02.225214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:02.226584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:02.235735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:02.245853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=49 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:02.437647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb4ac896-a701-41a4-8cbe-07ba0fcd9cd9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1743104008", "availability_zone": "foo_zone"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:02.462576 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:02.462576 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:02.464021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.aggregate [None req-cb4ac896-a701-41a4-8cbe-07ba0fcd9cd9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Generated uuid 99632336-bb94-4ef3-a8d4-516885c6ddb0 for aggregate {{(pid=131229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 20:20:02.470590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:02.542370 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb4ac896-a701-41a4-8cbe-07ba0fcd9cd9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.409245 Jul 19 20:20:02.545087 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2733/5360] 10.222.0.23 () {60 vars in 1163 bytes} [Tue Jul 19 20:20:02 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:02.558978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1af430ad-a970-40e0-a77c-129ceb9aa5c3 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:02.563062 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:02.563062 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:02.599487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1af430ad-a970-40e0-a77c-129ceb9aa5c3 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.047817 Jul 19 20:20:02.601178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2734/5361] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 20:20:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:02.615572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:02.617824 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:02.617824 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:02.621919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:02.622848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:02.624023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:02.624738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:02.674340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de38eb2e-7a05-4486-83dd-baa55e5ccfad tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066126 Jul 19 20:20:02.676900 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2735/5362] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Jul 19 20:20:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:02.699963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1891259b-1698-4457-b2a3-368eb72b6ad7 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:02.701217 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:02.701217 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:02.712519 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1891259b-1698-4457-b2a3-368eb72b6ad7 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.024098 Jul 19 20:20:02.714033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2736/5363] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Jul 19 20:20:02 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:02.714410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:02.732408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29623867-3e6e-42d1-b380-840b85f702a9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:02.740928 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:02.740928 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:02.759823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29623867-3e6e-42d1-b380-840b85f702a9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:02.760697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29623867-3e6e-42d1-b380-840b85f702a9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:03.252213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:03.265119 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecba7dd1-903f-41a2-afa2-7c92c3791131 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 1.170740 Jul 19 20:20:03.268021 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2628/5364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:02 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:03.528909 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29623867-3e6e-42d1-b380-840b85f702a9 tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.806695 Jul 19 20:20:03.529652 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2737/5365] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 20:20:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:03.543398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fff34fb-99b5-456a-8c30-77ff6b22260f tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:03.546369 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:03.546369 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 20:20:03.556699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:03.616961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fff34fb-99b5-456a-8c30-77ff6b22260f tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.079983 Jul 19 20:20:03.617321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7b9c8c4b-ad44-4cd5-9016-1c6b90d18158 req-82a939f4-de50-4513-8411-f340d1989a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90051f31-e621-44ad-aff2-bab0159dd0bd", "tag": "c7378819-1537-4649-8f71-70f280c6914f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:03.617968 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2629/5366] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:20:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:03.632069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b33af51-7a63-4266-91a4-192aed3052ce tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-842787113", "availability_zone": "foo_zone"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:03.633755 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:03.633755 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 20:20:03.639701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7b9c8c4b-ad44-4cd5-9016-1c6b90d18158 req-82a939f4-de50-4513-8411-f340d1989a02 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:03.644588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7b9c8c4b-ad44-4cd5-9016-1c6b90d18158 req-82a939f4-de50-4513-8411-f340d1989a02 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:03.737833 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7b9c8c4b-ad44-4cd5-9016-1c6b90d18158 req-82a939f4-de50-4513-8411-f340d1989a02 service nova] Creating event network-changed:c7378819-1537-4649-8f71-70f280c6914f for instance 90051f31-e621-44ad-aff2-bab0159dd0bd on n-h1-843834-3 Jul 19 20:20:03.755391 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7b9c8c4b-ad44-4cd5-9016-1c6b90d18158 req-82a939f4-de50-4513-8411-f340d1989a02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141097 Jul 19 20:20:03.756584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2738/5367] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:03.797589 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b33af51-7a63-4266-91a4-192aed3052ce tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.169623 Jul 19 20:20:03.809042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2630/5368] 10.222.0.23 () {60 vars in 1172 bytes} [Tue Jul 19 20:20:03 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:20:03.826835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb43b54e-c2a8-4277-8604-8029c40add8c tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:03.829404 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:03.829404 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:03.914643 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb43b54e-c2a8-4277-8604-8029c40add8c tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.094594 Jul 19 20:20:03.917971 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2739/5369] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 20:20:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:03.932201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e977839-4a1b-4213-b3c9-934a55f386ab tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:03.933345 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:03.933345 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 20:20:03.957648 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e977839-4a1b-4213-b3c9-934a55f386ab tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.030681 Jul 19 20:20:03.964131 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2631/5370] 10.222.0.23 () {58 vars in 1151 bytes} [Tue Jul 19 20:20:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:03.982614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de1f4684-ae00-4c69-97ae-eee831f3807d tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-843834-3"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:03.999279 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:03.999279 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:04.050796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de1f4684-ae00-4c69-97ae-eee831f3807d tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:04.051885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de1f4684-ae00-4c69-97ae-eee831f3807d tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:04.284848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:04.285960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:04.316030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:04.316283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:04.318155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:04.319184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:04.545319 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de1f4684-ae00-4c69-97ae-eee831f3807d tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.570469 Jul 19 20:20:04.564884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2740/5371] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 19 20:20:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:04.575098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f986d71b-059d-4e69-aa82-d753e74a839f tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:04.577017 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:04.577017 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:04.669349 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f986d71b-059d-4e69-aa82-d753e74a839f tempest-TestAggregatesBasicOps-295001979 tempest-TestAggregatesBasicOps-295001979-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.101910 Jul 19 20:20:04.672565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2741/5372] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 19 20:20:04 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 20:20:05.406005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:05.422393 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-838d1124-0c5c-4ad6-b97f-7881935c0cf6 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 1.141122 Jul 19 20:20:05.424635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2632/5373] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:04 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:20:06.445225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:06.446080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:06.460944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:06.468396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:06.469672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:06.473352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:07.235168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:07.244084 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-634d5191-b520-4590-902a-4f78c9225338 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.805678 Jul 19 20:20:07.264328 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2742/5374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:06 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:08.277956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:08.284047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:08.371236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:08.375278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:08.382592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:08.385476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:08.876221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:08.915224 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b2df7e5-319e-469b-b4af-4a7e943ed8cc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.642945 Jul 19 20:20:08.919164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2633/5375] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:08 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:09.937183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:09.939865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:10.012985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.013782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:10.021718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:10.026207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:10.482965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:10.496698 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b716cceb-e591-4d47-a295-aa4a37038157 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.567879 Jul 19 20:20:10.503649 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2743/5376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:09 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:11.528966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:11.531473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:11.557034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:11.559916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:11.561167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:11.564349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:12.243477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:12.255953 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-94d6b541-4330-4b4e-9d48-39172613348b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.732849 Jul 19 20:20:12.259983 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2634/5377] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:11 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:13.276788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:13.278337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:13.282091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:13.329022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:13.336611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:13.338049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:13.338537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:13.840704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:13.868533 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-93655eb7-b065-4011-ba60-6310d75cd26b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.593863 Jul 19 20:20:13.870033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2744/5378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:13 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:14.887601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:14.889099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:14.901865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-58eb9b25-a89d-47ce-8a8f-0a890e8f24ac req-bc4d88cd-83b6-46e5-b3b9-0274487b6e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90051f31-e621-44ad-aff2-bab0159dd0bd", "name": "network-vif-plugged", "status": "completed", "tag": "c7378819-1537-4649-8f71-70f280c6914f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:14.924763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:14.927087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:14.927087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:14.934977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:14.961349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-58eb9b25-a89d-47ce-8a8f-0a890e8f24ac req-bc4d88cd-83b6-46e5-b3b9-0274487b6e46 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:14.962160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-58eb9b25-a89d-47ce-8a8f-0a890e8f24ac req-bc4d88cd-83b6-46e5-b3b9-0274487b6e46 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:15.031518 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-58eb9b25-a89d-47ce-8a8f-0a890e8f24ac req-bc4d88cd-83b6-46e5-b3b9-0274487b6e46 service nova] Creating event network-vif-plugged:c7378819-1537-4649-8f71-70f280c6914f for instance 90051f31-e621-44ad-aff2-bab0159dd0bd on n-h1-843834-3 Jul 19 20:20:15.056794 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-58eb9b25-a89d-47ce-8a8f-0a890e8f24ac req-bc4d88cd-83b6-46e5-b3b9-0274487b6e46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167148 Jul 19 20:20:15.060822 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2745/5379] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:15.437861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:15.447383 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c5a665d1-e865-487a-972e-459dd056ff21 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.563936 Jul 19 20:20:15.459781 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2635/5380] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:14 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:16.502534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:16.504028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:16.522281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:16.523286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:16.525185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:16.526447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:16.968544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:16.985452 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76e39d4a-2667-4353-b3db-780c6bd560d4 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1366 microversion: 2.1 time: 0.499791 Jul 19 20:20:17.005101 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2746/5381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:16 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:18.016097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:18.018365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:18.033581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:18.034322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:18.036324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:18.038598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:18.623323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:18.669469 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-45bb2c36-012a-479a-9b36-5ca9a45b9983 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1557 microversion: 2.1 time: 0.655115 Jul 19 20:20:18.672615 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2636/5382] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:18 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1557 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:20:18.691704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:18.692809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:18.709217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:18.709985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:18.711419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:18.712175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:19.043221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0e2624a-bfaf-4904-b614-8851467a23f5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.357968 Jul 19 20:20:19.044084 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2747/5383] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:20:18 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:21.353953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ff9ba56e-dd7d-4069-b935-e24972c40a3c req-efcf738d-5e7c-47bd-bd28-9c10020ebcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90051f31-e621-44ad-aff2-bab0159dd0bd", "tag": "c7378819-1537-4649-8f71-70f280c6914f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:21.402721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ff9ba56e-dd7d-4069-b935-e24972c40a3c req-efcf738d-5e7c-47bd-bd28-9c10020ebcf0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:21.404174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ff9ba56e-dd7d-4069-b935-e24972c40a3c req-efcf738d-5e7c-47bd-bd28-9c10020ebcf0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:21.437030 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ff9ba56e-dd7d-4069-b935-e24972c40a3c req-efcf738d-5e7c-47bd-bd28-9c10020ebcf0 service nova] Creating event network-changed:c7378819-1537-4649-8f71-70f280c6914f for instance 90051f31-e621-44ad-aff2-bab0159dd0bd on n-h1-843834-3 Jul 19 20:20:21.450492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ff9ba56e-dd7d-4069-b935-e24972c40a3c req-efcf738d-5e7c-47bd-bd28-9c10020ebcf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103159 Jul 19 20:20:21.453080 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2637/5384] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:20:30.699316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:30.700125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=62 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:30.704562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-332583532", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "365a8bef-af9d-453a-91e9-75c25f40de29"}], "key_name": "tempest-TestSecurityGroupsBasicOps-466787029", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f09c6545-a3ff-4c40-87d7-02c29aea286b"]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:30.791973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] validate_networks() for [('365a8bef-af9d-453a-91e9-75c25f40de29', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:20:32.166330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:20:32.167369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:20:32.167369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:20:32.167934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:20:32.168204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:20:32.189545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:32.189932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:32.192056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:32.192787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:32.246509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for project 4c41fa9accff44a7967c943efdc72d02. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:20:32.270122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Getting quotas for user a213ab5dc97549c4b9c75e6dab1b2de7 and project 4c41fa9accff44a7967c943efdc72d02. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:20:32.318412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:20:32.322737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:20:32.395421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15e363cd-e506-4a10-b60c-64c9924d1fc4 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.695882 Jul 19 20:20:32.404054 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2748/5385] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:20:30 2022] POST /compute/v2.1/servers => generated 361 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:20:32.411595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:32.413561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=37 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:32.419290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-876d16a2-19b6-43b5-9ed6-26ee987483ac tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:32.421713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-876d16a2-19b6-43b5-9ed6-26ee987483ac tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:32.612021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-876d16a2-19b6-43b5-9ed6-26ee987483ac tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:32.630126 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-876d16a2-19b6-43b5-9ed6-26ee987483ac tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1240 microversion: 2.1 time: 0.220906 Jul 19 20:20:32.630859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2638/5386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:32 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1240 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:20:33.667453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:33.673171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:33.704356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:33.706110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:33.709050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:33.710252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:33.948096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:33.959819 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86912c45-41e4-496e-bd59-e7f8a0d580fc tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1244 microversion: 2.1 time: 0.313105 Jul 19 20:20:33.961316 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2749/5387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:33 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1244 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:34.979375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:34.980796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:35.001746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:35.002232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:35.003137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:35.003585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:35.324095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:35.349975 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c3083aa-52ad-4a63-9895-d95948ccd6e9 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.375030 Jul 19 20:20:35.354859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2639/5388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:34 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:36.400282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:36.407280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:36.454934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:36.455439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:36.462016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:36.462251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:36.746597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:36.767623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e80c4377-bf46-4396-835e-8591a1c20556 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.385709 Jul 19 20:20:36.769282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2750/5389] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:36 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:37.795292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:37.801965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:37.828478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:37.829369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:37.830771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:37.851932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:38.140181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:38.182138 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d485ecfa-9d3b-462d-abb1-78b50fd09fae tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.394433 Jul 19 20:20:38.211072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2640/5390] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:37 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:39.232798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:39.237484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:39.269067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:39.271930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:39.275025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:39.280671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:39.504062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b8628716-4248-4acf-9a06-ef9cf097eca8 req-fbab2b3e-1f54-4193-95c2-152a8a8f7f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b204b6-9583-40ff-a2a0-70b67bd52d47", "tag": "79f12e60-adfb-46bf-be02-a0deeb7da941"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:39.530133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8628716-4248-4acf-9a06-ef9cf097eca8 req-fbab2b3e-1f54-4193-95c2-152a8a8f7f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:39.530616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b8628716-4248-4acf-9a06-ef9cf097eca8 req-fbab2b3e-1f54-4193-95c2-152a8a8f7f57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:39.575497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b8628716-4248-4acf-9a06-ef9cf097eca8 req-fbab2b3e-1f54-4193-95c2-152a8a8f7f57 service nova] Creating event network-changed:79f12e60-adfb-46bf-be02-a0deeb7da941 for instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 on n-h1-843834-3 Jul 19 20:20:39.603311 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b8628716-4248-4acf-9a06-ef9cf097eca8 req-fbab2b3e-1f54-4193-95c2-152a8a8f7f57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.497905 Jul 19 20:20:39.604611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2751/5391] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:39.727251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:39.735682 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2b3d814d-8c28-40db-84a7-90e9aa47ad3c tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.509682 Jul 19 20:20:39.735682 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2641/5392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:39 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:40.767340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:40.772043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:40.785160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:40.786490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:40.788046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:40.788800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:40.953910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:40.965472 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4aabd85f-ed66-4076-95ab-3dea1bfb9842 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.207820 Jul 19 20:20:40.966706 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2752/5393] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:40 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:41.985355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:41.986173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:42.001691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:42.003508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:42.006553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:42.007155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:42.623390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:43.321319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:43.350453 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24089166-d764-400f-94ce-17c9d07677af tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 1.369991 Jul 19 20:20:43.352686 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2642/5394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:41 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:44.369646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:44.370725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:44.374220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:44.378067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:20:44.401398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:44.401918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:44.403171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:44.403697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:44.606892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:44.634308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-caf6687f-643d-4298-9e1e-ceaeccd0c335 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.265195 Jul 19 20:20:44.635839 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2753/5395] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:44 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:45.662685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:45.664269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:45.678686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:45.682247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:45.686312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:45.690320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:45.918063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:45.931940 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8acf981-9f3e-4609-a170-18d1ea8a389f tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.282094 Jul 19 20:20:45.935592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2643/5396] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:45 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:46.378558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6186532d-10cf-483b-815d-b78a3e8ff2d0 req-d020be89-70c3-421f-936a-7c093dac81b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b204b6-9583-40ff-a2a0-70b67bd52d47", "name": "network-vif-plugged", "status": "completed", "tag": "79f12e60-adfb-46bf-be02-a0deeb7da941"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:46.406144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6186532d-10cf-483b-815d-b78a3e8ff2d0 req-d020be89-70c3-421f-936a-7c093dac81b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:46.406630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6186532d-10cf-483b-815d-b78a3e8ff2d0 req-d020be89-70c3-421f-936a-7c093dac81b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:46.434894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6186532d-10cf-483b-815d-b78a3e8ff2d0 req-d020be89-70c3-421f-936a-7c093dac81b2 service nova] Creating event network-vif-plugged:79f12e60-adfb-46bf-be02-a0deeb7da941 for instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 on n-h1-843834-3 Jul 19 20:20:46.461417 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6186532d-10cf-483b-815d-b78a3e8ff2d0 req-d020be89-70c3-421f-936a-7c093dac81b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086377 Jul 19 20:20:46.464653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2754/5397] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:46.951968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:46.952609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:46.966364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:46.967173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:46.968237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:46.972295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:47.093584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:47.102651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c645807a-160e-4055-aba3-f15bbecbe8f3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.154556 Jul 19 20:20:47.103793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2644/5398] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:46 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:48.141618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:48.144005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:48.163159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:48.164973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:48.166849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:48.171197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:48.376635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:48.386398 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c93a1c3a-5dad-43fd-8c85-dc87571fbdf5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1298 microversion: 2.1 time: 0.260763 Jul 19 20:20:48.388349 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2755/5399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:48 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1298 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:49.414871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:49.416361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:49.423565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.424111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.425136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.425834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.593838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:49.614403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5049e0b-6a85-4ad9-baae-352a20cb839a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1471 microversion: 2.1 time: 0.212643 Jul 19 20:20:49.630326 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2645/5400] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:49 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:49.640377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:49.641810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:49.665856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.668015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.670058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.671993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.877216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:49.893568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ccaf4cd-360e-41c1-9a9f-86083339a5f2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1471 microversion: 2.1 time: 0.261378 Jul 19 20:20:49.894260 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2756/5401] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:49 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:49.913358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:49.914029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:49.922865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.923038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:49.923842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:49.924280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.132055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4baad5bb-bba5-49a8-885a-121e14e798f5 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1622 microversion: 2.1 time: 0.221100 Jul 19 20:20:50.134091 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2646/5402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:49 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1622 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:50.154886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:50.155875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:50.164967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.165810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.167662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.168327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.490051 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a73de29c-0847-4234-96d0-7ddefcdbcd80 tempest-TestSecurityGroupsBasicOps-1577604092 tempest-TestSecurityGroupsBasicOps-1577604092-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1912 microversion: 2.1 time: 0.340523 Jul 19 20:20:50.500984 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2757/5403] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:50 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1912 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:50.579204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:50.579818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:50.589362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.590129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.591223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.591833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.630654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:20:50.822416 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4f36d4b5-b4b7-4b79-9f92-177ad3866784 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 204 len: 0 microversion: 2.1 time: 0.246253 Jul 19 20:20:50.824496 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2647/5404] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:20:50 2022] DELETE /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:20:50.838385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:50.839225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:50.870172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.874733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:50.879988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:50.880809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:51.101583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:51.135039 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1530d513-017f-48db-9ab1-525f2faaace8 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1477 microversion: 2.1 time: 0.304275 Jul 19 20:20:51.136105 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2758/5405] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:50 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:52.162043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:52.163688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:52.186254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:52.187467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:52.189600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:52.190381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:52.465680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:52.496050 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c60f64de-4e8b-4678-a158-74a9289a382a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1477 microversion: 2.1 time: 0.342849 Jul 19 20:20:52.496680 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2648/5406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:52 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:53.396298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b2cb3bc6-4028-4569-a137-5ef4f04e5c0a req-23b90bfa-0810-485c-bb2a-aa4397a0d428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b204b6-9583-40ff-a2a0-70b67bd52d47", "name": "network-vif-deleted", "tag": "79f12e60-adfb-46bf-be02-a0deeb7da941"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:53.426982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b2cb3bc6-4028-4569-a137-5ef4f04e5c0a req-23b90bfa-0810-485c-bb2a-aa4397a0d428 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.428844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b2cb3bc6-4028-4569-a137-5ef4f04e5c0a req-23b90bfa-0810-485c-bb2a-aa4397a0d428 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:53.460683 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b2cb3bc6-4028-4569-a137-5ef4f04e5c0a req-23b90bfa-0810-485c-bb2a-aa4397a0d428 service nova] Creating event network-vif-deleted:79f12e60-adfb-46bf-be02-a0deeb7da941 for instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 on n-h1-843834-3 Jul 19 20:20:53.481146 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b2cb3bc6-4028-4569-a137-5ef4f04e5c0a req-23b90bfa-0810-485c-bb2a-aa4397a0d428 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090182 Jul 19 20:20:53.482296 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2759/5407] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:53.526811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:53.527746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:53.553434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.562265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:53.564235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.568810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:53.683156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:53.683948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:53.689340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lazy-loading 'fault' on Instance uuid f5b204b6-9583-40ff-a2a0-70b67bd52d47 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:20:53.821334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:20:53.836318 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-918d221f-7b87-435d-82ed-f33c88d6f2e5 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 200 len: 1330 microversion: 2.1 time: 0.313612 Jul 19 20:20:53.849601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2649/5408] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:53 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 1330 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:20:54.865471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:54.873338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f5b204b6-9583-40ff-a2a0-70b67bd52d47] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:54.892886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:54.898209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:54.904502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:54.904957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:54.967938 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] HTTP exception thrown: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Request method failure captured: Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 HTTP/1.1 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xGxE6fKMq1xt7_1AscZtf8BG5snPuNIuJm-EgbTrgBKrpAeQwUL5T8OerUIfVI_h3WmmMDyAOcF9_Lcdj8vTOv4dWDnV6UYirnseWGg83DKrhsYZ2R0l8K2EiKBJDIpSWhNjBUYQvbvFUZoeRQ0qChva6Cs_qePEkidl-AFnmdcq6c Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4c41fa9accff44a7967c943efdc72d02 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4c41fa9accff44a7967c943efdc72d02 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestSecurityGroupsBasicOps-1357363623-project Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a213ab5dc97549c4b9c75e6dab1b2de7 Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1357363623-project Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f5b204b6-9583-40ff-a2a0-70b67bd52d47'} Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:20:54.976342 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. Jul 19 20:20:54.981147 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:20:54.987988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Returning 404 to user: Instance f5b204b6-9583-40ff-a2a0-70b67bd52d47 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:20:54.989166 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-395d340e-deb7-4cc4-bd28-46669b58fb18 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47" status: 404 len: 111 microversion: 2.1 time: 0.135861 Jul 19 20:20:54.990061 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2760/5409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:20:54 2022] GET /compute/v2.1/servers/f5b204b6-9583-40ff-a2a0-70b67bd52d47 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:20:56.361908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:56.363109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:20:56.387383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:56.388636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:56.391770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:56.394322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:56.524233 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3ccc3762-9777-4627-a7dc-b685963cf317 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/ips" status: 200 len: 151 microversion: 2.1 time: 0.166255 Jul 19 20:20:56.529487 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2650/5410] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:20:56 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/ips => generated 151 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:59.031940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:20:59.032914 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:20:59.032914 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:20:59.034170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:59.034637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:59.035548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:20:59.036002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:20:59.102513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa3aefa4-1262-4ad4-a946-b5f160f31980 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.301183 Jul 19 20:20:59.103800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2761/5411] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Jul 19 20:20:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:20:59.331391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2052495965", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "availability_zone": "nova:n-h1-843834-3", "networks": [{"uuid": "10f59dd8-78bf-4845-a4ee-6f8a6f29fe53"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:20:59.494233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] validate_networks() for [('10f59dd8-78bf-4845-a4ee-6f8a6f29fe53', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:21:00.681558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0f3f10-72ec-419d-8a61-9b19003e5798"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:00.682655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:00.710805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:00.711583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:00.715732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:00.716423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:00.762163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:21:00.762820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:21:00.763443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:21:00.764957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:21:00.765736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:21:00.807063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:00.809739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:00.811719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=63 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:00.813096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:00.813730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:00.891395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Getting quotas for project 7afa15d1814948b29ed2c92f698b2116. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:00.914061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Getting quotas for user 21f78a49a83040ea837b87ddcc9284ee and project 7afa15d1814948b29ed2c92f698b2116. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:00.972805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:21:00.986848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:21:01.153254 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b64530c-280f-418b-ac86-7e04d5ffabcc tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827406 Jul 19 20:21:01.154052 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2651/5412] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:20:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:21:01.185124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9761a81-1598-4c00-a657-d2a0d3d17e79 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:01.188471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9761a81-1598-4c00-a657-d2a0d3d17e79 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:01.417046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-135e27d9-7001-42ea-8c2e-36bf93ce9dac tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739227 Jul 19 20:21:01.419613 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9761a81-1598-4c00-a657-d2a0d3d17e79 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1329 microversion: 2.1 time: 0.258195 Jul 19 20:21:01.425379 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2762/5413] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:21:00 2022] POST /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:01.451521 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2652/5414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:01 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1329 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:02.453916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:02.457739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:02.463856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:02.481003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:02.483009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:02.484079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:02.487366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:03.095456 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dae4a73-b180-4540-a47b-84fe0d23dc69 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1346 microversion: 2.1 time: 0.652312 Jul 19 20:21:03.115796 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2763/5415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:02 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1346 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:04.131699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:04.132315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:04.135604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:04.148615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:04.149239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:04.150163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:04.163898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:04.169713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:04.559984 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3f4774ca-36b0-48f2-8fc1-2de4182ef965 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1422 microversion: 2.1 time: 0.431568 Jul 19 20:21:04.568235 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2653/5416] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:04 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1422 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:05.587603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:05.590168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:05.604519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:05.607885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:05.616048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:05.630825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:06.269228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32f44c29-777e-4a8d-8644-9ae298a109e4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1422 microversion: 2.1 time: 0.685683 Jul 19 20:21:06.283131 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2764/5417] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:05 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1422 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:07.289741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:07.290382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:07.304694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:07.315771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:07.316942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:07.317556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:08.470641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d84f6339-6a25-4480-8174-30aec1776f68 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 1.185464 Jul 19 20:21:08.481477 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2654/5418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:07 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:09.503590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:09.505021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:09.509819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:09.524102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:09.525138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:09.526487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:09.527357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.278205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:10.279492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:10.290497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.291206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.292526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.293137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.370318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:21:10.388032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ad4833f-f8b5-45fa-8f6d-04d6533425a1 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.889759 Jul 19 20:21:10.395821 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2765/5419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:09 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:10.436809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-44230912-eed5-4ce1-8b91-1e08ac039f1c req-e772ab03-def6-4c0a-ba4e-df7520378728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09c6545-a3ff-4c40-87d7-02c29aea286b", "tag": "4dd17dd2-4be2-42d9-bbb6-066d7e521bbe"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:10.452098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-44230912-eed5-4ce1-8b91-1e08ac039f1c req-e772ab03-def6-4c0a-ba4e-df7520378728 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.464673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-44230912-eed5-4ce1-8b91-1e08ac039f1c req-e772ab03-def6-4c0a-ba4e-df7520378728 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.479931 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-51d5bcdf-00b4-43ac-989d-7affed6dcc16 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 204 len: 0 microversion: 2.1 time: 0.205850 Jul 19 20:21:10.486779 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2655/5420] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:21:10 2022] DELETE /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:21:10.497551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:10.498892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:10.509404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.510182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.511282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:10.512032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:10.520728 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-44230912-eed5-4ce1-8b91-1e08ac039f1c req-e772ab03-def6-4c0a-ba4e-df7520378728 service nova] Creating event network-changed:4dd17dd2-4be2-42d9-bbb6-066d7e521bbe for instance f09c6545-a3ff-4c40-87d7-02c29aea286b on n-h2-843834-3 Jul 19 20:21:10.550165 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-44230912-eed5-4ce1-8b91-1e08ac039f1c req-e772ab03-def6-4c0a-ba4e-df7520378728 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101259 Jul 19 20:21:10.553113 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2766/5421] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:10.840675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:11.150834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:11.163441 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5093876f-0778-464e-bc10-af7b23fc0acd tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1767 microversion: 2.1 time: 0.672719 Jul 19 20:21:11.170084 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2656/5422] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:10 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1767 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:11.415782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:11.417107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:11.442098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:11.445574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:11.446735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:11.449587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:12.182263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:12.182884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:12.190220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:12.211429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:12.212946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:12.214025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:12.214538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:12.920306 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1814d867-5e11-4943-9e90-c116440b7d9d tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 1.510404 Jul 19 20:21:12.931631 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2767/5423] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:11 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:12.940108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-86824e44-feb8-433c-89b4-1b4d9651baf0 req-88d60ab0-624e-4ae0-a87a-450b611e2dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c7fd780-36ed-4822-8081-5a75b78b0c24", "tag": "7b076ba1-f446-4d51-a0a6-2b3a1810faf1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:12.949725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-86824e44-feb8-433c-89b4-1b4d9651baf0 req-88d60ab0-624e-4ae0-a87a-450b611e2dcc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:12.950599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-86824e44-feb8-433c-89b4-1b4d9651baf0 req-88d60ab0-624e-4ae0-a87a-450b611e2dcc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:12.969350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-86824e44-feb8-433c-89b4-1b4d9651baf0 req-88d60ab0-624e-4ae0-a87a-450b611e2dcc service nova] Creating event network-changed:7b076ba1-f446-4d51-a0a6-2b3a1810faf1 for instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 on n-h1-843834-3 Jul 19 20:21:12.976756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-86824e44-feb8-433c-89b4-1b4d9651baf0 req-88d60ab0-624e-4ae0-a87a-450b611e2dcc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042678 Jul 19 20:21:12.977660 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2768/5424] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:13.249744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:13.269392 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2c44403d-8bc9-4d0e-b096-0ec555f58fc2 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1767 microversion: 2.1 time: 1.089767 Jul 19 20:21:13.271949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2657/5425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:12 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1767 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:13.945252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:13.947454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:13.961665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:13.963335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:13.965100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:13.966371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.292230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:14.293078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:14.314206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.314683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.315500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:14.315937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:14.672407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a213ab5dc97549c4b9c75e6dab1b2de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c41fa9accff44a7967c943efdc72d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:14.689777 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3614f275-6f28-4e77-9576-bd3e5037c0e7 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 200 len: 1529 microversion: 2.1 time: 0.404368 Jul 19 20:21:14.690670 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2658/5426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:14 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 1529 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:14.824076 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-66f71d07-0c6c-4ad3-9150-456b6adb5944 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.882765 Jul 19 20:21:14.826075 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2769/5427] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:13 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:15.018544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ec46bc29-dabe-445b-a577-c0d5e52de4ff req-646bc210-3ab5-4d3e-8c8e-63906849c725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09c6545-a3ff-4c40-87d7-02c29aea286b", "name": "network-vif-deleted", "tag": "4dd17dd2-4be2-42d9-bbb6-066d7e521bbe"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:15.050955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ec46bc29-dabe-445b-a577-c0d5e52de4ff req-646bc210-3ab5-4d3e-8c8e-63906849c725 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.054491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ec46bc29-dabe-445b-a577-c0d5e52de4ff req-646bc210-3ab5-4d3e-8c8e-63906849c725 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.069892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ec46bc29-dabe-445b-a577-c0d5e52de4ff req-646bc210-3ab5-4d3e-8c8e-63906849c725 service nova] Creating event network-vif-deleted:4dd17dd2-4be2-42d9-bbb6-066d7e521bbe for instance f09c6545-a3ff-4c40-87d7-02c29aea286b on n-h2-843834-3 Jul 19 20:21:15.077380 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ec46bc29-dabe-445b-a577-c0d5e52de4ff req-646bc210-3ab5-4d3e-8c8e-63906849c725 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063457 Jul 19 20:21:15.079175 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2659/5428] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:15.718238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:15.720489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] [instance: f09c6545-a3ff-4c40-87d7-02c29aea286b] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:15.736882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.737804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.740526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.741757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.772675 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] HTTP exception thrown: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Request method failure captured: Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b HTTP/1.1 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xGxE6fKMq1xt7_1AscZtf8BG5snPuNIuJm-EgbTrgBKrpAeQwUL5T8OerUIfVI_h3WmmMDyAOcF9_Lcdj8vTOv4dWDnV6UYirnseWGg83DKrhsYZ2R0l8K2EiKBJDIpSWhNjBUYQvbvFUZoeRQ0qChva6Cs_qePEkidl-AFnmdcq6c Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4c41fa9accff44a7967c943efdc72d02 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c41fa9accff44a7967c943efdc72d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4c41fa9accff44a7967c943efdc72d02 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1357363623 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestSecurityGroupsBasicOps-1357363623-project Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a213ab5dc97549c4b9c75e6dab1b2de7 Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1357363623-project Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f09c6545-a3ff-4c40-87d7-02c29aea286b'} Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:15.775877 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Returning 404 to user: Instance f09c6545-a3ff-4c40-87d7-02c29aea286b could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d56ea1ed-8d73-42fa-93a5-94f1a6d3f7c3 tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b" status: 404 len: 111 microversion: 2.1 time: 0.069156 Jul 19 20:21:15.787465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2770/5429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:15 2022] GET /compute/v2.1/servers/f09c6545-a3ff-4c40-87d7-02c29aea286b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:21:15.854303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:15.855961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:15.865628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.866464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:15.868132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:15.868868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:16.378227 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e13aee73-393e-408d-9c79-61552be7699c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.532523 Jul 19 20:21:16.382214 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2660/5430] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:15 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:17.402022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:17.403559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:17.425707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:17.426533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:17.427668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:17.428315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:17.790739 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cb0317a7-5fd3-4e81-a373-36b2d977b028 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.394666 Jul 19 20:21:17.792010 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2771/5431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:17 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:18.810542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:18.812270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:18.838442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:18.849450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:18.850200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:18.850686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:19.238529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6da7bc1a-30ab-46c3-bb0a-3c01751bd336 req-5a5505ed-c9c5-4e97-a24d-12586ff40ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7fd780-36ed-4822-8081-5a75b78b0c24", "name": "network-vif-plugged", "status": "completed", "tag": "7b076ba1-f446-4d51-a0a6-2b3a1810faf1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:19.259641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6da7bc1a-30ab-46c3-bb0a-3c01751bd336 req-5a5505ed-c9c5-4e97-a24d-12586ff40ee5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:19.260395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6da7bc1a-30ab-46c3-bb0a-3c01751bd336 req-5a5505ed-c9c5-4e97-a24d-12586ff40ee5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:19.295082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6da7bc1a-30ab-46c3-bb0a-3c01751bd336 req-5a5505ed-c9c5-4e97-a24d-12586ff40ee5 service nova] Creating event network-vif-plugged:7b076ba1-f446-4d51-a0a6-2b3a1810faf1 for instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 on n-h1-843834-3 Jul 19 20:21:19.302682 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6da7bc1a-30ab-46c3-bb0a-3c01751bd336 req-5a5505ed-c9c5-4e97-a24d-12586ff40ee5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.462158 Jul 19 20:21:19.305003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2772/5432] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:19.512521 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fbcb1190-7a54-4e95-a116-cc496f133469 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.706997 Jul 19 20:21:19.515762 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2661/5433] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:18 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:20.371817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0f3f10-72ec-419d-8a61-9b19003e5798"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:20.376092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:20.397974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.398360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.399816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.400539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.532746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:20.533365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:20.547425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.547879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.548972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.549455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.583596 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments HTTP/1.1 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 74 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: {"volumeAttachment": {"volumeId": "1f0f3f10-72ec-419d-8a61-9b19003e5798"}} Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '90051f31-e621-44ad-aff2-bab0159dd0bd', 'body': {'volumeAttachment': {'volumeId': '1f0f3f10-72ec-419d-8a61-9b19003e5798'}}} Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:21:20.585454 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd Jul 19 20:21:20.590084 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:20.592880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 400 to user: Invalid volume: volume 1f0f3f10-72ec-419d-8a61-9b19003e5798 is already attached to instances: 90051f31-e621-44ad-aff2-bab0159dd0bd {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:21:20.596103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-52ad0bf8-77dc-416a-95ae-683afcb3dcc2 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.232459 Jul 19 20:21:20.596957 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2773/5434] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:21:20 2022] POST /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 174 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:21:20.715117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:20.715637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:20.745169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.745654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.746485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:20.750835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:20.966958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lazy-loading 'services' on Instance uuid 90051f31-e621-44ad-aff2-bab0159dd0bd {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:21:21.150949 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ae8af71-b005-44de-8d25-3e8145038747 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1464 microversion: 2.1 time: 0.615151 Jul 19 20:21:21.161724 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2662/5435] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:20 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1464 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:21.194805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a68a2e96-0f97-4b1b-8c54-ffdfa5fc7049 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments/1f0f3f10-72ec-419d-8a61-9b19003e5798" status: 202 len: 0 microversion: 2.1 time: 0.489020 Jul 19 20:21:21.195651 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2774/5436] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:21:20 2022] DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments/1f0f3f10-72ec-419d-8a61-9b19003e5798 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:21:21.208545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:21.211384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:21.224592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:21.225793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:21.228186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:21.229047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:21.314656 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-713e8018-bdf2-47c3-b963-9c3e727e2022 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113747 Jul 19 20:21:21.315335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2663/5437] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:21 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:22.175106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:22.175920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:22.184379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.184935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.185819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.186339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.333271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:22.334962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:22.361530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.362386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.376519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.377542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.467008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb8a18ed-f7de-4eb5-9b6c-75b1547e3c11 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142915 Jul 19 20:21:22.468040 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2664/5438] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:22 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:22.617483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f598d593-d7c6-4fae-ba72-e549a24e3fb4 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1648 microversion: 2.1 time: 0.451031 Jul 19 20:21:22.618282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2775/5439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:22 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1648 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:22.755071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:22.757117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:22.764925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.766994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:22.768235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:22.769208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.378215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d6b566f4-4630-4e16-9a27-4994ef941cb6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1648 microversion: 2.1 time: 0.627402 Jul 19 20:21:23.398848 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2665/5440] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:22 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1648 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:23.423099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:23.427252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:23.450275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.451933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.454220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.455625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.485236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:23.487022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:23.513338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.514088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.515533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:23.516379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:23.624425 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d104a728-c1e9-4bbc-8e9f-0b9e6a834c5b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147722 Jul 19 20:21:23.629234 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2666/5441] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:23 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:24.642797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:24.644184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:24.656940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:24.664415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:24.665512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:24.666377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:24.743948 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2c40c801-4e67-46f7-afd2-2269e7630db3 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105275 Jul 19 20:21:24.745088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2667/5442] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:24 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:24.853802 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d793455-4358-46a5-a3f2-d70c2bafe0f2 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1648 microversion: 2.1 time: 1.443387 Jul 19 20:21:24.855501 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2776/5443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:23 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1648 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:25.183883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-346282634", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "availability_zone": "nova:n-h2-843834-3", "networks": [{"uuid": "10f59dd8-78bf-4845-a4ee-6f8a6f29fe53"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:25.363373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] validate_networks() for [('10f59dd8-78bf-4845-a4ee-6f8a6f29fe53', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:21:25.769268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:25.770587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:25.789388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:25.789863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:25.791045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:25.791506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:25.886140 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a2da2bc-cc32-4c5f-bec8-c55941287014 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121699 Jul 19 20:21:25.891456 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2777/5444] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:25 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:26.624054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56c833bd-9ad6-4b73-8a48-e25cb698f41a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] Calling method '.version_select at 0x7f23ee1e0940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:26.632255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:21:26.633281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:21:26.634307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:21:26.635142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:21:26.635846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:21:26.657524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:26.661843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:26.664401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:26.665302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:26.674713 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56c833bd-9ad6-4b73-8a48-e25cb698f41a tempest-TestSecurityGroupsBasicOps-1357363623 tempest-TestSecurityGroupsBasicOps-1357363623-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-466787029" status: 202 len: 0 microversion: 2.1 time: 0.055112 Jul 19 20:21:26.676062 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2778/5445] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-466787029 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:21:26.762613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Getting quotas for project 7afa15d1814948b29ed2c92f698b2116. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:26.777132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Getting quotas for user 21f78a49a83040ea837b87ddcc9284ee and project 7afa15d1814948b29ed2c92f698b2116. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:26.833666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:21:26.845343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:21:26.922883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:26.928222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:26.953216 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-125ceec3-e673-416a-9e6f-504190ac1378 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775055 Jul 19 20:21:26.954099 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2668/5446] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:21:26.964661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:26.966009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:26.969191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b3eb4c1-baa6-4dea-8313-f80c918f643c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:26.972539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b3eb4c1-baa6-4dea-8313-f80c918f643c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:26.973943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:26.976085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:27.064715 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-22786379-f775-4424-8d07-7a6a64c2800c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165954 Jul 19 20:21:27.072014 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2779/5447] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:26 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:27.132080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b3eb4c1-baa6-4dea-8313-f80c918f643c tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1328 microversion: 2.1 time: 0.170109 Jul 19 20:21:27.151033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2669/5448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:26 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:28.085320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:28.089714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:28.107165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:28.109189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.111737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:28.113126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.156266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:28.160021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:28.205250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:28.211517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.214827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:28.220849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:28.276763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:28.292538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:28.297584 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14b40058-65ff-4960-b8d0-ebf9003c742a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221416 Jul 19 20:21:28.299680 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2780/5449] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:28 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:28.434147 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df08517e-949b-4a1b-9f97-215042b5ea84 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1345 microversion: 2.1 time: 0.287338 Jul 19 20:21:28.434761 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2670/5450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:28 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:29.315078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:29.316817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:29.338119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:29.338994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:29.343273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:29.344125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:29.450295 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d87aef9a-ca14-4fd1-8a84-b5d2409fd1b7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142311 Jul 19 20:21:29.452912 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2781/5451] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:29 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:29.456030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:29.457119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:29.485613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:29.486758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:29.495814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:29.496878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:30.111992 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-31d4318a-ee0e-4a2c-bd15-946d64f93b98 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1421 microversion: 2.1 time: 0.647353 Jul 19 20:21:30.113200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2671/5452] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:29 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1421 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:30.469248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:30.473431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:30.508695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:30.509473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:30.521511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:30.522375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:30.669853 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1dbd20e-4df1-4ce9-aa27-2ff4954c12fc tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202172 Jul 19 20:21:30.671438 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2782/5453] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:30 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:31.154292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:31.160651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:31.184691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.187271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.189439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.192224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.683425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:31.684563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:31.701477 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d3644175-7e84-4bb8-841a-5c346236c828 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.554183 Jul 19 20:21:31.703321 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2672/5454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:31 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:31.722154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.724523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.727772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.728689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.803937 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f64233cb-9409-477b-b674-58a9ea29e165 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125644 Jul 19 20:21:31.804569 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2783/5455] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:21:31 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:21:31.892704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:31.894029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:31.905915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.907114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.908950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:31.909986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:31.958408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:21:32.146148 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-82d66eaf-fa4c-4f31-a74d-348256f2eddd tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 204 len: 0 microversion: 2.1 time: 0.261113 Jul 19 20:21:32.151872 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2673/5456] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:21:31 2022] DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:21:32.172240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:32.180130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:32.197394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.198503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.200265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.202140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.481314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5226b7dc-2f4e-425a-92a9-fafbbaa759b4 req-253c4301-8c41-43d7-ae4c-9782efa43cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da8b622-a2f0-4c3f-9239-e68b3a8c22c1", "tag": "2d457f15-f6d4-457e-b065-395c5b3e5e61"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:32.500634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5226b7dc-2f4e-425a-92a9-fafbbaa759b4 req-253c4301-8c41-43d7-ae4c-9782efa43cd0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.501689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5226b7dc-2f4e-425a-92a9-fafbbaa759b4 req-253c4301-8c41-43d7-ae4c-9782efa43cd0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.521244 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5226b7dc-2f4e-425a-92a9-fafbbaa759b4 req-253c4301-8c41-43d7-ae4c-9782efa43cd0 service nova] Creating event network-changed:2d457f15-f6d4-457e-b065-395c5b3e5e61 for instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 on n-h2-843834-3 Jul 19 20:21:32.528429 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5226b7dc-2f4e-425a-92a9-fafbbaa759b4 req-253c4301-8c41-43d7-ae4c-9782efa43cd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057460 Jul 19 20:21:32.530193 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2674/5457] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:32.593518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:32.610185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7d26dbae-3e66-4536-a2f1-4b7a4fddf2f9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1682 microversion: 2.1 time: 0.455844 Jul 19 20:21:32.615151 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2784/5458] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:32 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1682 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:32.723991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:32.724891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:32.733609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.734776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:32.735725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:32.736171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:33.126782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44094311-0c24-428e-a43d-1072a88a0512 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.404548 Jul 19 20:21:33.127616 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2675/5459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:32 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:33.635008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:33.636038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:33.643186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:33.659534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:33.664351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:33.666363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:33.667574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:34.106290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:34.149920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:34.152352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:34.155616 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9d1b0e3-75b0-43e2-968f-038304be9beb tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1682 microversion: 2.1 time: 0.521626 Jul 19 20:21:34.160156 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2785/5460] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:33 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1682 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:34.165540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:34.166003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:34.167011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:34.167809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:34.774955 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-70cb2b57-e4a3-4e62-a975-0014b84ac139 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.629659 Jul 19 20:21:34.782221 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2676/5461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:34 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:35.204137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:35.206881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:35.219719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.220174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:35.231169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.232071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:35.802112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:35.805084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:35.821971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:35.834814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.837676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:35.841379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:35.842276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:36.704658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:36.932254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:36.943124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fffe0144-e4ab-4aa0-a8a4-38c504401d57 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1682 microversion: 2.1 time: 1.767203 Jul 19 20:21:36.953809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2786/5462] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:35 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1682 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:37.131009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:37.265846 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be86ca8f-df25-4579-bf36-a0b158e2eaac tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 1.470513 Jul 19 20:21:37.270654 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2677/5463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:35 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:37.868886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-85d2017b-fccd-475b-9038-bcd4be92ba73 req-63f0914f-5e7a-49f7-ad0e-0e4dcbe8171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90051f31-e621-44ad-aff2-bab0159dd0bd", "name": "network-vif-deleted", "tag": "c7378819-1537-4649-8f71-70f280c6914f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:37.898438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85d2017b-fccd-475b-9038-bcd4be92ba73 req-63f0914f-5e7a-49f7-ad0e-0e4dcbe8171e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:37.898990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85d2017b-fccd-475b-9038-bcd4be92ba73 req-63f0914f-5e7a-49f7-ad0e-0e4dcbe8171e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:37.918845 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-85d2017b-fccd-475b-9038-bcd4be92ba73 req-63f0914f-5e7a-49f7-ad0e-0e4dcbe8171e service nova] Creating event network-vif-deleted:c7378819-1537-4649-8f71-70f280c6914f for instance 90051f31-e621-44ad-aff2-bab0159dd0bd on n-h1-843834-3 Jul 19 20:21:37.957320 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-85d2017b-fccd-475b-9038-bcd4be92ba73 req-63f0914f-5e7a-49f7-ad0e-0e4dcbe8171e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096479 Jul 19 20:21:37.960340 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2787/5464] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 19 20:21:37.967003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:37.967744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:37.991974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:37.992534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.001578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:38.002162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.113909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:38.114622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.117245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lazy-loading 'fault' on Instance uuid 90051f31-e621-44ad-aff2-bab0159dd0bd {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:21:38.178465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:38.190874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c92b6be3-5dcb-4889-87fa-7d05f5584ff9 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 200 len: 1330 microversion: 2.1 time: 0.232750 Jul 19 20:21:38.192204 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2678/5465] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:37 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 1330 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:38.285628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:38.286359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:38.301502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:38.301972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.302804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:38.303426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:38.622329 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-179ff69b-69d7-4c98-a119-31d2f8a66794 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.342200 Jul 19 20:21:38.623896 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2788/5466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:38 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:39.213190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:39.213975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:39.235127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.237469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:39.238787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.239274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:39.291190 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd HTTP/1.1 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '90051f31-e621-44ad-aff2-bab0159dd0bd'} Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:39.293187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-275b5382-989c-45d9-99f2-35aa49ad3941 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 404 len: 111 microversion: 2.1 time: 0.086675 Jul 19 20:21:39.298120 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2679/5467] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:39 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:21:39.308043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-286df3d0-5885-45fa-856d-1e4a68aa672e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '.version_select at 0x7f23eec283a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:39.338040 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-286df3d0-5885-45fa-856d-1e4a68aa672e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816552407" status: 202 len: 0 microversion: 2.1 time: 0.035118 Jul 19 20:21:39.339268 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2789/5468] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816552407 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:21:39.681565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:39.698813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:39.714876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.715819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:39.721804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:39.722614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:40.157235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5032f248-92f4-4337-92b6-9b2dc5521f54 req-03069633-bbb1-4b63-887a-5b6758fecb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da8b622-a2f0-4c3f-9239-e68b3a8c22c1", "name": "network-vif-plugged", "status": "completed", "tag": "2d457f15-f6d4-457e-b065-395c5b3e5e61"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:40.182568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5032f248-92f4-4337-92b6-9b2dc5521f54 req-03069633-bbb1-4b63-887a-5b6758fecb41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:40.182872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5032f248-92f4-4337-92b6-9b2dc5521f54 req-03069633-bbb1-4b63-887a-5b6758fecb41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:40.219722 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5032f248-92f4-4337-92b6-9b2dc5521f54 req-03069633-bbb1-4b63-887a-5b6758fecb41 service nova] Creating event network-vif-plugged:2d457f15-f6d4-457e-b065-395c5b3e5e61 for instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 on n-h2-843834-3 Jul 19 20:21:40.263029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5032f248-92f4-4337-92b6-9b2dc5521f54 req-03069633-bbb1-4b63-887a-5b6758fecb41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107801 Jul 19 20:21:40.268438 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2790/5469] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:40.460795 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-277878d1-d61e-4534-9981-a7b3cb03c2c0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.814834 Jul 19 20:21:40.461663 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2680/5470] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:39 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:41.506381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:41.509786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:41.538462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:41.541197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:41.543057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:41.544137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:41.612328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-548bc0da-8634-4ed1-a00f-321fe7b6b93a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: .version_select at 0x7f23eeab48b0>, body: {"keypair": {"name": "tempest-keypair-1297845442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrP8cR0B3GUQxY6FvUzArZcSh7ddguztPCHq4mmScPDL6oTjRa/sTGGTR9A+vZNkfaQUYu7/wzZka5bOyk+V8oYJ8kZQrvMVHKmQ57F+SxJgMoawJa1pg7f/LlvjbTA4Q=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:41.681343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-548bc0da-8634-4ed1-a00f-321fe7b6b93a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:41.711753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-548bc0da-8634-4ed1-a00f-321fe7b6b93a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:41.818488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-548bc0da-8634-4ed1-a00f-321fe7b6b93a tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217900 Jul 19 20:21:41.819920 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2681/5471] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:21:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:41.964058 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e562d677-a460-4e38-b458-4f428b659801 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1463 microversion: 2.1 time: 0.481062 Jul 19 20:21:41.968262 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2791/5472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:41 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1463 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:42.989378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:42.990474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:43.021241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.022255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.031750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.034548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.363960 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a0e1abae-1651-43ae-bbec-5a86f3e68968 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1646 microversion: 2.1 time: 0.383138 Jul 19 20:21:43.364662 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2682/5473] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:42 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1646 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:43.391961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:43.393002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:43.406462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.407007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.408038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.408612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.751474 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a5116ee-9f1e-4f38-ba55-5c26b0ed4539 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1646 microversion: 2.1 time: 0.367072 Jul 19 20:21:43.753843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2792/5474] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:43 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1646 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:43.786496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:43.793381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:43.829777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.830619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:43.840559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:43.841698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.105150 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-193388b2-f096-493f-9732-37ac29e17885 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1646 microversion: 2.1 time: 0.326776 Jul 19 20:21:44.138387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:44.139643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:44.149470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2683/5475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:43 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1646 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:44.154189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.155613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.159134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.159898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.208322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:21:44.339929 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c7ae23fb-91b9-4ade-ba11-bd373bf574ce tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 204 len: 0 microversion: 2.1 time: 0.207289 Jul 19 20:21:44.341411 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2793/5476] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:21:44 2022] DELETE /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:21:44.354156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:44.356025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:44.371455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.373318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.396407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:44.437381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:44.818706 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-94cc0b63-38c2-475f-a87a-d56984d7dade tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1652 microversion: 2.1 time: 0.471630 Jul 19 20:21:44.824792 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2684/5477] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:44 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1652 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:45.281630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1437816230", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d951e469-ec97-4bb2-a85a-d97852653bf0"}], "security_groups": [{"name": "tempest-securitygroup--708151367"}], "key_name": "tempest-keypair-1297845442", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:45.587923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] validate_networks() for [('d951e469-ec97-4bb2-a85a-d97852653bf0', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:21:45.841123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:45.842125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:45.863582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:45.864037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:45.867090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:45.867782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:47.438211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5195c6e6-09da-470e-9bf7-7b38b1e58a12 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1652 microversion: 2.1 time: 1.596016 Jul 19 20:21:47.440556 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2685/5478] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:45 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1652 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:48.488286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:48.491049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:48.532243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:48.548007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:48.565917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:48.570624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:49.003691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99e11e9d-1941-4182-860b-f18f231d8406 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 200 len: 1610 microversion: 2.1 time: 0.532297 Jul 19 20:21:49.020507 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2686/5479] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:48 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 1610 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:49.026487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9b07b78f-d9c4-4604-b9c6-e234411be5e0 req-beee18fc-2b41-4e2a-a00c-5ea528855a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da8b622-a2f0-4c3f-9239-e68b3a8c22c1", "name": "network-vif-deleted", "tag": "2d457f15-f6d4-457e-b065-395c5b3e5e61"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:49.037287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9b07b78f-d9c4-4604-b9c6-e234411be5e0 req-beee18fc-2b41-4e2a-a00c-5ea528855a18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:49.038156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9b07b78f-d9c4-4604-b9c6-e234411be5e0 req-beee18fc-2b41-4e2a-a00c-5ea528855a18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:49.055674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9b07b78f-d9c4-4604-b9c6-e234411be5e0 req-beee18fc-2b41-4e2a-a00c-5ea528855a18 service nova] Creating event network-vif-deleted:2d457f15-f6d4-457e-b065-395c5b3e5e61 for instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 on n-h2-843834-3 Jul 19 20:21:49.067394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9b07b78f-d9c4-4604-b9c6-e234411be5e0 req-beee18fc-2b41-4e2a-a00c-5ea528855a18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045115 Jul 19 20:21:49.070572 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2687/5480] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:21:49.173774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:21:49.176088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:21:49.176895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:21:49.177508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:21:49.178281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:21:49.243441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:49.244820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:49.248462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:49.249793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:49.304658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:49.339128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Getting quotas for user 381238cd67a6421eab8ba961b1fb0978 and project dce188bd2cea4346adc79344f0c87b18. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:49.413529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:21:49.426267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:21:49.626259 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-292fd3f9-94b7-4000-83fe-5702d6415d9d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.351000 Jul 19 20:21:49.628197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2794/5481] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:21:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 4360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:21:49.645293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5116c5ca-66a9-4cdd-b06b-b1952fa00bf8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:49.647679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5116c5ca-66a9-4cdd-b06b-b1952fa00bf8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:49.988177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5116c5ca-66a9-4cdd-b06b-b1952fa00bf8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:50.031901 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5116c5ca-66a9-4cdd-b06b-b1952fa00bf8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1242 microversion: 2.1 time: 0.387756 Jul 19 20:21:50.032883 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2688/5482] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:49 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1242 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:50.034946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:50.043687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:50.081070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.084251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:50.088998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.090944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:50.168127 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] HTTP exception thrown: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Request method failure captured: Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 HTTP/1.1 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xIq_z8rxESj8MiioNY00IleWvTvP8E5RW5-q5L1jhxGpV_JvX5XxrStxvA8uSeS0ZQGzBjwIMu_dAspgGdMjqBvSbeNpkGq-Vv0Kd2ZaVOoqsnByTuQuylZDO4J8KoWY8S14YfLtnwGxF3irxYg7dL1da4mkOkFq7c91xSpYS0tfFU Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 7afa15d1814948b29ed2c92f698b2116 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestServerMultinode-2081379032 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestServerMultinode-2081379032 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 7afa15d1814948b29ed2c92f698b2116 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestServerMultinode-2081379032 Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestServerMultinode-2081379032-project-admin Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 21f78a49a83040ea837b87ddcc9284ee Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestServerMultinode-2081379032-project-admin Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1da8b622-a2f0-4c3f-9239-e68b3a8c22c1'} Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:50.182100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. Jul 19 20:21:50.193980 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:21:50.207792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Returning 404 to user: Instance 1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:21:50.209866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c29207bd-75e6-4764-910d-001218ad28b3 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1" status: 404 len: 111 microversion: 2.1 time: 0.184648 Jul 19 20:21:50.222720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2795/5483] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:50 2022] GET /compute/v2.1/servers/1da8b622-a2f0-4c3f-9239-e68b3a8c22c1 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:21:50.228566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:50.229393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:50.274969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.280712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:50.282335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.283057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:50.303470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:50.411498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:21:50.638274 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3121e942-b834-459e-ad0a-47a76628a364 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 204 len: 0 microversion: 2.1 time: 0.413180 Jul 19 20:21:50.651628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2689/5484] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:21:50 2022] DELETE /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:21:50.672231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:50.677572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:50.707044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.719976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:50.721304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:50.721982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:51.072607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:51.076292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:51.120715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:51.122112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:51.124862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:51.125934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:51.311930 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8945453c-f8aa-4fa4-81d5-3fe13f13f7f6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1654 microversion: 2.1 time: 0.654234 Jul 19 20:21:51.319108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2796/5485] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:50 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1654 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:51.471483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:51.489667 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a203429-5ae4-469d-9e1d-800a4aa17cab tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1246 microversion: 2.1 time: 0.431645 Jul 19 20:21:51.496371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2690/5486] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:51 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1246 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:52.343707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:52.344934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:52.366561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.367911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.370315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.371538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.525390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:52.528324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:52.552263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.555881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.574969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:52.576126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:52.884277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:52.937543 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67714046-1043-4cf8-87f6-c59440e0c138 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1300 microversion: 2.1 time: 0.415355 Jul 19 20:21:52.941304 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2691/5487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:52 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1300 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:53.233485 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-19199291-2396-4b42-8cb4-a6d2b4536030 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1654 microversion: 2.1 time: 0.896536 Jul 19 20:21:53.236200 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2797/5488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:52 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1654 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:21:53.961427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:53.970072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:53.998636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:54.000026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:54.007434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:54.008913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:54.227768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:54.240607 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-746ad3d0-fb50-4dc7-a02f-173c63c41a82 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1300 microversion: 2.1 time: 0.286579 Jul 19 20:21:54.242854 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2692/5489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:53 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:54.259257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:54.260993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:54.276199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:54.276710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:54.277985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:54.278456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:54.473871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-15952640-bd9b-445a-a253-38f758666b02 req-6e1f25db-12fe-4a2a-a6a0-2b67cf40ef7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7fd780-36ed-4822-8081-5a75b78b0c24", "name": "network-vif-deleted", "tag": "7b076ba1-f446-4d51-a0a6-2b3a1810faf1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:54.491301 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-872f3aef-8ab9-403a-8869-d3cdb2e691f0 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 200 len: 1612 microversion: 2.1 time: 0.237909 Jul 19 20:21:54.506966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2798/5490] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:54 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 1612 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:54.519385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-15952640-bd9b-445a-a253-38f758666b02 req-6e1f25db-12fe-4a2a-a6a0-2b67cf40ef7e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:54.521659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-15952640-bd9b-445a-a253-38f758666b02 req-6e1f25db-12fe-4a2a-a6a0-2b67cf40ef7e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:54.576170 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-15952640-bd9b-445a-a253-38f758666b02 req-6e1f25db-12fe-4a2a-a6a0-2b67cf40ef7e service nova] Creating event network-vif-deleted:7b076ba1-f446-4d51-a0a6-2b3a1810faf1 for instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 on n-h1-843834-3 Jul 19 20:21:54.600063 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-15952640-bd9b-445a-a253-38f758666b02 req-6e1f25db-12fe-4a2a-a6a0-2b67cf40ef7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135111 Jul 19 20:21:54.606666 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2693/5491] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:55.274106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:55.276387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:55.322209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.329438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.330725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.333626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.419514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:55.519336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:55.519336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] [instance: 5c7fd780-36ed-4822-8081-5a75b78b0c24] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:55.533406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.534423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.579976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:55.581234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:55.636693 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] HTTP exception thrown: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Request method failure captured: Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 HTTP/1.1 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xIq_z8rxESj8MiioNY00IleWvTvP8E5RW5-q5L1jhxGpV_JvX5XxrStxvA8uSeS0ZQGzBjwIMu_dAspgGdMjqBvSbeNpkGq-Vv0Kd2ZaVOoqsnByTuQuylZDO4J8KoWY8S14YfLtnwGxF3irxYg7dL1da4mkOkFq7c91xSpYS0tfFU Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 7afa15d1814948b29ed2c92f698b2116 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestServerMultinode-2081379032 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7afa15d1814948b29ed2c92f698b2116"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestServerMultinode-2081379032 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 7afa15d1814948b29ed2c92f698b2116 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestServerMultinode-2081379032 Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestServerMultinode-2081379032-project-admin Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 21f78a49a83040ea837b87ddcc9284ee Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestServerMultinode-2081379032-project-admin Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '5c7fd780-36ed-4822-8081-5a75b78b0c24'} Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:21:55.641770 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] Returning 404 to user: Instance 5c7fd780-36ed-4822-8081-5a75b78b0c24 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:21:55.652932 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c02165a-f59c-47de-922c-dee141cce7e6 tempest-TestServerMultinode-2081379032 tempest-TestServerMultinode-2081379032-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24" status: 404 len: 111 microversion: 2.1 time: 0.141889 Jul 19 20:21:55.661702 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2694/5492] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:55 2022] GET /compute/v2.1/servers/5c7fd780-36ed-4822-8081-5a75b78b0c24 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:21:56.097980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:56.113615 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6aeeb8da-79d2-42cf-a829-5fece87f7f33 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.849660 Jul 19 20:21:56.115911 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2799/5493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:55 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:57.140799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:57.148919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:57.173801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:57.174786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:57.180305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:57.181307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:57.615671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:57.634135 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3ab51fc3-f2fc-4302-9178-25befd86e5ff tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.501366 Jul 19 20:21:57.636434 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2695/5494] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:57 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:58.004262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-cd4de852-f323-4ae0-a8ff-eff6b0898343 req-46e84c7f-f8ce-46b8-bcbf-e50908683757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4789687-2c3d-4137-b1db-5ccf91c3f385", "tag": "65f04eb8-4d39-4ff2-a461-706940b08a63"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:58.022469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cd4de852-f323-4ae0-a8ff-eff6b0898343 req-46e84c7f-f8ce-46b8-bcbf-e50908683757 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:58.023266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cd4de852-f323-4ae0-a8ff-eff6b0898343 req-46e84c7f-f8ce-46b8-bcbf-e50908683757 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:58.038177 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-cd4de852-f323-4ae0-a8ff-eff6b0898343 req-46e84c7f-f8ce-46b8-bcbf-e50908683757 service nova] Creating event network-changed:65f04eb8-4d39-4ff2-a461-706940b08a63 for instance c4789687-2c3d-4137-b1db-5ccf91c3f385 on n-h2-843834-3 Jul 19 20:21:58.046697 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-cd4de852-f323-4ae0-a8ff-eff6b0898343 req-46e84c7f-f8ce-46b8-bcbf-e50908683757 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051938 Jul 19 20:21:58.056771 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2800/5495] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:21:58.665261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:21:58.666036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:21:58.689436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:58.690736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:58.698618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:21:58.699123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:21:59.033528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:21:59.043319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-967bbcfd-0c14-4bec-8675-e41a13a2e3a1 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.382282 Jul 19 20:21:59.054381 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2696/5496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:21:58 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:21:59.270331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:59.362033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bcb3a9f-418a-43da-a01f-992d782a98a1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Action: 'create', calling method: .version_select at 0x7f23eec28670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-399791663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxawRCLDD+XrqKqVWX7jYwO36BJ1iP5nqFyjHEV4ppZuP7r4Tr+tFKPqtKZcyt7m/lNC16mWF5SffNV4dEQUSVEzzpMHFBFRUfwzJ7fl7Dhvaam/l1hQ3ls99NhuxllAw=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:21:59.377880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:21:59.405560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6bcb3a9f-418a-43da-a01f-992d782a98a1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for project 2ae58fbe35c348f290d04b1a22811516. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:21:59.420658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6bcb3a9f-418a-43da-a01f-992d782a98a1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for user 4cec9320ebcb44f8a1b7ff3053ac854d and project 2ae58fbe35c348f290d04b1a22811516. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:21:59.473369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bcb3a9f-418a-43da-a01f-992d782a98a1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.463342 Jul 19 20:21:59.475392 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2801/5497] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:21:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:00.084325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:00.084962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:00.105688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:00.108027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.111332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:00.112732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:00.115337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:00.899126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:00.914069 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d364ea39-45aa-4e00-a52a-e13a1d73668e tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.833576 Jul 19 20:22:00.927262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2697/5498] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:00 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:01.935470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:01.936990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:01.946575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:01.947646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:01.948735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:01.949361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:02.153668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:02.165538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-566742f5-0c26-4d86-ac61-f721e6c03d25 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.234705 Jul 19 20:22:02.166963 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2802/5499] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:01 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:02.727038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-368463861", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-399791663", "security_groups": [{"name": "tempest-secgroup-smoke-1917103514"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f3fde047-f5b4-4250-a245-63e2f7eafa65"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:02.969631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] validate_networks() for [('f3fde047-f5b4-4250-a245-63e2f7eafa65', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:22:03.200666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:03.204610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:03.233553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.234359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.246867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:03.247444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:03.904129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:03.929182 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9ca14f1-8838-4f7d-9baf-07af0dee0dec tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.737385 Jul 19 20:22:03.930258 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2803/5500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:03 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:04.034132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for project 2ae58fbe35c348f290d04b1a22811516. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:22:04.041635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for user 4cec9320ebcb44f8a1b7ff3053ac854d and project 2ae58fbe35c348f290d04b1a22811516. Resources: dict_keys(['metadata_items']) {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:22:04.075321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:22:04.076176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:22:04.076867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:22:04.077491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:22:04.078327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:22:04.091984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.093008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.094274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.094952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.133639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for project 2ae58fbe35c348f290d04b1a22811516. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:22:04.141745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Getting quotas for user 4cec9320ebcb44f8a1b7ff3053ac854d and project 2ae58fbe35c348f290d04b1a22811516. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:22:04.160690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:22:04.165114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:22:04.236932 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7943fa0b-11ce-4808-919e-83fa8dcf24d8 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.517936 Jul 19 20:22:04.243805 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2698/5501] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:22:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:22:04.262793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61c57dc7-7f86-494f-b941-b26ff6780556 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:04.270188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61c57dc7-7f86-494f-b941-b26ff6780556 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:04.276614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:04.492660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-61c57dc7-7f86-494f-b941-b26ff6780556 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:04.531526 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61c57dc7-7f86-494f-b941-b26ff6780556 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1301 microversion: 2.1 time: 0.285620 Jul 19 20:22:04.533611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2804/5502] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:04 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1301 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:04.608627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-87a2a2f9-7aea-4c6b-af33-2ca9712510ac req-d2e35756-90f0-411b-b053-37f3d9cb4604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4789687-2c3d-4137-b1db-5ccf91c3f385", "name": "network-vif-plugged", "status": "completed", "tag": "65f04eb8-4d39-4ff2-a461-706940b08a63"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:04.679644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87a2a2f9-7aea-4c6b-af33-2ca9712510ac req-d2e35756-90f0-411b-b053-37f3d9cb4604 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.680800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87a2a2f9-7aea-4c6b-af33-2ca9712510ac req-d2e35756-90f0-411b-b053-37f3d9cb4604 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.760380 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-87a2a2f9-7aea-4c6b-af33-2ca9712510ac req-d2e35756-90f0-411b-b053-37f3d9cb4604 service nova] Creating event network-vif-plugged:65f04eb8-4d39-4ff2-a461-706940b08a63 for instance c4789687-2c3d-4137-b1db-5ccf91c3f385 on n-h2-843834-3 Jul 19 20:22:04.770715 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-87a2a2f9-7aea-4c6b-af33-2ca9712510ac req-d2e35756-90f0-411b-b053-37f3d9cb4604 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178206 Jul 19 20:22:04.775076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2699/5503] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:04.950348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:04.951131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:04.971874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.972565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:04.973781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:04.974451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.376117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:05.391085 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b2e527e-fb8d-4c30-a130-536fa2644c30 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1367 microversion: 2.1 time: 0.445828 Jul 19 20:22:05.407669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2805/5504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:04 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:05.556466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:05.558982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:05.626759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:05.629196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.630835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:05.632415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:05.845455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:05.860474 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-356c2878-c303-4f2a-9ae1-0923d751a7c5 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1353 microversion: 2.1 time: 0.313883 Jul 19 20:22:05.871777 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2700/5505] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:05 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1353 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:06.424662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:06.425867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:06.457880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.459305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.463395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.475756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.886980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:06.888380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:06.893002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:06.897661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.898120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.899165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:06.899629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:06.965588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:06.975376 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f7e126b-8344-4d63-ad36-dd8f940231ce tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1558 microversion: 2.1 time: 0.562126 Jul 19 20:22:06.976169 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2806/5506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:06 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1558 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:06.994435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:06.995228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:07.002829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.003862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.004817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:07.005382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:07.093390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:07.103687 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-64486380-c729-4cc6-8bd7-3817d8acb18b tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1359 microversion: 2.1 time: 0.220120 Jul 19 20:22:07.104520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2701/5507] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:06 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:22:07.618433 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bf38f2c7-0340-47e1-aa44-51b0bffbdd8c tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.629494 Jul 19 20:22:07.619560 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2807/5508] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:22:06 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-interface => generated 285 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:22:08.125320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:08.127175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:08.143322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:08.144518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:08.145566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:08.146573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:08.530300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:08.556499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1d3d486-cb0b-48c3-951c-c270c863a490 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1359 microversion: 2.1 time: 0.437538 Jul 19 20:22:08.565260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2702/5509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:08 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:09.589366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:09.591671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:09.606089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.607084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:09.608307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:09.609172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:10.326058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ad9aa801-4ee6-49aa-9842-d1387b2f9151 req-5ea96724-73c2-406d-b93f-f1066079f02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4789687-2c3d-4137-b1db-5ccf91c3f385", "tag": "65f04eb8-4d39-4ff2-a461-706940b08a63"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:10.348201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ad9aa801-4ee6-49aa-9842-d1387b2f9151 req-5ea96724-73c2-406d-b93f-f1066079f02c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:10.349053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ad9aa801-4ee6-49aa-9842-d1387b2f9151 req-5ea96724-73c2-406d-b93f-f1066079f02c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:10.368774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:10.378525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-76fc15f3-1e5b-4281-b46c-dbb496619440 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.794414 Jul 19 20:22:10.379770 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ad9aa801-4ee6-49aa-9842-d1387b2f9151 req-5ea96724-73c2-406d-b93f-f1066079f02c service nova] Creating event network-changed:65f04eb8-4d39-4ff2-a461-706940b08a63 for instance c4789687-2c3d-4137-b1db-5ccf91c3f385 on n-h2-843834-3 Jul 19 20:22:10.385221 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2808/5510] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:09 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:10.407201 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ad9aa801-4ee6-49aa-9842-d1387b2f9151 req-5ea96724-73c2-406d-b93f-f1066079f02c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085272 Jul 19 20:22:10.408635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2703/5511] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:22:11.410434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:11.411298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:11.435216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:11.436413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:11.442898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:11.443700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:11.791446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:11.810956 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-edd0e079-230e-4a58-8dc5-547e34c645bf tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.404799 Jul 19 20:22:11.812246 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2809/5512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:11 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:12.867051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:12.874488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:12.898266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.899522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.914110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.915353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.922001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-538b0191-3342-436f-859c-2a1ca40adf10 req-f9a1afe7-3ff8-477a-b61c-45f3c9f4b770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbda6260-64af-468c-827c-90d50b4664c9", "tag": "1944e4e6-70e7-4bda-bdbf-6d0afead47d4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:12.958470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-538b0191-3342-436f-859c-2a1ca40adf10 req-f9a1afe7-3ff8-477a-b61c-45f3c9f4b770 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:12.959893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-538b0191-3342-436f-859c-2a1ca40adf10 req-f9a1afe7-3ff8-477a-b61c-45f3c9f4b770 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:12.985936 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-538b0191-3342-436f-859c-2a1ca40adf10 req-f9a1afe7-3ff8-477a-b61c-45f3c9f4b770 service nova] Creating event network-changed:1944e4e6-70e7-4bda-bdbf-6d0afead47d4 for instance bbda6260-64af-468c-827c-90d50b4664c9 on n-h1-843834-3 Jul 19 20:22:12.996006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-538b0191-3342-436f-859c-2a1ca40adf10 req-f9a1afe7-3ff8-477a-b61c-45f3c9f4b770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089740 Jul 19 20:22:12.998069 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2810/5513] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:13.270447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:13.298576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34e1ca54-e569-4336-9b4b-aae0e43bbd2e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.459730 Jul 19 20:22:13.300194 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2704/5514] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:12 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:14.319062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:14.319765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:14.328204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:14.328660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:14.329504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:14.329949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:14.508866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:14.613775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:14.624724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9c37d14e-ad06-4f97-be41-25cf06b3ec0a tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.311044 Jul 19 20:22:14.625712 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2811/5515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:14 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:15.646670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:15.647929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:15.653086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:15.654668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:15.666545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.667384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.668906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:15.669635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:15.868484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:15.882560 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-96063345-4c91-4c71-bcdc-1cffd4a574f4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.243003 Jul 19 20:22:15.883801 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2705/5516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:15 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:16.907192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:16.909180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:16.919341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.920013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:16.920942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:16.921566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:17.165644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:17.176904 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f40dafe-8232-4c3d-9c08-5a57790b5b24 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.277689 Jul 19 20:22:17.179294 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2812/5517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:16 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:18.198069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:18.198803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:18.207660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:18.208109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.208953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:18.209335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.404229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:18.413649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5109b0b1-e24a-440a-8f37-bcc148417e81 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.220038 Jul 19 20:22:18.414378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2706/5518] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:18 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:18.750986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9c5a3c07-7143-4adb-8eb8-f88d2567e2df req-1c46a5b4-5d36-4de2-9a04-79b86a93f8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbda6260-64af-468c-827c-90d50b4664c9", "name": "network-vif-plugged", "status": "completed", "tag": "1944e4e6-70e7-4bda-bdbf-6d0afead47d4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:18.769020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9c5a3c07-7143-4adb-8eb8-f88d2567e2df req-1c46a5b4-5d36-4de2-9a04-79b86a93f8ac service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:18.770263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9c5a3c07-7143-4adb-8eb8-f88d2567e2df req-1c46a5b4-5d36-4de2-9a04-79b86a93f8ac service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:18.787136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9c5a3c07-7143-4adb-8eb8-f88d2567e2df req-1c46a5b4-5d36-4de2-9a04-79b86a93f8ac service nova] Creating event network-vif-plugged:1944e4e6-70e7-4bda-bdbf-6d0afead47d4 for instance bbda6260-64af-468c-827c-90d50b4664c9 on n-h1-843834-3 Jul 19 20:22:18.796109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9c5a3c07-7143-4adb-8eb8-f88d2567e2df req-1c46a5b4-5d36-4de2-9a04-79b86a93f8ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051460 Jul 19 20:22:18.797386 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2813/5519] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:22:19.432668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:19.433712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:19.443683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.444249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:19.445951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:19.446482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:19.465864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:19.645170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:19.657212 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d2ce998-f921-42c2-a6d2-c7703276d0b6 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1427 microversion: 2.1 time: 0.228672 Jul 19 20:22:19.658041 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2707/5520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:19 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:20.677794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:20.678485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:20.687521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.687975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.688783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.689224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.888221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:20.899108 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df1ebb16-cc45-4cbc-bf27-3d7bdb5d6162 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1606 microversion: 2.1 time: 0.225888 Jul 19 20:22:20.900012 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2814/5521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:20 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1606 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:20.919167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:20.920069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:20.930974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.932029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:20.933095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:20.933715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.144122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:21.154978 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-54642352-d090-4006-a930-62befbb22e96 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1606 microversion: 2.1 time: 0.241477 Jul 19 20:22:21.155768 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2708/5522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:20 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1606 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:21.175627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:21.176513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:21.184730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.185471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.186656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:21.187426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:21.412145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:22:21.425595 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28290b34-61e6-4870-be3d-098af0500ff1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1606 microversion: 2.1 time: 0.254646 Jul 19 20:22:21.426539 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2815/5523] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:22:21 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1606 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:22:24.698361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a90b4257-dc4c-4bb8-be32-2e9eccee57d2 req-304bbe27-6ad7-4a58-9cae-cc4b6507fc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbda6260-64af-468c-827c-90d50b4664c9", "tag": "1944e4e6-70e7-4bda-bdbf-6d0afead47d4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:24.713287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a90b4257-dc4c-4bb8-be32-2e9eccee57d2 req-304bbe27-6ad7-4a58-9cae-cc4b6507fc6d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:24.713897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a90b4257-dc4c-4bb8-be32-2e9eccee57d2 req-304bbe27-6ad7-4a58-9cae-cc4b6507fc6d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:24.732575 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a90b4257-dc4c-4bb8-be32-2e9eccee57d2 req-304bbe27-6ad7-4a58-9cae-cc4b6507fc6d service nova] Creating event network-changed:1944e4e6-70e7-4bda-bdbf-6d0afead47d4 for instance bbda6260-64af-468c-827c-90d50b4664c9 on n-h1-843834-3 Jul 19 20:22:24.740894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a90b4257-dc4c-4bb8-be32-2e9eccee57d2 req-304bbe27-6ad7-4a58-9cae-cc4b6507fc6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302581 Jul 19 20:22:24.741887 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2709/5524] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:39.631568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:39.632710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:39.637577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=25 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:39.639299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=73 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:39.650309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:39.651134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:39.652616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:39.653375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:39.699634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42c14b48-02da-4069-b064-b71757b10315 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/ips" status: 200 len: 151 microversion: 2.1 time: 0.073431 Jul 19 20:22:39.700809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2816/5525] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 20:22:39 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:42.285188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65c74e1-5369-4f87-bd26-2a4baa520d89"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:22:42.287196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:42.291781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=17 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:42.293374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=11 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:42.304421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:42.305210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:42.306626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:42.307332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:42.657737 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7138a997-f9e0-4e1a-992b-ef61c12b5a4b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "POST /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379130 Jul 19 20:22:42.664717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2710/5526] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:22:42 2022] POST /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:56.972292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:56.973078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:56.975423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:56.976090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:56.983353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:56.983984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:56.984824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:56.985284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:57.085438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lazy-loading 'services' on Instance uuid c4789687-2c3d-4137-b1db-5ccf91c3f385 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:22:57.173529 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6c810ece-5ff7-492a-a1bd-d2236aee46a7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments/a65c74e1-5369-4f87-bd26-2a4baa520d89" status: 202 len: 0 microversion: 2.1 time: 0.205950 Jul 19 20:22:57.175197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2817/5527] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:22:56 2022] DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments/a65c74e1-5369-4f87-bd26-2a4baa520d89 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:22:57.193588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:57.197131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:57.223081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:57.234740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:22:57.239361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:57.244064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:57.245203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:57.245894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:57.301536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a0a1dcc-23c7-465d-9a36-f94ab6dc3cd7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115987 Jul 19 20:22:57.302635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2711/5528] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:22:57 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:58.318717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:58.319935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:58.327931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:58.328390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:58.329205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:58.329652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:58.365098 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-607dc7bc-9f6c-4829-a713-287fcb5c009d tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Jul 19 20:22:58.365658 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2818/5529] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:22:58 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:22:59.386369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:22:59.388434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:22:59.404561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:59.406393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:59.408762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:22:59.409868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:22:59.476115 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3bf51775-1927-4aed-b8fb-d7e250da8783 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099224 Jul 19 20:22:59.483614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2712/5530] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:22:59 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:00.317644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:00.317644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:00.328780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:00.329336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:00.333288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:00.334005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:00.369644 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61d191de-219b-4b1e-b252-121b5951b60c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.060342 Jul 19 20:23:00.370552 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2819/5531] 10.222.0.23 () {58 vars in 1292 bytes} [Tue Jul 19 20:23:00 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9/os-server-password => generated 116 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:00.492024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:00.492833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:00.500967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:00.501420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:00.502218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:00.502661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:00.541302 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5a9fceaf-43d6-4e33-a57e-a5dc8026550f tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053353 Jul 19 20:23:00.546877 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2713/5532] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:23:00 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:01.554436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:01.555712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:01.563993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:01.564457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:01.565274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:01.566053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:01.609675 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa89d391-6708-46e6-9c04-d2faf8e48d31 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059411 Jul 19 20:23:01.610619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2820/5533] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:23:01 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:02.624191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:02.625138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:02.634754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.635594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.636031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.636466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.680021 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c79d29e-11ce-4a7a-a214-f9359578ee38 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059779 Jul 19 20:23:02.680612 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2714/5534] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:23:02 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:23:02.747690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:02.748271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:02.755805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.756265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.757062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.757507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.789114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:23:02.889361 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-912ef0e9-1512-4125-a221-3bbb08e1b8d7 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 204 len: 0 microversion: 2.1 time: 0.145148 Jul 19 20:23:02.890384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2821/5535] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:02 2022] DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:23:02.899959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:02.900698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:02.908731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.909612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:02.910649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:02.911349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:03.071390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:03.088188 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c8f5d627-aafb-4eda-8d93-dac5f60e5ec8 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1683 microversion: 2.1 time: 0.192347 Jul 19 20:23:03.089326 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2715/5536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:02 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:04.116844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:04.118286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:04.131260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:04.132585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:04.134458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:04.135621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:04.356267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:04.365400 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7d3b1cea-11e3-441f-a521-9819b7aaf1b5 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1683 microversion: 2.1 time: 0.253477 Jul 19 20:23:04.366140 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2822/5537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:04 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:05.384028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:05.384755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:05.392565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:05.393007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:05.393848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:05.394503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:05.496356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381238cd67a6421eab8ba961b1fb0978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce188bd2cea4346adc79344f0c87b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:05.525666 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6a6cbb18-5bf5-46a4-a277-d5b3e5c8a519 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 200 len: 1616 microversion: 2.1 time: 0.145370 Jul 19 20:23:05.547064 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2716/5538] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:05 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 1616 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:05.571010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ab556a5f-2ecb-4b1e-82a1-69c6b4b1aad3 req-ed641b03-7472-41c6-b023-2555bf08fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4789687-2c3d-4137-b1db-5ccf91c3f385", "name": "network-vif-deleted", "tag": "65f04eb8-4d39-4ff2-a461-706940b08a63"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:05.588854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ab556a5f-2ecb-4b1e-82a1-69c6b4b1aad3 req-ed641b03-7472-41c6-b023-2555bf08fe0c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:05.590363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ab556a5f-2ecb-4b1e-82a1-69c6b4b1aad3 req-ed641b03-7472-41c6-b023-2555bf08fe0c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:05.632572 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ab556a5f-2ecb-4b1e-82a1-69c6b4b1aad3 req-ed641b03-7472-41c6-b023-2555bf08fe0c service nova] Creating event network-vif-deleted:65f04eb8-4d39-4ff2-a461-706940b08a63 for instance c4789687-2c3d-4137-b1db-5ccf91c3f385 on n-h2-843834-3 Jul 19 20:23:05.659249 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ab556a5f-2ecb-4b1e-82a1-69c6b4b1aad3 req-ed641b03-7472-41c6-b023-2555bf08fe0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097969 Jul 19 20:23:05.660951 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2823/5539] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:06.562887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:06.563704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:06.572351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:06.572786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:06.573845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:06.574279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:06.591159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 HTTP/1.1 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c4789687-2c3d-4137-b1db-5ccf91c3f385'} Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:06.593185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30782373-41da-4119-bc53-78fcf63b0c75 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 404 len: 111 microversion: 2.1 time: 0.036632 Jul 19 20:23:06.599114 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2717/5540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:06 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:06.605698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb8f4637-0cec-4973-bfeb-05c321137e05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '.version_select at 0x7f23efcffe50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:06.638596 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb8f4637-0cec-4973-bfeb-05c321137e05 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297845442" status: 202 len: 0 microversion: 2.1 time: 0.037819 Jul 19 20:23:06.644625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2824/5541] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 19 20:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297845442 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:23:07.823077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-63a90a1d-1d7c-4d1b-b894-a36eb1dbef20 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Action: 'create', calling method: .version_select at 0x7f23eea0b940>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-945289300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9MGKOUiF4AmKgE2ZrLIPqgVB2EjZjTtA6Jwx4ZVP5Fng2OuB+R7wvHdvFSiz2/zMM6R7/j4ZCHzcJdoGwS2zIOzL0RPw9m1+LxE2iWGTgFk/1UR+0Icy4l8EPgRdihHQ=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:07.848418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-63a90a1d-1d7c-4d1b-b894-a36eb1dbef20 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Getting quotas for project 12bca2bdda4240dc9a8488086c234e58. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:23:07.857422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-63a90a1d-1d7c-4d1b-b894-a36eb1dbef20 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Getting quotas for user eea03340928646e0a3b523ca36d7cd89 and project 12bca2bdda4240dc9a8488086c234e58. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:23:07.888490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-63a90a1d-1d7c-4d1b-b894-a36eb1dbef20 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.070049 Jul 19 20:23:07.889555 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2718/5542] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:23:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:09.552389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-856469195", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a72555b-47f0-4c7e-9921-8b6c80c55742", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-945289300", "security_groups": [{"name": "tempest-secgroup-smoke-78076396"}], "networks": [{"uuid": "63b07e10-71a6-41e7-ae3d-2319bc36088f"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:09.701131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] validate_networks() for [('63b07e10-71a6-41e7-ae3d-2319bc36088f', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:23:10.270777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:23:10.271941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:23:10.272912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:23:10.273664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:23:10.274474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:23:10.295719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.296477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.298076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:10.298896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:10.333464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Getting quotas for project 12bca2bdda4240dc9a8488086c234e58. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:23:10.344453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Getting quotas for user eea03340928646e0a3b523ca36d7cd89 and project 12bca2bdda4240dc9a8488086c234e58. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:23:10.433503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:23:10.436011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a72555b-47f0-4c7e-9921-8b6c80c55742',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:23:10.622149 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2f084f4-5e50-4026-9720-c02482e3be99 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.075967 Jul 19 20:23:10.623210 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2825/5543] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:23:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:23:10.637872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6f16b5fb-b145-4716-b6c4-8cc209b96bf9 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:10.646195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6f16b5fb-b145-4716-b6c4-8cc209b96bf9 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:10.770890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6f16b5fb-b145-4716-b6c4-8cc209b96bf9 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:10.785557 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6f16b5fb-b145-4716-b6c4-8cc209b96bf9 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1097 microversion: 2.1 time: 0.155127 Jul 19 20:23:10.786879 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2719/5544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:10 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1097 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:11.806327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:11.807058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:11.818639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:11.819409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:11.820926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:11.821763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:11.923431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:11.934211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f46703a8-bdda-4cbe-bac1-821b4ffcdbf3 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1195 microversion: 2.1 time: 0.133974 Jul 19 20:23:11.934849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2826/5545] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:11 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1195 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:12.284751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:12.286023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:12.311304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.312304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.314072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.315378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.338222 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 HTTP/1.1 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c4789687-2c3d-4137-b1db-5ccf91c3f385'} Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:12.340235 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-197b53f6-2b6d-445f-bd17-cbb2bd8d6c06 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 404 len: 111 microversion: 2.1 time: 0.062112 Jul 19 20:23:12.348939 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2720/5546] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:12 2022] DELETE /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:12.353406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:12.354314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: c4789687-2c3d-4137-b1db-5ccf91c3f385] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:12.362823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.363324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.364166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.364880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.381447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 HTTP/1.1 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c4789687-2c3d-4137-b1db-5ccf91c3f385'} Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:12.384341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance c4789687-2c3d-4137-b1db-5ccf91c3f385 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bcb9cf3b-d5c7-49ed-b22b-f2a1fd9557d0 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385" status: 404 len: 111 microversion: 2.1 time: 0.037536 Jul 19 20:23:12.391874 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2827/5547] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:12 2022] GET /compute/v2.1/servers/c4789687-2c3d-4137-b1db-5ccf91c3f385 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:12.956084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:12.956935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:12.988203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.990298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:12.992800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:12.993282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:13.325044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:13.342516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-295e76ac-7fe1-47cf-9034-82eb9d58d33d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1279 microversion: 2.1 time: 0.392139 Jul 19 20:23:13.344048 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2721/5548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:12 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1279 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:14.367583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:14.400530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:14.400530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:14.400530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:14.400530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:14.400530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:14.575916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-87e22c46-2ff4-4c74-8a3f-f5f27c18c508 req-dd8bee4a-1963-49ca-8767-b08d922edaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:14.631923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87e22c46-2ff4-4c74-8a3f-f5f27c18c508 req-dd8bee4a-1963-49ca-8767-b08d922edaa5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:14.632764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-87e22c46-2ff4-4c74-8a3f-f5f27c18c508 req-dd8bee4a-1963-49ca-8767-b08d922edaa5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:14.683113 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-87e22c46-2ff4-4c74-8a3f-f5f27c18c508 req-dd8bee4a-1963-49ca-8767-b08d922edaa5 service nova] Creating event network-changed:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:23:14.699762 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-87e22c46-2ff4-4c74-8a3f-f5f27c18c508 req-dd8bee4a-1963-49ca-8767-b08d922edaa5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135552 Jul 19 20:23:14.701785 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2722/5549] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:14.808746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:14.822378 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a638e452-8a9c-48dd-8480-176b962189fe tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1279 microversion: 2.1 time: 0.463326 Jul 19 20:23:14.823910 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2828/5550] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:14 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1279 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:15.845415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:15.850214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:15.876462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:15.877167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:15.878471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:15.884286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:16.349361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:16.370308 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-532c43b0-12d8-4dbc-a335-b88983e0f055 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1279 microversion: 2.1 time: 0.533129 Jul 19 20:23:16.381536 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2723/5551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:15 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1279 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:16.951549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:16.952225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:16.963743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:16.964226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:16.965404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:16.966235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:16.985597 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd HTTP/1.1 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '90051f31-e621-44ad-aff2-bab0159dd0bd'} Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:16.987842 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90249fca-942e-4b2e-aad6-59544efe7817 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 404 len: 111 microversion: 2.1 time: 0.042935 Jul 19 20:23:16.998153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2829/5552] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:16 2022] DELETE /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:17.009195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:17.010311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: 90051f31-e621-44ad-aff2-bab0159dd0bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:17.024261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.025083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.026463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.027380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.055757 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd HTTP/1.1 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '90051f31-e621-44ad-aff2-bab0159dd0bd'} Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.060075 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance 90051f31-e621-44ad-aff2-bab0159dd0bd could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:17.069848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66670b9d-53f6-4b91-95fc-52adb8b0c331 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd" status: 404 len: 111 microversion: 2.1 time: 0.066028 Jul 19 20:23:17.072342 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2724/5553] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:16 2022] GET /compute/v2.1/servers/90051f31-e621-44ad-aff2-bab0159dd0bd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:17.083039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:17.083882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:17.097463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.098259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.100369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.101562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.134373 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c HTTP/1.1 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ed6575f5-38cf-4bca-a382-2ceffacb087c'} Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:17.137268 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:17.141156 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f066f3c-44b5-4755-aa74-988dacbbe134 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 404 len: 111 microversion: 2.1 time: 0.066215 Jul 19 20:23:17.147457 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2830/5554] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:17 2022] DELETE /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:17.164055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:17.165658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: ed6575f5-38cf-4bca-a382-2ceffacb087c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:17.177926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.178874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.180341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.181154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.210321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c HTTP/1.1 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ed6575f5-38cf-4bca-a382-2ceffacb087c'} Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:17.213550 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance ed6575f5-38cf-4bca-a382-2ceffacb087c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73d70e95-29b4-4a8b-a8ab-925b55e1a334 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c" status: 404 len: 111 microversion: 2.1 time: 0.067650 Jul 19 20:23:17.221893 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2725/5555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:17 2022] GET /compute/v2.1/servers/ed6575f5-38cf-4bca-a382-2ceffacb087c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:17.395498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:17.397846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:17.412693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.414291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.416237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:17.433411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:17.655018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:17.671120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-75f294ed-bc23-41c7-9370-86663b511a32 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1279 microversion: 2.1 time: 0.285104 Jul 19 20:23:17.684402 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2831/5556] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:17 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:18.698236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:18.698979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:18.707510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:18.708127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:18.708922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:18.709379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:18.891023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:18.899644 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-652478cb-89c7-4183-9f05-643a36ad8dd8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1279 microversion: 2.1 time: 0.206614 Jul 19 20:23:18.900895 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2726/5557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:18 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:19.917970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:19.918719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:19.927326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:19.927793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:19.928649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:19.929097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:20.103071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:20.118827 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-22f38ed8-e698-442a-9406-407fb3bb8f53 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.204447 Jul 19 20:23:20.120721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2832/5558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:19 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:23:21.149083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:21.149864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:21.153512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:21.160626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:21.161079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:21.161879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:21.162337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:21.344207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:21.355882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8d9f4a9-bc26-4a7d-b357-d19ecdcf6ed8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.212360 Jul 19 20:23:21.356650 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2727/5559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:21 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:22.380106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:22.381063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:22.383529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:22.384393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:22.394262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.394740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.395743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.396182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.570641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:22.579602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f253127-87da-4af3-a327-0b1136fc674d tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.204205 Jul 19 20:23:22.580577 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2833/5560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:22 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:22.741441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:22.743012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:22.752915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.753521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.754575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.755284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.773581 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab HTTP/1.1 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'daba30af-3561-4993-850b-32e5155474ab'} Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:22.775611 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-18cc4830-8c47-4a29-a98d-2c0d43a95870 tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 404 len: 111 microversion: 2.1 time: 0.041777 Jul 19 20:23:22.784997 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2728/5561] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:23:22 2022] DELETE /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:23:22.791230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:22.792191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] [instance: daba30af-3561-4993-850b-32e5155474ab] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:22.800607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.801272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.802344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:22.802890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:22.821382 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] HTTP exception thrown: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Request method failure captured: Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab HTTP/1.1 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xEtlP9EIIoU611a9PZE8lUaYGDM_K6MAg37KzyFvAHh6PrZCU_ebX6syfggiw2vACp-vgXj0CktkrsWxGPCmETpGrxvxg_CdEz6KrM_2wffogwtF55bnOvoqPbKt8XdbwejzxCM34l5G3L8fPXUeI8WsIU5H9yWWdeVc9F0IGGSsv4 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dce188bd2cea4346adc79344f0c87b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: dce188bd2cea4346adc79344f0c87b18 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1962412183 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 381238cd67a6421eab8ba961b1fb0978 Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-AttachVolumeNegativeTest-1962412183-project Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'daba30af-3561-4993-850b-32e5155474ab'} Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:23:22.824461 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] Returning 404 to user: Instance daba30af-3561-4993-850b-32e5155474ab could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d16243be-2a8c-41f3-b1e2-738c0739639b tempest-AttachVolumeNegativeTest-1962412183 tempest-AttachVolumeNegativeTest-1962412183-project] 10.222.0.23 "GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab" status: 404 len: 111 microversion: 2.1 time: 0.040888 Jul 19 20:23:22.833500 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2834/5562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:22 2022] GET /compute/v2.1/servers/daba30af-3561-4993-850b-32e5155474ab => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:23:23.598995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:23.599453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:23.607009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:23.607484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:23.608471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:23.608941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:23.854077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:23.864083 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0981c217-effb-437e-950e-c6d6fd38735f tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.269401 Jul 19 20:23:23.865107 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2729/5563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:23 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:24.888026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:24.889420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:24.901468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:24.902300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:24.904124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:24.904616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:25.754530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:25.770565 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1a96488-3e12-4f7d-b02d-8834d7b536ee tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.889781 Jul 19 20:23:25.775572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2835/5564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:24 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:26.801657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:26.802781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:26.816156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:26.817218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:26.818890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:26.819972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:27.129817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:27.146365 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-189d019a-271c-4044-8838-fa71065655fa tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.351620 Jul 19 20:23:27.147483 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2730/5565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:26 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:28.166765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:28.167824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:28.171540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:28.179451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:28.179917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:28.180736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:28.181172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:28.186597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:28.365329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:28.377783 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56094c91-5d47-446f-8636-475c77073617 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.215432 Jul 19 20:23:28.378731 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2836/5566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:28 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:28.917605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-fdc20890-f21f-4acf-ad33-781ae8a427d4 req-bc99a065-53c5-47dd-b8b0-c616ecd46f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "name": "network-vif-plugged", "status": "completed", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:28.926388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:28.939103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fdc20890-f21f-4acf-ad33-781ae8a427d4 req-bc99a065-53c5-47dd-b8b0-c616ecd46f59 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:28.939558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fdc20890-f21f-4acf-ad33-781ae8a427d4 req-bc99a065-53c5-47dd-b8b0-c616ecd46f59 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:28.964345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-fdc20890-f21f-4acf-ad33-781ae8a427d4 req-bc99a065-53c5-47dd-b8b0-c616ecd46f59 service nova] Creating event network-vif-plugged:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:23:28.970639 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-fdc20890-f21f-4acf-ad33-781ae8a427d4 req-bc99a065-53c5-47dd-b8b0-c616ecd46f59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061081 Jul 19 20:23:28.971458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2731/5567] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:29.397310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:29.397978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:29.405783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:29.406279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:29.407167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:29.407637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:29.628655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:29.639759 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f48f8081-51af-4c93-b14f-f1c853442bc7 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1267 microversion: 2.1 time: 0.246359 Jul 19 20:23:29.640397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2837/5568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:29 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:30.670793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:30.673271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:30.686618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:30.687312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:30.688195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:30.688884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:30.696063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=87 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:23:30.880555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:30.893203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5cb1a826-f6a9-406e-8322-a8f1afa6c3fb tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1457 microversion: 2.1 time: 0.230032 Jul 19 20:23:30.894304 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2732/5569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:30 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1457 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:30.920087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:23:30.924637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:23:30.935953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:30.936670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:30.937996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:30.938639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:31.148554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:23:31.162096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cebbbcb1-d2c1-4720-9407-5dd6b6b67b31 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1457 microversion: 2.1 time: 0.249659 Jul 19 20:23:31.162716 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2838/5570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:23:30 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1457 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:23:34.489067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e8a99d06-b9c6-4bb0-ab17-9ced2121e747 req-0c8fcfa7-8053-4248-bbee-4ca8450b1051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:34.512996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e8a99d06-b9c6-4bb0-ab17-9ced2121e747 req-0c8fcfa7-8053-4248-bbee-4ca8450b1051 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:34.514156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e8a99d06-b9c6-4bb0-ab17-9ced2121e747 req-0c8fcfa7-8053-4248-bbee-4ca8450b1051 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:34.547572 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e8a99d06-b9c6-4bb0-ab17-9ced2121e747 req-0c8fcfa7-8053-4248-bbee-4ca8450b1051 service nova] Creating event network-changed:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:23:34.559490 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e8a99d06-b9c6-4bb0-ab17-9ced2121e747 req-0c8fcfa7-8053-4248-bbee-4ca8450b1051 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074099 Jul 19 20:23:34.566300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2733/5571] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:36.880528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a795289b-0bf2-401c-91c4-969a8d473d2c req-ed793ba9-5f38-4d31-a4fd-aacc52199e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:36.891288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a795289b-0bf2-401c-91c4-969a8d473d2c req-ed793ba9-5f38-4d31-a4fd-aacc52199e4f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:36.891742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a795289b-0bf2-401c-91c4-969a8d473d2c req-ed793ba9-5f38-4d31-a4fd-aacc52199e4f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:36.904947 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a795289b-0bf2-401c-91c4-969a8d473d2c req-ed793ba9-5f38-4d31-a4fd-aacc52199e4f service nova] Creating event network-changed:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:23:36.911258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a795289b-0bf2-401c-91c4-969a8d473d2c req-ed793ba9-5f38-4d31-a4fd-aacc52199e4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034259 Jul 19 20:23:36.912449 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2839/5572] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:23:38.935180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-15e76912-59e9-4668-98a1-b075a994aa8a req-f20bec00-5fd3-4771-a135-34aa0c1e043d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:23:38.948840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-15e76912-59e9-4668-98a1-b075a994aa8a req-f20bec00-5fd3-4771-a135-34aa0c1e043d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:23:38.949489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-15e76912-59e9-4668-98a1-b075a994aa8a req-f20bec00-5fd3-4771-a135-34aa0c1e043d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:23:38.967203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-15e76912-59e9-4668-98a1-b075a994aa8a req-f20bec00-5fd3-4771-a135-34aa0c1e043d service nova] Creating event network-changed:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:23:38.973386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-15e76912-59e9-4668-98a1-b075a994aa8a req-f20bec00-5fd3-4771-a135-34aa0c1e043d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047558 Jul 19 20:23:38.974015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2734/5573] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:09.235183 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:24:09.235828 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:24:11.716790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=7 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:11.717714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:11.727722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:11.728536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:11.734184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6a01cdb4-8b41-473d-9382-46a8231c6186 req-c6bcd12a-2a12-4b2c-a8e7-e7d5185cc29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:11.747194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:11.748447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=19 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:24:11.762579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6a01cdb4-8b41-473d-9382-46a8231c6186 req-c6bcd12a-2a12-4b2c-a8e7-e7d5185cc29f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:11.766073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:11.766718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:11.767785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:11.768327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:11.776091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6a01cdb4-8b41-473d-9382-46a8231c6186 req-c6bcd12a-2a12-4b2c-a8e7-e7d5185cc29f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:11.827111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6a01cdb4-8b41-473d-9382-46a8231c6186 req-c6bcd12a-2a12-4b2c-a8e7-e7d5185cc29f service nova] Creating event network-changed:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:24:11.827762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:24:11.838644 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6a01cdb4-8b41-473d-9382-46a8231c6186 req-c6bcd12a-2a12-4b2c-a8e7-e7d5185cc29f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124059 Jul 19 20:24:11.856190 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2735/5574] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:12.033251 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f94909bc-0639-4022-99d2-4a54b58875d2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 204 len: 0 microversion: 2.1 time: 0.318203 Jul 19 20:24:12.037575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2840/5575] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:24:11 2022] DELETE /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:24:12.055824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:12.057556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:12.076567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.077397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.078832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:12.079885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:12.446622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:12.471319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1a0c76c4-f3fb-41d8-9bc2-a1d8760b5177 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1582 microversion: 2.1 time: 0.426299 Jul 19 20:24:12.474777 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2736/5576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:12 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1582 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:13.515125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:13.518652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:13.542291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:13.542291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:13.542291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:13.542291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:13.868854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:13.885851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b98e195a-e5e6-4d54-9284-7d75c7f2ef68 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1582 microversion: 2.1 time: 0.382005 Jul 19 20:24:13.900476 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2841/5577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:13 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1582 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:14.446578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-46ce866f-c4af-4da9-8a77-208ed1e97b38 req-c922141c-9606-4968-a868-8fc6b0144284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a8650c-9057-4029-aedc-b297efff8620", "name": "network-vif-deleted", "tag": "0956489f-2801-44ce-850f-bc297848eb3f"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:24:14.459402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-46ce866f-c4af-4da9-8a77-208ed1e97b38 req-c922141c-9606-4968-a868-8fc6b0144284 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.460502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-46ce866f-c4af-4da9-8a77-208ed1e97b38 req-c922141c-9606-4968-a868-8fc6b0144284 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.493494 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-46ce866f-c4af-4da9-8a77-208ed1e97b38 req-c922141c-9606-4968-a868-8fc6b0144284 service nova] Creating event network-vif-deleted:0956489f-2801-44ce-850f-bc297848eb3f for instance 11a8650c-9057-4029-aedc-b297efff8620 on n-h2-843834-3 Jul 19 20:24:14.503920 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-46ce866f-c4af-4da9-8a77-208ed1e97b38 req-c922141c-9606-4968-a868-8fc6b0144284 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061794 Jul 19 20:24:14.505371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2737/5578] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:24:14.918789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:14.921294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:14.938408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.940749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:14.943513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:14.944753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:15.083205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:15.100210 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc9faa81-d9d1-4e7f-9cfa-1f22977b3dd6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1228 microversion: 2.1 time: 0.188904 Jul 19 20:24:15.101433 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2842/5579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:14 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1228 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:16.125745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:16.127255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:16.144954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.146625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:16.148630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:16.149306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:16.253652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:16.266367 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8242911-df29-435d-bb0d-836abfce24c5 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1228 microversion: 2.1 time: 0.145703 Jul 19 20:24:16.267435 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2738/5580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:16 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1228 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:17.293442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:17.295203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:17.310123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:17.311096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:17.312922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:17.313846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:17.447676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:17.464978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7cddef8-2e62-4560-8c80-7ee9537684f6 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1228 microversion: 2.1 time: 0.180988 Jul 19 20:24:17.466047 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2843/5581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:17 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1228 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:18.491800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:18.492787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:18.506413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.507246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.508779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:18.509778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:18.613423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:18.623083 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-15999235-5dfe-4543-862f-a4870ec73551 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1228 microversion: 2.1 time: 0.137413 Jul 19 20:24:18.630949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2739/5582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:18 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1228 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:19.646279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:19.647276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:19.660603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:19.661720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:19.663395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:19.664412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:19.787438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:19.802516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f064a7d-7b3a-458c-b1fc-f5f51b5e71bf tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1228 microversion: 2.1 time: 0.163958 Jul 19 20:24:19.803572 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2844/5583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:19 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1228 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:24:20.833811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:20.834872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:20.849645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.850386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.851527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.852309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.920932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:20.921906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:20.923196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lazy-loading 'fault' on Instance uuid 11a8650c-9057-4029-aedc-b297efff8620 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:24:21.002783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea03340928646e0a3b523ca36d7cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bca2bdda4240dc9a8488086c234e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:24:21.019884 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2bbdec1f-113c-47be-b7ae-03fdd6b81be2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 200 len: 1233 microversion: 2.1 time: 0.195641 Jul 19 20:24:21.021841 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2740/5584] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:20 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 1233 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:24:22.051028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:22.052064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] [instance: 11a8650c-9057-4029-aedc-b297efff8620] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:24:22.064204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:22.065272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:22.068392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:24:22.069117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:24:22.120336 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] HTTP exception thrown: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Request method failure captured: Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 HTTP/1.1 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xHdkJ4u3kcc4vPkyTXH56G1m9UyDIMjWhycG2uNS2vUI06svh-fUja-pBmB50m75PcnorzXNwN8zR4lSnqnAQtzIfWD928hm7LulNKiAaPW4SWxcrhToEZE1DbEZ8hiw5s8hoXiLVI_0zPID8klKQT5DtokW2OfdryRPK_jbvRUKWg Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 12bca2bdda4240dc9a8488086c234e58 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBackupRestore-1618891047 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12bca2bdda4240dc9a8488086c234e58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12bca2bdda4240dc9a8488086c234e58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12bca2bdda4240dc9a8488086c234e58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12bca2bdda4240dc9a8488086c234e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBackupRestore-1618891047 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 12bca2bdda4240dc9a8488086c234e58 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1618891047 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBackupRestore-1618891047-project Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: eea03340928646e0a3b523ca36d7cd89 Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBackupRestore-1618891047-project Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '11a8650c-9057-4029-aedc-b297efff8620'} Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:24:22.123856 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:24:22.135535 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Returning 404 to user: Instance 11a8650c-9057-4029-aedc-b297efff8620 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:24:22.137317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65f5dd1b-499a-43bd-aa76-99500f63cee2 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620" status: 404 len: 111 microversion: 2.1 time: 0.090676 Jul 19 20:24:22.143453 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2845/5585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:24:22 2022] GET /compute/v2.1/servers/11a8650c-9057-4029-aedc-b297efff8620 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:24:22.451086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73e6fe78-ab58-4745-9f94-94f4197fb7c8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] Calling method '.version_select at 0x7f23ee64da60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:24:22.496062 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73e6fe78-ab58-4745-9f94-94f4197fb7c8 tempest-TestVolumeBackupRestore-1618891047 tempest-TestVolumeBackupRestore-1618891047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-945289300" status: 202 len: 0 microversion: 2.1 time: 0.052828 Jul 19 20:24:22.498531 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2741/5586] 10.222.0.23 () {58 vars in 1265 bytes} [Tue Jul 19 20:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-945289300 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:25:09.867939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:09.869867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:09.897557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-272902288", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "48f48622-e016-4338-b098-e8fe56f78289", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:10.218675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:25:10.808719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:25:10.809597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:25:10.811050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:25:10.811748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:25:10.812389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:25:10.826132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:10.826652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:10.827751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:10.828318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:10.851711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:25:10.858433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:25:10.947259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:25:10.949860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48f48622-e016-4338-b098-e8fe56f78289',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:25:11.186606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8624a032-4f06-4c52-a4a2-d20e579cd3d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320864 Jul 19 20:25:11.187794 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2846/5587] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:25:11.197395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=30 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:11.199006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:11.208801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-519c0552-166e-4f49-a49b-b6482203da0d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:11.209553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-519c0552-166e-4f49-a49b-b6482203da0d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:11.453178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-519c0552-166e-4f49-a49b-b6482203da0d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:11.472271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-519c0552-166e-4f49-a49b-b6482203da0d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1056 microversion: 2.1 time: 0.277102 Jul 19 20:25:11.481453 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2742/5588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:11 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1056 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:12.510344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:12.511602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:12.528595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:12.529380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:12.534261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:12.535122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:12.673172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:12.683642 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7d82293-3d5e-409e-8a85-af7de217d8d7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1098 microversion: 2.1 time: 0.188250 Jul 19 20:25:12.684588 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2847/5589] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:12 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1098 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:13.702385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:13.703033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:13.719176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:13.719632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:13.720441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:13.720874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:13.860094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:13.869624 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-42e2a842-734d-4878-818a-e4face200745 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1172 microversion: 2.1 time: 0.171607 Jul 19 20:25:13.870502 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2743/5590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:13 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1172 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:14.908597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:14.909648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:14.926208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:14.927123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:14.928108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:14.928827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:15.313980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:15.329383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0bd046ce-013e-47f8-af79-0f582e764e20 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1214 microversion: 2.1 time: 0.433813 Jul 19 20:25:15.347313 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2848/5591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:14 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1214 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:16.114140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5ecdf1d4-d84e-41e5-b80a-158728809909 req-d4b80878-6842-4e51-960b-ac7faa878ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f86e8f5-3bfc-4a0c-8699-6449b1518cd2", "tag": "93bdd917-e86b-4360-b2c6-9ba40041a704"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:16.147513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5ecdf1d4-d84e-41e5-b80a-158728809909 req-d4b80878-6842-4e51-960b-ac7faa878ad7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:16.148656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5ecdf1d4-d84e-41e5-b80a-158728809909 req-d4b80878-6842-4e51-960b-ac7faa878ad7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:16.166258 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5ecdf1d4-d84e-41e5-b80a-158728809909 req-d4b80878-6842-4e51-960b-ac7faa878ad7 service nova] Creating event network-changed:93bdd917-e86b-4360-b2c6-9ba40041a704 for instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 on n-h2-843834-3 Jul 19 20:25:16.173905 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5ecdf1d4-d84e-41e5-b80a-158728809909 req-d4b80878-6842-4e51-960b-ac7faa878ad7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066869 Jul 19 20:25:16.175913 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2744/5592] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:25:16.359322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:16.361447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:16.374767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:16.376049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:16.378785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:16.379935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:16.690797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:16.711063 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e5b44936-336d-4c60-920f-1d68c1927013 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1214 microversion: 2.1 time: 0.358546 Jul 19 20:25:16.712317 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2849/5593] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:16 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1214 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:17.737215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:17.738815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:17.746599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:17.747148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:17.747988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:17.748427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:18.009597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:18.029854 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-69790ebe-d714-48d1-a080-776b5628b7b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1214 microversion: 2.1 time: 0.298599 Jul 19 20:25:18.030833 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2745/5594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:17 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:19.050047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:19.051812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:19.061152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:19.062227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:19.063734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:19.064354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:19.308589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:19.327226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-166a4574-d575-47fb-9e1c-7a9c41fea52c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1214 microversion: 2.1 time: 0.281117 Jul 19 20:25:19.329201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2850/5595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:19 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:20.354244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:20.356598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:20.370807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:20.371893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:20.373714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:20.374875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:20.616151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:20.632217 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0f42b78-5de8-47a2-8cef-104201a23e04 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1214 microversion: 2.1 time: 0.283824 Jul 19 20:25:20.633642 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2746/5596] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:20 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:21.655843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:21.657217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:21.663799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:21.665202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:21.677067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:21.678036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:21.679623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:21.680500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:21.879276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:21.894226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ca1602c-d395-4329-ae11-8eb7430ffd61 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.246737 Jul 19 20:25:21.895314 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2851/5597] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:21 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:22.920950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:22.921964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:22.926612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:22.934738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:22.935242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:22.936039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:22.936479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:23.140038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:23.151211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9612ed3f-f37b-4818-9e1c-562164672f2e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.234468 Jul 19 20:25:23.152012 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2747/5598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:22 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:24.172266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:24.173357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:24.186577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:24.187354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:24.188752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:24.189487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:24.365426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:24.373823 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a883443-7c35-4c79-a26f-62db763eb1a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.207130 Jul 19 20:25:24.374429 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2852/5599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:24 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:25.394852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:25.395579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:25.405964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:25.406777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:25.408767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:25.409624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:25.610709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:25.620312 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b07cfc32-2a92-483a-aee0-2d77fd3e5c1a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.230246 Jul 19 20:25:25.621111 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2748/5600] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:25 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:26.642298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:26.643241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:26.664154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:26.665413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:26.666937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:26.667889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:26.891123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:26.906086 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36c318b8-be51-46aa-bacd-215f0018e487 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.269363 Jul 19 20:25:26.907089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2853/5601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:26 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:27.929663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:27.930782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:27.943809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:27.944499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:27.945977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:27.947127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:28.153947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:28.165334 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e341e7b4-cccf-4d27-a3c6-95255d691033 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.242656 Jul 19 20:25:28.166396 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2749/5602] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:27 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:29.193800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:29.194882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:29.212676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:29.213745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:29.215362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:29.216475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:29.504584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e392cbdf-ae81-4c4a-b8fa-4b4f688d8eb6 req-81ace106-1311-4da5-a049-d178cc26148d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f86e8f5-3bfc-4a0c-8699-6449b1518cd2", "name": "network-vif-plugged", "status": "completed", "tag": "93bdd917-e86b-4360-b2c6-9ba40041a704"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:29.553644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e392cbdf-ae81-4c4a-b8fa-4b4f688d8eb6 req-81ace106-1311-4da5-a049-d178cc26148d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:29.555272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e392cbdf-ae81-4c4a-b8fa-4b4f688d8eb6 req-81ace106-1311-4da5-a049-d178cc26148d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:29.588080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e392cbdf-ae81-4c4a-b8fa-4b4f688d8eb6 req-81ace106-1311-4da5-a049-d178cc26148d service nova] Creating event network-vif-plugged:93bdd917-e86b-4360-b2c6-9ba40041a704 for instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 on n-h2-843834-3 Jul 19 20:25:29.602280 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e392cbdf-ae81-4c4a-b8fa-4b4f688d8eb6 req-81ace106-1311-4da5-a049-d178cc26148d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105201 Jul 19 20:25:29.604049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2750/5603] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:25:30.025711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:30.036764 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b10a1c56-2359-4bb3-a3b5-872bc2ad038d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1202 microversion: 2.1 time: 0.851841 Jul 19 20:25:30.038323 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2854/5604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:29 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1202 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:31.065828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:31.067031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:31.082084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.083014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.084604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.085419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.272693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:31.286654 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eda9051e-5208-49b8-9e44-bfc8fafb672e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1389 microversion: 2.1 time: 0.232072 Jul 19 20:25:31.287445 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2751/5605] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:31 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:31.309592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:31.312731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:31.331111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.331968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.334631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.335894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.521268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:31.537037 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a7d6f9a0-829a-4282-9429-c30e08818c5d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1389 microversion: 2.1 time: 0.234941 Jul 19 20:25:31.538048 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2855/5606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:31 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1389 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:31.563572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:31.565029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:31.573166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.573720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.574724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.575259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.738900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:31.749895 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a9fc167b-b260-49fe-9d6d-ddbb99b684d1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1389 microversion: 2.1 time: 0.191175 Jul 19 20:25:31.750502 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2752/5607] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:31 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1389 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:31.771036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:31.771718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:31.782012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.782582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.783548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.784271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.820389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:25:31.927163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5062645-887c-4a3e-a8b2-7ee8c23bd494 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 204 len: 0 microversion: 2.1 time: 0.160825 Jul 19 20:25:31.928582 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2856/5608] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:25:31 2022] DELETE /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:25:31.937358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:31.937987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:31.945241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.945902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:31.947595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:31.948387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:32.124325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:32.135366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0383a7c-4753-4d70-aecb-a663797a1539 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1395 microversion: 2.1 time: 0.202258 Jul 19 20:25:32.136710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2753/5609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:31 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1395 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:33.157533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:33.158329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:33.169850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:33.170451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:33.171609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:33.172234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:33.384679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:33.394307 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a776636f-6231-456c-ab55-108848ae7f4f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1395 microversion: 2.1 time: 0.241424 Jul 19 20:25:33.394946 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2857/5610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:33 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1395 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:34.416971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:34.417683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:34.435007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:34.435418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:34.437562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:34.438086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:34.523331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d8102e8e-aa44-44e7-bfdc-4a7f4f5411ff req-96cd1180-1f8f-4c3e-9122-bf9bc9df3fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f86e8f5-3bfc-4a0c-8699-6449b1518cd2", "name": "network-vif-deleted", "tag": "93bdd917-e86b-4360-b2c6-9ba40041a704"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:34.559696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d8102e8e-aa44-44e7-bfdc-4a7f4f5411ff req-96cd1180-1f8f-4c3e-9122-bf9bc9df3fc1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:34.560902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d8102e8e-aa44-44e7-bfdc-4a7f4f5411ff req-96cd1180-1f8f-4c3e-9122-bf9bc9df3fc1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:34.600436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:34.606561 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d8102e8e-aa44-44e7-bfdc-4a7f4f5411ff req-96cd1180-1f8f-4c3e-9122-bf9bc9df3fc1 service nova] Creating event network-vif-deleted:93bdd917-e86b-4360-b2c6-9ba40041a704 for instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 on n-h2-843834-3 Jul 19 20:25:34.622252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d8102e8e-aa44-44e7-bfdc-4a7f4f5411ff req-96cd1180-1f8f-4c3e-9122-bf9bc9df3fc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104782 Jul 19 20:25:34.633081 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2858/5611] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:25:34.656218 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef38e8c0-aa48-4ee0-be54-f049af41d455 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1353 microversion: 2.1 time: 0.243581 Jul 19 20:25:34.665225 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2754/5612] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:34 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:35.692616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:35.694245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:35.702682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:35.703354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:35.704305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:35.704967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:35.800948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:35.813589 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5839bb0c-2e13-4627-bdff-523d28ebb41a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1187 microversion: 2.1 time: 0.125135 Jul 19 20:25:35.814784 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2859/5613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:35 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1187 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:36.038979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-394982211", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:36.136220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] validate_networks() for None {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:25:36.505936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:25:36.506568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:25:36.507236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:25:36.507751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:25:36.508396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:25:36.519769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:36.520212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:36.521023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:36.521465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:36.550890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Getting quotas for project 3c3fc2af67914954af287636f560a3ee. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:25:36.557392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Getting quotas for user f5e55aa938a24fb3b646ab6f2b694b82 and project 3c3fc2af67914954af287636f560a3ee. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:25:36.573068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:25:36.575933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:25:36.644504 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-388cc71c-2932-4050-9142-994471476b9f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613100 Jul 19 20:25:36.650362 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2755/5614] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:25:36.660013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-337ff46c-f734-4d8c-b834-36ebeeb44d77 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:36.661672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-337ff46c-f734-4d8c-b834-36ebeeb44d77 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:36.751038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-337ff46c-f734-4d8c-b834-36ebeeb44d77 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:36.762296 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-337ff46c-f734-4d8c-b834-36ebeeb44d77 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1214 microversion: 2.1 time: 0.109755 Jul 19 20:25:36.762986 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2860/5615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:36 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:36.840621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:36.841582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:36.850577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:36.851289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:36.854618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:36.854618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:36.960888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:36.972051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2da19bac-a6f5-43ba-a591-216805351d1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1187 microversion: 2.1 time: 0.137409 Jul 19 20:25:36.972695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2756/5616] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:36 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1187 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:37.789933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd77f706-8765-418f-acec-c5b737375c66 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:37.791086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd77f706-8765-418f-acec-c5b737375c66 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:37.909743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd77f706-8765-418f-acec-c5b737375c66 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:37.923405 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd77f706-8765-418f-acec-c5b737375c66 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1214 microversion: 2.1 time: 0.140168 Jul 19 20:25:37.924878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2861/5617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:37 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:37.993263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:37.995504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:38.010230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:38.010978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:38.012695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:38.014002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:38.145138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:38.163407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4c08809-0f16-4c7f-9aa3-b232daf3aa77 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1187 microversion: 2.1 time: 0.177206 Jul 19 20:25:38.164858 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2757/5618] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:37 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1187 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:38.950577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc663127-afac-4449-abe0-93989712ea63 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:38.951870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc663127-afac-4449-abe0-93989712ea63 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:39.059731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc663127-afac-4449-abe0-93989712ea63 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:39.076623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc663127-afac-4449-abe0-93989712ea63 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1214 microversion: 2.1 time: 0.133383 Jul 19 20:25:39.086476 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2862/5619] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:38 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:39.190829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:39.192280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:39.205092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:39.205878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:39.207296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:39.208063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:39.326667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:39.338503 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d558ec5-20a1-4c61-9e49-839aed680931 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1187 microversion: 2.1 time: 0.155258 Jul 19 20:25:39.339427 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2758/5620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:39 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:40.104029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6bff42d2-3644-4dc2-bbb5-131ffb06d94b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:40.104913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6bff42d2-3644-4dc2-bbb5-131ffb06d94b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:40.108434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:40.191274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6bff42d2-3644-4dc2-bbb5-131ffb06d94b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:40.199925 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6bff42d2-3644-4dc2-bbb5-131ffb06d94b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1214 microversion: 2.1 time: 0.100899 Jul 19 20:25:40.200548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2863/5621] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:40 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:40.365380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:40.367209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:40.383796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:40.386717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:40.389214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:40.391846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:40.494621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:40.505874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9586c791-893f-494e-8432-27fa32c809e1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 200 len: 1187 microversion: 2.1 time: 0.148717 Jul 19 20:25:40.505874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2759/5622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:40 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 1187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:41.224408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:41.225163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:41.238321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:41.238644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:41.239393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:41.239832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:41.243203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:41.314882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:41.323877 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44be18de-891a-4560-a635-b6813efb0be5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1218 microversion: 2.1 time: 0.103679 Jul 19 20:25:41.324584 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2864/5623] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:41 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:41.522162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:41.522943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:41.526157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:41.534232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:41.534737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:41.535943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:41.536425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:41.541819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=91 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:41.557026 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 HTTP/1.1 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8f86e8f5-3bfc-4a0c-8699-6449b1518cd2'} Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:25:41.558800 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-52b339c3-7d79-438b-ac19-16b87361619f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2" status: 404 len: 111 microversion: 2.1 time: 0.042310 Jul 19 20:25:41.563870 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2760/5624] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:41 2022] GET /compute/v2.1/servers/8f86e8f5-3bfc-4a0c-8699-6449b1518cd2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:25:42.343697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:42.345084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:42.354450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:42.355108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:42.356267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:42.356965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:42.452678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:42.466272 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b724968-6028-44c2-b44e-914ee4df146f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1272 microversion: 2.1 time: 0.127650 Jul 19 20:25:42.467762 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2865/5625] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:42 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:43.487119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:43.488634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:43.500535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:43.501731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:43.503461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:43.504482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:43.724390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:43.747111 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d37266b-9f8b-493d-8f96-f86bf3dd7890 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.264270 Jul 19 20:25:43.762059 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2761/5626] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:43 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:44.783356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:44.786073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:44.805254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:44.811730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:44.820217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:44.820933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:44.882771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-335fe1a4-fde9-429d-baf6-697d81845567 req-71d393ac-55f2-4c99-b8c5-9447176e283a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedaafec-d794-4eff-b956-f8c599e5c3bc", "tag": "75de816f-e908-4145-92a9-fd558037c065"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:44.963426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-335fe1a4-fde9-429d-baf6-697d81845567 req-71d393ac-55f2-4c99-b8c5-9447176e283a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:44.968104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-335fe1a4-fde9-429d-baf6-697d81845567 req-71d393ac-55f2-4c99-b8c5-9447176e283a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:45.012489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-335fe1a4-fde9-429d-baf6-697d81845567 req-71d393ac-55f2-4c99-b8c5-9447176e283a service nova] Creating event network-changed:75de816f-e908-4145-92a9-fd558037c065 for instance bedaafec-d794-4eff-b956-f8c599e5c3bc on n-h2-843834-3 Jul 19 20:25:45.029031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-335fe1a4-fde9-429d-baf6-697d81845567 req-71d393ac-55f2-4c99-b8c5-9447176e283a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181687 Jul 19 20:25:45.030161 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2762/5627] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:25:45.204249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:45.223756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af1fc78a-d6f4-44ac-825b-ddfbf6611495 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.455950 Jul 19 20:25:45.227713 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2866/5628] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:44 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:46.246903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:46.248017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:46.257580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:46.258520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:46.264402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:46.265241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:46.524729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:46.536948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:46.542350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8676294e-dd27-4beb-a7b8-ef1b2ea34dec tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.299736 Jul 19 20:25:46.543465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2763/5629] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:46 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:47.578002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:47.579287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:47.594404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:47.595661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:47.597135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:47.598131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:47.847752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:47.857799 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f46486b-3b4d-4f9e-93f1-73613e94b9ac tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.287844 Jul 19 20:25:47.872374 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2867/5630] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:47 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:48.880156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:48.880778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:48.883459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:48.898468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:48.898468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:48.898468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:48.898468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:49.104468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:49.116904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1024965c-bf17-4761-9f2e-a6a24d802c81 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.240361 Jul 19 20:25:49.123011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2764/5631] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:48 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:49.348322 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:25:49.349178 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:25:49.446666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1ae1b36e-1abc-49f5-9b5c-a42f4713b724 req-7c165377-1672-44f0-9603-af3fca965835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedaafec-d794-4eff-b956-f8c599e5c3bc", "name": "network-vif-plugged", "status": "completed", "tag": "75de816f-e908-4145-92a9-fd558037c065"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:49.466861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1ae1b36e-1abc-49f5-9b5c-a42f4713b724 req-7c165377-1672-44f0-9603-af3fca965835 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:49.467511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1ae1b36e-1abc-49f5-9b5c-a42f4713b724 req-7c165377-1672-44f0-9603-af3fca965835 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:49.487298 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1ae1b36e-1abc-49f5-9b5c-a42f4713b724 req-7c165377-1672-44f0-9603-af3fca965835 service nova] Creating event network-vif-plugged:75de816f-e908-4145-92a9-fd558037c065 for instance bedaafec-d794-4eff-b956-f8c599e5c3bc on n-h2-843834-3 Jul 19 20:25:49.495436 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1ae1b36e-1abc-49f5-9b5c-a42f4713b724 req-7c165377-1672-44f0-9603-af3fca965835 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054574 Jul 19 20:25:49.496554 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2868/5632] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:25:50.147461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:50.149077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:50.161655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:50.162688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:50.164566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:50.165399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:50.382948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:50.397554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7fae0103-b003-4361-b542-cc4972ad7bd5 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1314 microversion: 2.1 time: 0.260696 Jul 19 20:25:50.410510 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2765/5633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:50 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:25:51.418756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:51.419620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:51.421593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:25:51.428490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.428944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:51.429735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.430173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:51.622372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:51.630552 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b5b81403-526a-4d67-9536-cea8ab98c79f tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1463 microversion: 2.1 time: 0.216329 Jul 19 20:25:51.636281 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2869/5634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:51 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1463 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:51.682678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:51.683619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:51.690150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.690601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:51.691423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.691857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:51.725509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:25:51.857207 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3cd2991c-df47-4ca8-b828-814cee0a2e65 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 204 len: 0 microversion: 2.1 time: 0.178715 Jul 19 20:25:51.858280 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2766/5635] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:25:51 2022] DELETE /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:25:51.868846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:51.869616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:51.877687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.878473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:51.879876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:51.880594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:52.081838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:52.096879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a264c3ae-6195-48a4-a8f8-2181a247070d tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1469 microversion: 2.1 time: 0.232817 Jul 19 20:25:52.098203 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2870/5636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:51 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:53.126839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:53.130218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:53.155875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:53.156738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:53.157728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:53.158283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:53.396303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e55aa938a24fb3b646ab6f2b694b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3fc2af67914954af287636f560a3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:25:53.405162 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a4fe87a-2e54-411b-b082-4f772ab6530b tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 200 len: 1469 microversion: 2.1 time: 0.285014 Jul 19 20:25:53.419003 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2767/5637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:53 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:25:53.783934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d36f52a2-f6e0-4a2c-8109-8c7bf1205322 req-ad5a8b8b-e5b3-4c3f-9f81-19544fc9fd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedaafec-d794-4eff-b956-f8c599e5c3bc", "name": "network-vif-deleted", "tag": "75de816f-e908-4145-92a9-fd558037c065"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:25:53.806379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d36f52a2-f6e0-4a2c-8109-8c7bf1205322 req-ad5a8b8b-e5b3-4c3f-9f81-19544fc9fd11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:53.807625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d36f52a2-f6e0-4a2c-8109-8c7bf1205322 req-ad5a8b8b-e5b3-4c3f-9f81-19544fc9fd11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:53.840208 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d36f52a2-f6e0-4a2c-8109-8c7bf1205322 req-ad5a8b8b-e5b3-4c3f-9f81-19544fc9fd11 service nova] Creating event network-vif-deleted:75de816f-e908-4145-92a9-fd558037c065 for instance bedaafec-d794-4eff-b956-f8c599e5c3bc on n-h2-843834-3 Jul 19 20:25:53.853092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d36f52a2-f6e0-4a2c-8109-8c7bf1205322 req-ad5a8b8b-e5b3-4c3f-9f81-19544fc9fd11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085284 Jul 19 20:25:53.855329 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2871/5638] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:25:54.433574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:25:54.434699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] [instance: bedaafec-d794-4eff-b956-f8c599e5c3bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:25:54.449347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:54.450159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:54.451317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:25:54.452040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:25:54.477273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] HTTP exception thrown: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Request method failure captured: Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc HTTP/1.1 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xM9HmbdFQ1bPsx3dhWt91dWzEnWg1oSWAQ70JhSDBypxn1DvxTr0l3JBJMCOH141UGZ7LlSp4Fx6X8UqefGq_JL3XO2LaE-rSarm_RMdC4nmyfsqYI_Pz88FJQrPzjD8A9LAa-rezccB_c9SC1Ouv0a33iXKRHc5CeebuZmWxn917E Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 3c3fc2af67914954af287636f560a3ee Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesNegativeTest-491037002 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3fc2af67914954af287636f560a3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c3fc2af67914954af287636f560a3ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c3fc2af67914954af287636f560a3ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3fc2af67914954af287636f560a3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesNegativeTest-491037002 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 3c3fc2af67914954af287636f560a3ee Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesNegativeTest-491037002 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesNegativeTest-491037002-project Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: f5e55aa938a24fb3b646ab6f2b694b82 Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesNegativeTest-491037002-project Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bedaafec-d794-4eff-b956-f8c599e5c3bc'} Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:25:54.480511 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] Returning 404 to user: Instance bedaafec-d794-4eff-b956-f8c599e5c3bc could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:25:54.489472 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a7e76706-e4b5-452a-8425-148c9edeaa97 tempest-VolumesNegativeTest-491037002 tempest-VolumesNegativeTest-491037002-project] 10.222.0.23 "GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc" status: 404 len: 111 microversion: 2.1 time: 0.053094 Jul 19 20:25:54.492072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2768/5639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:25:54 2022] GET /compute/v2.1/servers/bedaafec-d794-4eff-b956-f8c599e5c3bc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:26:11.283116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1477922539", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fdb606b3-d26c-4349-9747-914c6746b8a8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:26:11.293437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=19 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:11.294131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=39 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:11.407943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:26:12.159131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:26:12.160430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:26:12.161515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:26:12.162205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:26:12.162948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:26:12.181046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:12.181827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:12.183399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:12.184364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:12.219267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:26:12.230428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:26:12.256026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:26:12.260190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fdb606b3-d26c-4349-9747-914c6746b8a8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:26:12.412635 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-318df22c-778c-48bb-b983-a4d7ab5ced1b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134513 Jul 19 20:26:12.414233 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2872/5640] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:26:12.450529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ab51352-e560-4c0b-aa6f-61890943b202 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:12.455806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ab51352-e560-4c0b-aa6f-61890943b202 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:12.461299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:12.462620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:12.559716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ab51352-e560-4c0b-aa6f-61890943b202 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:12.567537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ab51352-e560-4c0b-aa6f-61890943b202 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1057 microversion: 2.1 time: 0.144522 Jul 19 20:26:12.568169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2769/5641] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:12 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1057 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:13.595732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:13.597092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:13.607181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:13.607642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:13.608850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:13.609546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:13.726990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:13.754782 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-192a4b49-6103-4199-b7af-b08447383e8c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1109 microversion: 2.1 time: 0.165606 Jul 19 20:26:13.755978 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2873/5642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:13 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1109 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:14.782371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:14.784001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:14.798567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:14.799887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:14.801444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:14.803134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:15.065129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:15.096926 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3562adb7-dab6-411b-9a7d-67322001e446 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.316225 Jul 19 20:26:15.142635 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2770/5643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:14 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:16.151044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:16.152178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:16.169357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:16.169686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:16.171782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:16.175256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:16.521589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:16.561259 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86b92d4c-ea5c-4491-9838-699ed9eff3d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.419896 Jul 19 20:26:16.572488 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2874/5644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:16 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:16.642278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0a331e31-bce5-4ccd-bd1b-06e7b190dc33 req-e0efbf34-c7d7-4255-ad18-888dc1ea1d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58518102-9f69-42bf-ad6e-1bdb71187ce3", "tag": "78655f0c-3198-4d28-9388-723a723d0870"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:26:16.715421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a331e31-bce5-4ccd-bd1b-06e7b190dc33 req-e0efbf34-c7d7-4255-ad18-888dc1ea1d1e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:16.718535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0a331e31-bce5-4ccd-bd1b-06e7b190dc33 req-e0efbf34-c7d7-4255-ad18-888dc1ea1d1e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:16.761535 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0a331e31-bce5-4ccd-bd1b-06e7b190dc33 req-e0efbf34-c7d7-4255-ad18-888dc1ea1d1e service nova] Creating event network-changed:78655f0c-3198-4d28-9388-723a723d0870 for instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 on n-h2-843834-3 Jul 19 20:26:16.771650 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0a331e31-bce5-4ccd-bd1b-06e7b190dc33 req-e0efbf34-c7d7-4255-ad18-888dc1ea1d1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144211 Jul 19 20:26:16.773360 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2771/5645] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:26:17.606510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:17.609109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:17.624584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:17.625924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:17.627881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:17.628989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:18.014455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:18.046297 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5222138-d765-4911-8c35-6e2e2fe5e2b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.449550 Jul 19 20:26:18.048176 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2875/5646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:17 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:19.073876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:19.082741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:19.110769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:19.116683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:19.119524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:19.122394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:19.383932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:19.399326 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-091f0bc9-d33d-4e1c-8c9a-8f0f1f617f64 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.336187 Jul 19 20:26:19.415690 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2772/5647] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:19 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:20.430309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:20.431638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:20.443958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:20.444687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:20.446041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:20.447297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:20.749885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:20.766331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44408b91-4425-47a3-adc0-c056d944cb92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.343492 Jul 19 20:26:20.767302 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2876/5648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:20 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:21.799331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:21.800128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:21.812962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:21.813996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:21.815325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:21.815927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:22.086228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:22.102970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-045ec074-77fe-4a08-b283-7697720dd693 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.310630 Jul 19 20:26:22.105459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2773/5649] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:21 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:23.134904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:23.136209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:23.149115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:23.152656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:23.169171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:23.170066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:23.171505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:23.172580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:23.487623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:23.512927 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7944f4e-e2c7-475b-ad3f-32f66cba86a3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.387233 Jul 19 20:26:23.514022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2877/5650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:23 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:24.549756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:24.553955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:24.570289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:24.585528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:24.586864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:24.589654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:24.590722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:24.945019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:24.962555 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-78d34509-292e-4753-9f4a-b8be5dcfefe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.421476 Jul 19 20:26:24.978310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2774/5651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:24 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:26:25.987557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:25.988577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:26.003430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:26.004482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:26.005976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:26.006900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:26.265872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:26.286182 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78a5ac56-fc33-4b87-bc87-8b5bc9be7085 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.303052 Jul 19 20:26:26.287638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2878/5652] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:25 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:27.323992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:27.324642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:27.336906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:27.337559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:27.338702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:27.339432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:27.638353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:27.656526 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e99a4c43-5100-4982-a7fc-bcdabc525388 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.341866 Jul 19 20:26:27.671687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2775/5653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:27 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:28.687549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:28.688727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:28.703027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:28.703820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:28.705324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:28.706111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:28.930935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:28.944997 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7a09a1bb-babc-4470-905b-f123aa20ae87 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.265216 Jul 19 20:26:28.946009 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2879/5654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:28 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:29.974260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:29.975317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:29.988432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:29.989197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:29.990625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:29.991423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:30.244953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:30.258465 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b34828c7-bc3c-456b-ac9f-bf828f4927b3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.291420 Jul 19 20:26:30.259754 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2776/5655] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:29 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:31.287779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:31.289008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:31.311098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:31.312330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:31.313801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:31.314561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:31.538561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:31.555369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-96335056-f41f-4396-90dc-5517a0c885af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.275557 Jul 19 20:26:31.556389 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2880/5656] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:31 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:32.590836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:32.591828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:32.602984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:32.604062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:32.605655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:32.606575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:32.884144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:32.898733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-51c8165a-7a14-4e73-9c08-818f5b0a03fc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.314289 Jul 19 20:26:32.900136 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2777/5657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:32 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:26:33.928873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:33.929898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:33.949597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:33.951033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:33.952517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:33.953369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:34.257921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:34.274355 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-779d33f8-82c9-45f5-860a-a19a6b602f4a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.352479 Jul 19 20:26:34.275827 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2881/5658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:33 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:35.306423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:35.307862 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:35.321152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:35.322641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:35.324439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:35.325625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:35.591645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:35.606354 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81d9bdf1-2d44-407a-9fdb-cc09dc7f3608 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.305858 Jul 19 20:26:35.607865 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2778/5659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:35 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:36.639590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:36.640645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:36.652888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:36.653629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:36.654931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:36.656015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:36.892892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:36.904568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-faeb6064-9ff3-465d-9037-42b33dc99fe2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1169 microversion: 2.1 time: 0.271588 Jul 19 20:26:36.905790 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2882/5660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:36 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1169 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:37.930986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:37.933353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:37.953743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:37.959695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:37.961542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:37.962310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:38.231766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:38.248312 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9dc5c533-75a4-4f46-912a-5e74b58b6391 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1215 microversion: 2.1 time: 0.324762 Jul 19 20:26:38.250812 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2779/5661] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:37 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1215 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:39.291367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:39.292493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:39.301824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:39.302519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:39.303669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:39.304272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:39.667415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:39.681281 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-631026bc-e30b-4cf4-bd5f-6155bf823e2f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.407611 Jul 19 20:26:39.682310 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2883/5662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:39 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:40.712747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:40.713676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:40.725457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:40.726184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:40.727467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:40.728169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:40.963111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:40.976197 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b137665-1056-47bd-a191-525eeb4d1e97 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.270182 Jul 19 20:26:40.977104 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2780/5663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:40 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:42.005926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:42.006850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:42.010865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:42.020611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:42.021176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:42.022352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:42.023239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:42.033084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=69 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:42.242284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:42.252000 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b0d0de93-8b18-4b11-9aaa-b97ab63340af tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.254032 Jul 19 20:26:42.252994 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2884/5664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:41 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:43.275730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:43.277656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:43.280550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:43.290629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:43.291392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:43.292673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:43.293389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:43.298190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=63 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:26:43.491915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:43.500818 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-08ad2040-cb6b-449d-b77a-69db1b2708a0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.232578 Jul 19 20:26:43.501649 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2781/5665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:43 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:44.523539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:44.524441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:44.540824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:44.541769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:44.543198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:44.544198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:44.814838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:44.828636 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9eba2d2-d61b-42bd-aa6c-892903aec53a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.313081 Jul 19 20:26:44.830997 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2885/5666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:44 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:45.861513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:45.871488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:45.886149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:45.887460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:45.891528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:45.898196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:46.159145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:46.196271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6ffb086-d71e-462d-a060-2fbcebfc6e27 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.343099 Jul 19 20:26:46.197872 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2782/5667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:45 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:26:47.226776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:47.227712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:47.244728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:47.245361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:47.247217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:47.248712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:47.433745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:47.448645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-304ce17c-521b-4153-b95e-0394cc4a31d3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.227246 Jul 19 20:26:47.449799 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2886/5668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:47 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:47.934617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-cdd54919-8cd7-4b33-8f24-9628c1db1933 req-e9d3af09-970a-4fc8-b286-036f6d6f0d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58518102-9f69-42bf-ad6e-1bdb71187ce3", "name": "network-vif-plugged", "status": "completed", "tag": "78655f0c-3198-4d28-9388-723a723d0870"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:26:47.943914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cdd54919-8cd7-4b33-8f24-9628c1db1933 req-e9d3af09-970a-4fc8-b286-036f6d6f0d2e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:47.944309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cdd54919-8cd7-4b33-8f24-9628c1db1933 req-e9d3af09-970a-4fc8-b286-036f6d6f0d2e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:47.965480 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-cdd54919-8cd7-4b33-8f24-9628c1db1933 req-e9d3af09-970a-4fc8-b286-036f6d6f0d2e service nova] Creating event network-vif-plugged:78655f0c-3198-4d28-9388-723a723d0870 for instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 on n-h2-843834-3 Jul 19 20:26:47.971405 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-cdd54919-8cd7-4b33-8f24-9628c1db1933 req-e9d3af09-970a-4fc8-b286-036f6d6f0d2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249716 Jul 19 20:26:47.972375 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2783/5669] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:26:48.473430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:48.474336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:48.485463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:48.486123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:48.487352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:48.488318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:48.706500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:48.718280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cbd552ad-b16c-4bcd-accf-3d2240ebe554 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1203 microversion: 2.1 time: 0.251060 Jul 19 20:26:48.718903 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2887/5670] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:48 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1203 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:49.742521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:49.743789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:49.751808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:49.752258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:49.753061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:49.753560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:49.974159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:49.985560 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61a5a2a5-3fe3-4621-94e3-e84f955bf4b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1390 microversion: 2.1 time: 0.252342 Jul 19 20:26:49.987310 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2784/5671] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:49 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1390 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:50.019044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:50.020119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:50.034665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.035624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.037501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.038275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.270218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:50.284087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-74d65805-d092-422b-89a1-2135a0c3c57f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1390 microversion: 2.1 time: 0.273855 Jul 19 20:26:50.285989 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2888/5672] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:50 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:50.312700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:50.313785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:50.329115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.330374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.332323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.333801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.558473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:50.574025 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3fd89244-45dd-46dd-aab3-79170be14697 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1390 microversion: 2.1 time: 0.269194 Jul 19 20:26:50.575466 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2785/5673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:50 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:50.671254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:50.671753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:50.678971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.679410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.680213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.680651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.719073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:26:50.823304 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6aab73fc-115e-4e82-8c9f-6328ef6d0157 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 204 len: 0 microversion: 2.1 time: 0.154295 Jul 19 20:26:50.824403 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2889/5674] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:26:50 2022] DELETE /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:26:50.834814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:50.835725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:50.843992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.844561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:50.845360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:50.845808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:51.018503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:51.027268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e837e57e-7754-4ac0-9c28-e242da07191c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1396 microversion: 2.1 time: 0.196785 Jul 19 20:26:51.027881 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2786/5675] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:50 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1396 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:52.048472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:52.049579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:52.059228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:52.059686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:52.060519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:52.060980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:52.281929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:52.294774 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3dcba41c-3894-4fe8-ae7c-3860430a8a90 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1396 microversion: 2.1 time: 0.252771 Jul 19 20:26:52.296108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2890/5676] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:52 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1396 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:53.076577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a50e158a-f2f2-49f5-8b72-1aebb37f16d5 req-a0b18a53-a068-431a-9404-33e8cdbfeb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58518102-9f69-42bf-ad6e-1bdb71187ce3", "name": "network-vif-deleted", "tag": "78655f0c-3198-4d28-9388-723a723d0870"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:26:53.127592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a50e158a-f2f2-49f5-8b72-1aebb37f16d5 req-a0b18a53-a068-431a-9404-33e8cdbfeb57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:53.139169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a50e158a-f2f2-49f5-8b72-1aebb37f16d5 req-a0b18a53-a068-431a-9404-33e8cdbfeb57 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:53.159246 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a50e158a-f2f2-49f5-8b72-1aebb37f16d5 req-a0b18a53-a068-431a-9404-33e8cdbfeb57 service nova] Creating event network-vif-deleted:78655f0c-3198-4d28-9388-723a723d0870 for instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 on n-h2-843834-3 Jul 19 20:26:53.170173 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a50e158a-f2f2-49f5-8b72-1aebb37f16d5 req-a0b18a53-a068-431a-9404-33e8cdbfeb57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103150 Jul 19 20:26:53.171351 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2787/5677] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:26:53.322301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:53.323589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:53.336736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:53.337480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:53.338933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:53.339721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:53.450687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:53.468996 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6cf20114-1e73-4b96-aa3c-1613e992c1bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.153745 Jul 19 20:26:53.470307 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2891/5678] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:53 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:54.501502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:54.504481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:54.525311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:54.527468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:54.529353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:54.530187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:54.651771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:54.665727 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5b83ded-cbdf-42ee-afae-c007fa7acce3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.174671 Jul 19 20:26:54.666784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2788/5679] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:54 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:55.690462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:55.691734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:55.707968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:55.709189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:55.711328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:55.711992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:55.836408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:55.846428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ba6bb51-ee9b-4560-b0e8-5050c7730da1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.165099 Jul 19 20:26:55.850070 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2892/5680] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:55 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:56.869651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:56.870595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:56.882574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:56.883259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:56.885235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:56.885235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:56.999034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:57.012226 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e4295014-fcfd-4907-8dfb-ef2582b9df69 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.149352 Jul 19 20:26:57.013282 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2789/5681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:56 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:58.034637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:58.035998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:58.052655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:58.053741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:58.055738 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:58.057337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:58.191994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:58.215576 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e27c727e-eb5c-4ab8-8733-468a043bb86c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.187317 Jul 19 20:26:58.216679 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2893/5682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:58 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:26:59.243374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:26:59.246614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:26:59.257830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:59.259253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:59.261159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:26:59.262334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:26:59.435877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:26:59.455423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-89ffff80-9c93-4ac3-a339-9be92f2593a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 200 len: 1188 microversion: 2.1 time: 0.217754 Jul 19 20:26:59.457660 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2790/5683] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:26:59 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 1188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:00.475961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:00.476851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:00.487069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:00.487526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:00.488467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:00.488861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:00.520128 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 HTTP/1.1 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '58518102-9f69-42bf-ad6e-1bdb71187ce3'} Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:00.523527 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:00.533100 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-000d0846-8bf7-4d88-9829-d8b0b5143308 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 404 len: 111 microversion: 2.1 time: 0.054418 Jul 19 20:27:00.534341 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2894/5684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:00 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:27:03.829896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:03.831097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:03.840295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:03.840739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:03.841730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:03.842169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:03.858546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 HTTP/1.1 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '58518102-9f69-42bf-ad6e-1bdb71187ce3'} Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:03.860303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-738bcbbe-16a1-4bfa-afcb-549455a31dfa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 404 len: 111 microversion: 2.1 time: 0.035755 Jul 19 20:27:03.866544 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2791/5685] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:27:03 2022] DELETE /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:27:03.877636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:03.879198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 58518102-9f69-42bf-ad6e-1bdb71187ce3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:03.893558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:03.894360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:03.897049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:03.897868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:03.932834 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 HTTP/1.1 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '58518102-9f69-42bf-ad6e-1bdb71187ce3'} Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:03.943046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:03.953852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 58518102-9f69-42bf-ad6e-1bdb71187ce3 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:03.956160 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-889a00c5-cc04-47e3-94c0-5cd4822e7ad5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3" status: 404 len: 111 microversion: 2.1 time: 0.085867 Jul 19 20:27:03.957982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2895/5686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:03 2022] GET /compute/v2.1/servers/58518102-9f69-42bf-ad6e-1bdb71187ce3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:27:04.172090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:04.172979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:04.185168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:04.185945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:04.187399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:04.188448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:04.263410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:27:04.424829 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eadf7a74-6fe0-4a04-bb87-fa90ad186180 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 204 len: 0 microversion: 2.1 time: 0.522921 Jul 19 20:27:04.426097 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2792/5687] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:27:03 2022] DELETE /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:27:04.436447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:04.437586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:04.446196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:04.446879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:04.448007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:04.449183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:04.665561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:04.686390 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8c7e966-b708-4beb-93f1-1c3f9ce54de4 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1730 microversion: 2.1 time: 0.254368 Jul 19 20:27:04.700227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2896/5688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:04 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:05.723836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:05.725900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:05.739334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:05.740477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:05.742146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:05.742979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:06.111839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:06.145984 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2cb9ffd-e920-4399-bd4a-dae4460ace6f tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1730 microversion: 2.1 time: 0.430906 Jul 19 20:27:06.147431 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2793/5689] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:05 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1730 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:07.178190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:07.181193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:07.205992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:07.207330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:07.209558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:07.210742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:07.374253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:07.383340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a9917f76-a863-4ace-8346-760a58cf4bf1 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1662 microversion: 2.1 time: 0.213834 Jul 19 20:27:07.385661 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2897/5690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:07 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:08.097705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d1e83bce-8241-456a-8019-5464c73f2b96 req-d0b9dcbd-a5a0-4621-b6e8-6a2fcff6dd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbda6260-64af-468c-827c-90d50b4664c9", "name": "network-vif-deleted", "tag": "1944e4e6-70e7-4bda-bdbf-6d0afead47d4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:08.108346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d1e83bce-8241-456a-8019-5464c73f2b96 req-d0b9dcbd-a5a0-4621-b6e8-6a2fcff6dd0f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:08.108968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d1e83bce-8241-456a-8019-5464c73f2b96 req-d0b9dcbd-a5a0-4621-b6e8-6a2fcff6dd0f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:08.142134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d1e83bce-8241-456a-8019-5464c73f2b96 req-d0b9dcbd-a5a0-4621-b6e8-6a2fcff6dd0f service nova] Creating event network-vif-deleted:1944e4e6-70e7-4bda-bdbf-6d0afead47d4 for instance bbda6260-64af-468c-827c-90d50b4664c9 on n-h1-843834-3 Jul 19 20:27:08.153403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d1e83bce-8241-456a-8019-5464c73f2b96 req-d0b9dcbd-a5a0-4621-b6e8-6a2fcff6dd0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385050 Jul 19 20:27:08.154356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2794/5691] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:08.416830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:08.417477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:08.433524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:08.434010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:08.434893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:08.440447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:08.522267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:08.523239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:08.524139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lazy-loading 'fault' on Instance uuid bbda6260-64af-468c-827c-90d50b4664c9 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:27:08.677676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cec9320ebcb44f8a1b7ff3053ac854d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae58fbe35c348f290d04b1a22811516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:08.711425 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed1ec974-58bf-475c-8071-f950f38b7764 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 200 len: 1387 microversion: 2.1 time: 0.299021 Jul 19 20:27:08.716542 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2898/5692] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:08 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 1387 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:09.736307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:09.737625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:09.747181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:09.747673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:09.748512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:09.749143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:09.772711 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] HTTP exception thrown: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Request method failure captured: Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 HTTP/1.1 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xJVqSgqUECuNdh12sE8McDuJR-mjypaLjLmjZ8WQe1vQ7E9GeF4q0Xlguvu44mhtLOpp2uQKQg93AHADoBUwjt4UIyRBeknEfnnb2LgLgbVWhvv07yzbgLNaznY00DWGA0qQElOPEAYLdqCoVNGKoSzfq25tNpsTEHf0hRU5w0tJ9I Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestServerBasicOps-21443856 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4cec9320ebcb44f8a1b7ff3053ac854d Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bbda6260-64af-468c-827c-90d50b4664c9'} Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:09.776566 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Returning 404 to user: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b62fbeb9-499a-420e-aa6c-163b1fcb4f82 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 404 len: 111 microversion: 2.1 time: 0.048115 Jul 19 20:27:09.783396 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2795/5693] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:09 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:27:11.103911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:11.105083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:11.112749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:11.113898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:11.122097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:11.123236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:11.149554 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] HTTP exception thrown: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Request method failure captured: Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 HTTP/1.1 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xJVqSgqUECuNdh12sE8McDuJR-mjypaLjLmjZ8WQe1vQ7E9GeF4q0Xlguvu44mhtLOpp2uQKQg93AHADoBUwjt4UIyRBeknEfnnb2LgLgbVWhvv07yzbgLNaznY00DWGA0qQElOPEAYLdqCoVNGKoSzfq25tNpsTEHf0hRU5w0tJ9I Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 4cec9320ebcb44f8a1b7ff3053ac854d Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'bbda6260-64af-468c-827c-90d50b4664c9'} Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:11.151715 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.156046 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.159342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Returning 404 to user: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:11.161035 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c86a286b-61c6-47c6-ba08-7e69566f1e7c tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 404 len: 111 microversion: 2.1 time: 0.061246 Jul 19 20:27:11.161794 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2899/5694] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:27:11 2022] DELETE /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:27:11.172478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:11.173095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] [instance: bbda6260-64af-468c-827c-90d50b4664c9] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:11.180540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:11.181002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:11.181835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:11.182291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:11.198022 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] HTTP exception thrown: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Request method failure captured: Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 HTTP/1.1 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xJVqSgqUECuNdh12sE8McDuJR-mjypaLjLmjZ8WQe1vQ7E9GeF4q0Xlguvu44mhtLOpp2uQKQg93AHADoBUwjt4UIyRBeknEfnnb2LgLgbVWhvv07yzbgLNaznY00DWGA0qQElOPEAYLdqCoVNGKoSzfq25tNpsTEHf0hRU5w0tJ9I Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae58fbe35c348f290d04b1a22811516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 2ae58fbe35c348f290d04b1a22811516 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestServerBasicOps-21443856 Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4cec9320ebcb44f8a1b7ff3053ac854d Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestServerBasicOps-21443856-project Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'bbda6260-64af-468c-827c-90d50b4664c9'} Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.199936 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Returning 404 to user: Instance bbda6260-64af-468c-827c-90d50b4664c9 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2a2acc4-9f89-413d-b6fa-72c7ecfaafb2 tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9" status: 404 len: 111 microversion: 2.1 time: 0.034623 Jul 19 20:27:11.204166 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2796/5695] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:11 2022] GET /compute/v2.1/servers/bbda6260-64af-468c-827c-90d50b4664c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:27:11.485162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-889b76a7-47a5-4ee6-b2a3-bf2674571d5e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] Calling method '.version_select at 0x7f23eec0df70>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:11.522015 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-889b76a7-47a5-4ee6-b2a3-bf2674571d5e tempest-TestServerBasicOps-21443856 tempest-TestServerBasicOps-21443856-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-399791663" status: 202 len: 0 microversion: 2.1 time: 0.043663 Jul 19 20:27:11.523211 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2900/5696] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 20:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-399791663 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:27:23.630851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-587286653", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "b35d6d79-6eab-4958-b11f-88c28da03169"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:23.643573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:23.645129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:23.710245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] validate_networks() for [('b35d6d79-6eab-4958-b11f-88c28da03169', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:27:24.518028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:27:24.519285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:27:24.520337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:27:24.520871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:27:24.521391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:27:24.541438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:24.542145 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:24.543520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:24.544540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:24.572131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Getting quotas for project d9fe1901156747cea6abc7fe2df88863. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:27:24.581175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Getting quotas for user d72cce68e2e042d2bf59f5e70d756af6 and project d9fe1901156747cea6abc7fe2df88863. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:27:24.606723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:27:24.612933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:27:24.690783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92abfa41-9cf1-4f9d-9a3f-a27c7df5f25b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063729 Jul 19 20:27:24.693232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2797/5697] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:27:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:27:24.705885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-967bae5d-39ee-41b6-8de1-ded3538beaaf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:24.708051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-967bae5d-39ee-41b6-8de1-ded3538beaaf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:24.712853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:24.713881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:24.839182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-967bae5d-39ee-41b6-8de1-ded3538beaaf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:24.852826 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-967bae5d-39ee-41b6-8de1-ded3538beaaf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1218 microversion: 2.1 time: 0.151286 Jul 19 20:27:24.855065 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2901/5698] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:24 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:25.876691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:25.877630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:25.884913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:25.885733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:25.888897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:25.889526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:25.999702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:26.010677 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76758c68-5ce1-4a53-9f48-d3501081f696 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1214 microversion: 2.1 time: 0.142436 Jul 19 20:27:26.012151 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2798/5699] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:25 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:27.037749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:27.038831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:27.059934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:27.065888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:27.069032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:27.076331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:27.199755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:27.212586 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5316265-9641-48d5-b631-22b779179ed8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1276 microversion: 2.1 time: 0.181333 Jul 19 20:27:27.213601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2902/5700] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:27 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:28.239171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:28.240297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:28.251766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.252680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.254324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.255939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.432988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:28.443755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce4cd411-19e5-4490-82af-2b9f58d5beeb tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.209535 Jul 19 20:27:28.444570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2799/5701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:28 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:28.817373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-887ca1b7-ff1b-4eda-81aa-58461cc80eaf req-6116a281-73fc-4aea-bdcd-231edd733327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76a6ed8-fed9-48df-90ba-1f86fc15bcea", "tag": "f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:28.827377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-887ca1b7-ff1b-4eda-81aa-58461cc80eaf req-6116a281-73fc-4aea-bdcd-231edd733327 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:28.827806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-887ca1b7-ff1b-4eda-81aa-58461cc80eaf req-6116a281-73fc-4aea-bdcd-231edd733327 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:28.840479 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-887ca1b7-ff1b-4eda-81aa-58461cc80eaf req-6116a281-73fc-4aea-bdcd-231edd733327 service nova] Creating event network-changed:f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a for instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea on n-h2-843834-3 Jul 19 20:27:28.846030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-887ca1b7-ff1b-4eda-81aa-58461cc80eaf req-6116a281-73fc-4aea-bdcd-231edd733327 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202018 Jul 19 20:27:28.846652 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2903/5702] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:29.192401 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:27:29.192634 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:27:29.462528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:29.462528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:29.470111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:29.470635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:29.471479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:29.471913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:29.621826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:29.630410 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c3f07b90-eef2-4952-b6ac-85df697f6aa8 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.172367 Jul 19 20:27:29.631122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2800/5703] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:29 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:30.655526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:30.657963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:30.670644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:30.671334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:30.672351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:30.674097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:30.876626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:30.886131 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9ab856f-71f4-4d56-829c-0f8eedd6b38b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.240263 Jul 19 20:27:30.887077 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2904/5704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:30 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:31.905910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:31.907231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:31.917216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:31.917794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:31.918721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:31.919289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:32.173010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:32.185302 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a56b482c-5f22-42f3-9acf-fd498768742b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.284742 Jul 19 20:27:32.189871 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2801/5705] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:31 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:33.205219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:33.206449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:33.219046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:33.219772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:33.220841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:33.221501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:33.449309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:33.465331 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58209ce6-87c8-4856-850a-55d7965a2aa7 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.265251 Jul 19 20:27:33.466475 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2905/5706] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:33 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:34.061265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4b8a792e-3016-4c66-a79d-fc535b74956c req-fcbead05-a984-4433-8885-55168689579d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a6ed8-fed9-48df-90ba-1f86fc15bcea", "name": "network-vif-plugged", "status": "completed", "tag": "f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:34.080371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4b8a792e-3016-4c66-a79d-fc535b74956c req-fcbead05-a984-4433-8885-55168689579d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:34.081369 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4b8a792e-3016-4c66-a79d-fc535b74956c req-fcbead05-a984-4433-8885-55168689579d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:34.099166 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4b8a792e-3016-4c66-a79d-fc535b74956c req-fcbead05-a984-4433-8885-55168689579d service nova] Creating event network-vif-plugged:f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a for instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea on n-h2-843834-3 Jul 19 20:27:34.105556 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4b8a792e-3016-4c66-a79d-fc535b74956c req-fcbead05-a984-4433-8885-55168689579d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050341 Jul 19 20:27:34.106392 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2802/5707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:27:34.494382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:34.495272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:34.504831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:34.505611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:34.506635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:34.507216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:34.748945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:34.760811 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-63224a43-e5d8-4f4d-a31a-9a3b93348429 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1318 microversion: 2.1 time: 0.271896 Jul 19 20:27:34.761547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2906/5708] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:34 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:35.777561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:35.779846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:35.789915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:35.791187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:35.804819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:35.804819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:35.805637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:35.806182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:36.004197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:36.017120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1146289386", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0537a9e4-d85d-4949-b4a7-6005918f5b91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:36.019529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb1192b3-b86b-40cd-8746-899283c91f4f tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1506 microversion: 2.1 time: 0.243600 Jul 19 20:27:36.020596 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2803/5709] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:35 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:36.030212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:36.121848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:27:36.732711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:27:36.733150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:27:36.733630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:27:36.734043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:27:36.734458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:27:36.747758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:36.748703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:36.750321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:36.751074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:36.778671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:27:36.790180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:27:37.112067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:27:37.116263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0537a9e4-d85d-4949-b4a7-6005918f5b91',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:27:37.331004 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf428fdf-8883-423a-b593-aef2c3b4adf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317737 Jul 19 20:27:37.332726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2907/5710] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:27:37.348011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30ad0e2c-affa-4071-89de-cc0c519a4739 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:37.349399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30ad0e2c-affa-4071-89de-cc0c519a4739 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:37.445540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30ad0e2c-affa-4071-89de-cc0c519a4739 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:37.462633 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30ad0e2c-affa-4071-89de-cc0c519a4739 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1071 microversion: 2.1 time: 0.120782 Jul 19 20:27:37.463724 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2804/5711] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:37 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1071 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:38.488249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:38.489141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:38.502656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:38.503747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:38.505176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:38.505868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:38.643315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:38.682773 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1717ee30-f82a-43dc-a53d-833c6d90801d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1169 microversion: 2.1 time: 0.195270 Jul 19 20:27:38.684508 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2908/5712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:38 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1169 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:39.715852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:39.717395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:39.728310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:39.728860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:39.729921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:39.730445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:39.855556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:39.880856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca2de7c8-cd71-478f-b207-e3bce90b8b76 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1187 microversion: 2.1 time: 0.171606 Jul 19 20:27:39.883644 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2805/5713] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:39 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:40.913722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:40.917798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:40.938842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:40.942071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:40.945681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:40.947440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:41.355288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:41.365645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5dda6b99-43ea-4636-8147-dd6905baf85a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1229 microversion: 2.1 time: 0.459960 Jul 19 20:27:41.371228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2909/5714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:40 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1229 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:41.635279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-910e6d5d-a046-46b4-9530-a609108d114d req-7dab362c-9eb3-403d-9a70-7bdee034af5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0b90ee-a463-4693-ae0c-6468b6d7f5ef", "tag": "132f60ef-7e6e-49d1-a3be-a14c2dccfd6c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:41.673607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-910e6d5d-a046-46b4-9530-a609108d114d req-7dab362c-9eb3-403d-9a70-7bdee034af5f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:41.679017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-910e6d5d-a046-46b4-9530-a609108d114d req-7dab362c-9eb3-403d-9a70-7bdee034af5f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:41.723102 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-910e6d5d-a046-46b4-9530-a609108d114d req-7dab362c-9eb3-403d-9a70-7bdee034af5f service nova] Creating event network-changed:132f60ef-7e6e-49d1-a3be-a14c2dccfd6c for instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef on n-h1-843834-3 Jul 19 20:27:41.736218 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-910e6d5d-a046-46b4-9530-a609108d114d req-7dab362c-9eb3-403d-9a70-7bdee034af5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137681 Jul 19 20:27:41.738234 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2806/5715] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:42.396225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:42.400993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:42.438562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:42.439754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:42.443401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:42.444940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:42.802458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:42.813380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f678f639-aec8-41e9-85cc-37a8f27d31ec tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1229 microversion: 2.1 time: 0.429533 Jul 19 20:27:42.825184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2910/5716] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:42 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1229 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:43.833903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:43.834825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:43.842217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:43.842771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:43.843606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:43.844435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:44.035621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:44.054739 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d799ae4a-b9ca-4d11-bb3f-e56f4ffb440c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1229 microversion: 2.1 time: 0.225723 Jul 19 20:27:44.066949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2807/5717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:43 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1229 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:45.089605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:45.089605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:45.101320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:45.102538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:45.104432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:45.105534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:45.400870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:45.413573 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c202739c-58f3-456d-9563-840d9c5cfd2a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1229 microversion: 2.1 time: 0.335908 Jul 19 20:27:45.429539 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2911/5718] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:45 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1229 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:46.438242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:46.439220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:46.456490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:46.457107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:46.458039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:46.458578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:46.719515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:46.738483 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88921f51-1a97-48d8-8c35-2921fd63ae6c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1229 microversion: 2.1 time: 0.308396 Jul 19 20:27:46.740475 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2808/5719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:46 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1229 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:47.769580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:47.770526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:47.773901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:47.774647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:47.786851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:47.787714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:47.793791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:47.793791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:47.991205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:48.004694 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bbceea03-0afb-4e13-9a15-b39d92204bf8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.241873 Jul 19 20:27:48.005638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2912/5720] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:47 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:49.025722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:49.026903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:49.031789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:49.038733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:49.039686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:49.041091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:49.041814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:49.230229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:49.245747 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-26605600-9ddd-4972-a97d-efc2facd15c2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.225436 Jul 19 20:27:49.246721 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2809/5721] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:49 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:50.270720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:50.271694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:50.279878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:50.280344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:50.281149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:50.281594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:50.502419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:50.518247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f23cd6f-809c-4e74-9837-35545d3ede0b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.251250 Jul 19 20:27:50.519344 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2913/5722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:50 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:51.539991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:51.541059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:51.554124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:51.554609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:51.555786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:51.556271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:51.763391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:51.783712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c14930c4-3754-4bf7-a493-ab1c637c7bd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.250432 Jul 19 20:27:51.785093 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2810/5723] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:51 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:52.812379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:52.813385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:52.822682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:52.823602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:52.824850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:52.825483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:53.035914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:53.047938 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2c9246c-ec30-47d7-9452-3d74d5347bf1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.242445 Jul 19 20:27:53.059449 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2914/5724] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:52 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:54.067073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:54.068122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:54.071850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:54.084981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:54.085627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:54.087083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:54.087897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:54.096576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=67 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:54.360637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:54.372181 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-255fd17d-cca7-49a1-a5e3-a7df753a332e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.308872 Jul 19 20:27:54.374293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2811/5725] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:54 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:55.403372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:55.404396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:55.408701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:55.421551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:55.422931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:55.424396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:55.425177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:55.435051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=71 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:27:55.623873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:55.639108 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f672e82f-99e5-48a9-a3cb-f11553a6788c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.243364 Jul 19 20:27:55.640172 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2915/5726] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:55 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:56.290509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1400975d-eb9e-4886-8401-47159daa2df0 req-f9c0fb06-9906-4060-8fa8-0813bf8b6f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0b90ee-a463-4693-ae0c-6468b6d7f5ef", "name": "network-vif-plugged", "status": "completed", "tag": "132f60ef-7e6e-49d1-a3be-a14c2dccfd6c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:56.310728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1400975d-eb9e-4886-8401-47159daa2df0 req-f9c0fb06-9906-4060-8fa8-0813bf8b6f85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:56.311540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1400975d-eb9e-4886-8401-47159daa2df0 req-f9c0fb06-9906-4060-8fa8-0813bf8b6f85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:56.334902 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1400975d-eb9e-4886-8401-47159daa2df0 req-f9c0fb06-9906-4060-8fa8-0813bf8b6f85 service nova] Creating event network-vif-plugged:132f60ef-7e6e-49d1-a3be-a14c2dccfd6c for instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef on n-h1-843834-3 Jul 19 20:27:56.346089 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1400975d-eb9e-4886-8401-47159daa2df0 req-f9c0fb06-9906-4060-8fa8-0813bf8b6f85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061977 Jul 19 20:27:56.348150 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2812/5727] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:27:56.663165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:56.664322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:56.677110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:56.677935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:56.679476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:56.680280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:56.935462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:56.945517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91a30ed8-6690-46a2-9f9a-22138be08be0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1217 microversion: 2.1 time: 0.290183 Jul 19 20:27:56.946357 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2916/5728] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:56 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:27:57.972642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:57.975881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:57.997031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:57.997840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:57.999709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.000498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:58.281481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:58.295982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2400a473-a8cf-446b-b413-d25a48adf49b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1405 microversion: 2.1 time: 0.331547 Jul 19 20:27:58.297696 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2813/5729] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:57 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:58.317597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:27:58.318630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:58.332762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.333494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:58.334765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.335513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:58.550791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:27:58.561408 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d1e6fead-1ac7-4326-9883-97ac897910d2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1405 microversion: 2.1 time: 0.250823 Jul 19 20:27:58.562229 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2917/5730] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:27:58 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:27:58.584151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1531086016"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:58.586545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:58.596114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.596672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:58.597737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:58.598277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:59.078140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Attempting to quiesce instance before volume snapshot. Jul 19 20:27:59.137631 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 19 20:27:59.267158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Creating snapshot from volume 0537a9e4-d85d-4949-b4a7-6005918f5b91. {{(pid=131230) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 19 20:27:59.626782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9b08aa4-48a8-4ad8-8669-bb2785ed82a2", "device": "/dev/sdb"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:27:59.629333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:27:59.641853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:59.642606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:27:59.644178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:27:59.644908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:00.079193 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f030c7d1-6b30-4d2d-9b99-61140eb8cad5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "POST /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459431 Jul 19 20:28:00.080561 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2918/5731] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:27:59 2022] POST /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:28:00.927392 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65bd27ed-5eed-4941-b040-a0874626d068 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef/action" status: 202 len: 0 microversion: 2.1 time: 2.349059 Jul 19 20:28:00.937676 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2814/5732] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:27:58 2022] POST /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef/action => generated 0 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 20:28:02.194021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1809845888", "imageRef": "c555ef8e-d270-4fb4-bd37-a02e528d83ac", "flavorRef": "452", "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:02.272836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:28:02.785756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:28:02.786589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:28:02.787512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:28:02.788108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:28:02.788888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:28:02.802283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:02.802879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:02.803864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:02.804422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:02.828536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:02.835570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:02.852701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:28:02.857615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b503d899-29f0-4b78-8100-652700b1b72a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:28:02.978122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-369a8655-643e-4c51-8021-d694f41fb9bf tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791393 Jul 19 20:28:02.979748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2919/5733] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:28:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:28:02.996634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc9b210f-59e8-4123-b2ef-1e20d738e58e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:02.998962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc9b210f-59e8-4123-b2ef-1e20d738e58e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:03.088708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc9b210f-59e8-4123-b2ef-1e20d738e58e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:03.098546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc9b210f-59e8-4123-b2ef-1e20d738e58e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1230 microversion: 2.1 time: 0.110970 Jul 19 20:28:03.099481 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2815/5734] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:02 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:04.137983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:04.142031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:04.162440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.163678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:04.165101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:04.166004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:04.291829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:04.307164 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-670f3411-8264-4ee7-9dc1-06572e7e1c26 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1282 microversion: 2.1 time: 0.183431 Jul 19 20:28:04.308262 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2920/5735] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:04 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:05.348745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:05.352066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:05.381902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:05.386300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:05.393667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:05.394773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:05.741410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:05.753848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0f347d5-f57b-4099-9213-36205a146947 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.423367 Jul 19 20:28:05.754784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2816/5736] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:05 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:06.778785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:06.781093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:06.807592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:06.808862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:06.810637 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:06.811871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:07.278168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-44be3d19-17b6-4609-a2a7-09a1c17397aa req-008b733f-ada9-42e0-8b6f-be22645aadef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d2a32b-30d0-49bc-82bb-36e73e00808e", "tag": "a471a74e-b365-4460-a235-5bb7ba745b45"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:07.285913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:07.315784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-44be3d19-17b6-4609-a2a7-09a1c17397aa req-008b733f-ada9-42e0-8b6f-be22645aadef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:07.316574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-44be3d19-17b6-4609-a2a7-09a1c17397aa req-008b733f-ada9-42e0-8b6f-be22645aadef service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:07.322277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7eb3fa74-0612-4d84-bcef-c92226a8a392 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.551374 Jul 19 20:28:07.325305 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2921/5737] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:06 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:07.365904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-44be3d19-17b6-4609-a2a7-09a1c17397aa req-008b733f-ada9-42e0-8b6f-be22645aadef service nova] Creating event network-changed:a471a74e-b365-4460-a235-5bb7ba745b45 for instance c0d2a32b-30d0-49bc-82bb-36e73e00808e on n-h1-843834-3 Jul 19 20:28:07.383162 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-44be3d19-17b6-4609-a2a7-09a1c17397aa req-008b733f-ada9-42e0-8b6f-be22645aadef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111161 Jul 19 20:28:07.385491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2817/5738] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:08.344848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:08.346991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:08.360173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:08.361188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:08.362789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:08.363711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:08.753222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:08.763623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fdb15f00-e780-4ef1-81e1-c38236f9d32f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.425701 Jul 19 20:28:08.765012 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2922/5739] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:08 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:09.788679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:09.789889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:09.801267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:09.802129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:09.803703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:09.804484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:09.980165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:09.993661 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a276e080-480c-4e07-b0f4-3285f84642bc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.214634 Jul 19 20:28:09.994687 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2818/5740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:09 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:11.018951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:11.022385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:11.041742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:11.043181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:11.045426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:11.046544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:11.305398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:11.323466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0f9b100-ac12-4cf1-95e3-a3985e186d85 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.310358 Jul 19 20:28:11.326022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2923/5741] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:11 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:12.358005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:12.359358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:12.371380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:12.372005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:12.372976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:12.373614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:12.632929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:12.648148 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d113f226-9ddd-460d-b1e8-6b831f4c809e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.297433 Jul 19 20:28:12.649042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2819/5742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:12 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:13.669712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:13.670448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:13.680180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:13.680990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:13.684889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:13.685505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:13.686307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:13.686771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:13.902631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:13.919222 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-946cf4b2-5ba7-4f2e-9ef5-df9540324a30 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.254543 Jul 19 20:28:13.924233 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2924/5743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:13 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:14.958752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:14.973784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:14.979254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:14.993999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:14.995377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:14.997923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:14.999068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:15.225249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:15.248993 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9d1a13a3-4c12-4fc2-b43e-09e55d2beb32 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.302152 Jul 19 20:28:15.263134 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2820/5744] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:14 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:16.284140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:16.285956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:16.298643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:16.300525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:16.301991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:16.303117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:16.571359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:16.588315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-680ed38e-977d-48d8-8d19-3f8092cb5515 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.311231 Jul 19 20:28:16.589395 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2925/5745] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:16 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:17.606863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:17.607993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:17.617438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:17.618164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:17.619175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:17.619780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:17.806037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:17.820336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aef008ff-0a2b-45e4-a827-99e2c1590397 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.217580 Jul 19 20:28:17.822163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2821/5746] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:17 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:18.851184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:18.852576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:18.873462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:18.874456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:18.876211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:18.877425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:19.140739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:19.155605 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eeb15b49-35c1-47c7-ada8-8dcc9f0079f3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.310289 Jul 19 20:28:19.156727 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2926/5747] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:18 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:20.189197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:20.190490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:20.207838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:20.208832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:20.211197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:20.211975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:20.510580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:20.533146 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4add6cf-8c41-4e19-bb9b-244050fd03b6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.353242 Jul 19 20:28:20.534104 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2822/5748] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:20 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:21.558417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:21.560755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:21.574436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:21.575410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:21.577647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:21.578360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:21.811379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:21.822189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f719614e-3a77-4dc8-873c-29fdfd212565 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.271150 Jul 19 20:28:21.823994 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2927/5749] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:21 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:22.861303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:22.862061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:22.890056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:22.890859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:22.892710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:22.893535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:23.187448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:23.202466 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e33b8dc9-e0d8-4fc4-8319-c032b6bef62f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.354571 Jul 19 20:28:23.203507 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2823/5750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:22 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:24.242437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:24.246825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:24.262899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:24.264493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:24.266558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:24.267692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:24.602942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:24.618701 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e733161-4d04-4922-bc48-94481b481f52 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1342 microversion: 2.1 time: 0.393225 Jul 19 20:28:24.634086 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2928/5751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:24 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1342 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:25.645746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:25.647177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:25.651863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:25.661524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:25.662439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:25.663997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:25.664990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:25.668579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:26.032812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:26.042809 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-687a1edd-9b7b-4c1e-bbca-c0d49a36397b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.404068 Jul 19 20:28:26.043697 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2824/5752] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:25 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:27.064992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:27.065681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:27.068179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:27.075232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:27.075686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:27.076503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:27.076942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:27.081593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:27.303873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:27.314580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ae6bbfec-5f1d-44df-a4bc-9dbc3d4c333f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.253366 Jul 19 20:28:27.315774 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2929/5753] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:27 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:28.348972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:28.350323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:28.365363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:28.366094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:28.369627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:28.370683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:28.646795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:28.666959 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3fcae8d5-958a-4c35-b643-712bc523152e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.325150 Jul 19 20:28:28.669415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2825/5754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:28 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:29.701740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:29.702995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:29.715461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.716205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.717548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:29.718291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:29.939805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:29.955783 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d876a24e-389e-4108-abbc-095bc7bc15b8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.260725 Jul 19 20:28:29.956695 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2930/5755] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:29 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:30.982640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:30.983529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:30.996813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:30.997327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:30.998376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:30.998946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:31.269800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:31.286515 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-57f4ad1b-0c90-4054-9ee0-eadb7f2d902e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.311399 Jul 19 20:28:31.287924 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2826/5756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:30 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:31.699492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:31.700964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:31.716180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:31.717207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:31.719059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:31.720059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:31.855855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lazy-loading 'services' on Instance uuid c76a6ed8-fed9-48df-90ba-1f86fc15bcea {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:28:31.950401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90ee19b9-7926-48d0-8050-91d9b581cd32 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea/os-volume_attachments/e9b08aa4-48a8-4ad8-8669-bb2785ed82a2" status: 202 len: 0 microversion: 2.1 time: 0.259535 Jul 19 20:28:31.951829 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2931/5757] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:28:31 2022] DELETE /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea/os-volume_attachments/e9b08aa4-48a8-4ad8-8669-bb2785ed82a2 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:28:32.311999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:32.313041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:32.323029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:32.323594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:32.324644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:32.325223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:32.526580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:32.545357 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b0661fbf-b519-40c4-be99-9ae70a657340 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.237886 Jul 19 20:28:32.546317 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2827/5758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:32 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:33.572681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:33.573530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:33.581059 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:33.581929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:33.583574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:33.584410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:33.791786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:33.801369 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8fa74704-f7a8-4720-94ca-8d21f1f437d6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.238198 Jul 19 20:28:33.802495 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2932/5759] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:33 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:34.643234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1ac63fdb-8701-4fbc-ac7d-e08aa9b47d8f req-9d9b6901-4592-44b4-88ab-49e1d8e458ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d2a32b-30d0-49bc-82bb-36e73e00808e", "name": "network-vif-plugged", "status": "completed", "tag": "a471a74e-b365-4460-a235-5bb7ba745b45"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:34.665240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1ac63fdb-8701-4fbc-ac7d-e08aa9b47d8f req-9d9b6901-4592-44b4-88ab-49e1d8e458ae service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:34.666211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1ac63fdb-8701-4fbc-ac7d-e08aa9b47d8f req-9d9b6901-4592-44b4-88ab-49e1d8e458ae service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:34.692220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1ac63fdb-8701-4fbc-ac7d-e08aa9b47d8f req-9d9b6901-4592-44b4-88ab-49e1d8e458ae service nova] Creating event network-vif-plugged:a471a74e-b365-4460-a235-5bb7ba745b45 for instance c0d2a32b-30d0-49bc-82bb-36e73e00808e on n-h1-843834-3 Jul 19 20:28:34.704102 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1ac63fdb-8701-4fbc-ac7d-e08aa9b47d8f req-9d9b6901-4592-44b4-88ab-49e1d8e458ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069442 Jul 19 20:28:34.705726 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2828/5760] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:34.828115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:34.829234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:34.845705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:34.846381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:34.848280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:34.849409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:35.644566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:35.659461 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-092149be-2345-4e06-8f35-b4c7fbd4984d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1376 microversion: 2.1 time: 0.840453 Jul 19 20:28:35.660415 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2933/5761] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:34 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1376 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:36.687055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:36.687820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:36.699524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:36.700301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:36.701689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:36.702290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:36.921506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:36.935609 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d398b7d-4187-461c-b536-77fbafb602e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1564 microversion: 2.1 time: 0.253428 Jul 19 20:28:36.936685 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2829/5762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:36 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:36.958832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:36.959932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:36.972336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:36.973540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:36.975036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:36.975800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:37.155127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:37.165719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dd976ea-e37d-4846-8ad9-de7776b8e382 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1564 microversion: 2.1 time: 0.214783 Jul 19 20:28:37.166504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2934/5763] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:36 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:37.252282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:37.253031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:37.261706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:37.262389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:37.263512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:37.264115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:37.299539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:28:37.406669 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d6ad47d2-a675-4bb6-87db-3054e53bdfac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 204 len: 0 microversion: 2.1 time: 0.158554 Jul 19 20:28:37.410470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2830/5764] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:28:37 2022] DELETE /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:28:37.419148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:37.419796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:37.427679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:37.428141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:37.429162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:37.429419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:37.643575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:37.652821 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-65d406f9-1fe5-434e-be5d-bd94ceda5355 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1570 microversion: 2.1 time: 0.237696 Jul 19 20:28:37.653463 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2935/5765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:37 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:38.674132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:38.675477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:38.687445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:38.687954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:38.688834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:38.689277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:38.903076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:38.916291 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a25dde5-bcf1-43c1-8b78-ce077d700519 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1570 microversion: 2.1 time: 0.249110 Jul 19 20:28:38.916954 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2831/5766] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:38 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:39.762507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:39.763474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:39.777828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:39.778624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:39.780126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:39.781052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:39.839415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:28:39.953648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:39.957752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:39.977244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:39.978586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:39.988480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:39.989975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:40.062340 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee432288-2dd8-47e6-80d4-03364d97f555 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 204 len: 0 microversion: 2.1 time: 0.306061 Jul 19 20:28:40.064888 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2936/5767] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:28:39 2022] DELETE /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:28:40.079379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-dced17f5-2742-4b98-a85b-fe69d41e5890 req-10004b33-b53c-47ff-a0eb-a86251f6cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d2a32b-30d0-49bc-82bb-36e73e00808e", "name": "network-vif-deleted", "tag": "a471a74e-b365-4460-a235-5bb7ba745b45"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:40.099604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-dced17f5-2742-4b98-a85b-fe69d41e5890 req-10004b33-b53c-47ff-a0eb-a86251f6cc71 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:40.100464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-dced17f5-2742-4b98-a85b-fe69d41e5890 req-10004b33-b53c-47ff-a0eb-a86251f6cc71 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:40.132022 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-dced17f5-2742-4b98-a85b-fe69d41e5890 req-10004b33-b53c-47ff-a0eb-a86251f6cc71 service nova] Creating event network-vif-deleted:a471a74e-b365-4460-a235-5bb7ba745b45 for instance c0d2a32b-30d0-49bc-82bb-36e73e00808e on n-h1-843834-3 Jul 19 20:28:40.142195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-dced17f5-2742-4b98-a85b-fe69d41e5890 req-10004b33-b53c-47ff-a0eb-a86251f6cc71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074905 Jul 19 20:28:40.143319 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2937/5768] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:40.150265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:40.151127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:40.202597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:40.203149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:40.204307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:40.204867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:40.205244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:40.224236 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8c2cfad-1f82-40c0-8efd-a0703ef143c3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1528 microversion: 2.1 time: 0.287703 Jul 19 20:28:40.226192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2832/5769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:39 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1528 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:40.451756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:40.469520 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-691ff670-2493-4509-8dce-6554e21719fa tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1512 microversion: 2.1 time: 0.324553 Jul 19 20:28:40.471052 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2938/5770] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:40 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:41.259189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:41.261675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:41.272963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:41.273852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:41.275419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:41.276253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:41.406126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:41.424517 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-36e90f9b-87c3-4a71-ace1-63512fc56580 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1361 microversion: 2.1 time: 0.173281 Jul 19 20:28:41.425772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2833/5771] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:41 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:41.497418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:41.498302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:41.508451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:41.509140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:41.510526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:41.511296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:41.988330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:42.006011 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-706eb0c9-08f0-4f19-9134-9f968e3e5a04 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1512 microversion: 2.1 time: 0.512329 Jul 19 20:28:42.007481 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2939/5772] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:41 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:42.451794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:42.452819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:42.471360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:42.471578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:42.473608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:42.474187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:42.588705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:42.600240 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-578dc58b-e7d9-4735-af66-50b30ab96b6d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1361 microversion: 2.1 time: 0.153236 Jul 19 20:28:42.601793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2834/5773] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:42 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:42.615180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8ce0da0e-f0e2-4c1c-8a1e-8de3854d4324 req-4a1e4a19-6f48-43f4-8d51-f635b44cf704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a6ed8-fed9-48df-90ba-1f86fc15bcea", "name": "network-vif-deleted", "tag": "f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:42.631337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8ce0da0e-f0e2-4c1c-8a1e-8de3854d4324 req-4a1e4a19-6f48-43f4-8d51-f635b44cf704 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:42.631337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8ce0da0e-f0e2-4c1c-8a1e-8de3854d4324 req-4a1e4a19-6f48-43f4-8d51-f635b44cf704 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:42.651750 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8ce0da0e-f0e2-4c1c-8a1e-8de3854d4324 req-4a1e4a19-6f48-43f4-8d51-f635b44cf704 service nova] Creating event network-vif-deleted:f88c774d-5b6c-4304-a8c9-f8b6a39b8b9a for instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea on n-h2-843834-3 Jul 19 20:28:42.658981 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8ce0da0e-f0e2-4c1c-8a1e-8de3854d4324 req-4a1e4a19-6f48-43f4-8d51-f635b44cf704 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048779 Jul 19 20:28:42.658981 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2940/5774] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:43.032138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:43.033402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:43.047429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:43.048601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:43.050106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:43.050953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:43.132258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:43.134000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:43.135088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lazy-loading 'fault' on Instance uuid c76a6ed8-fed9-48df-90ba-1f86fc15bcea {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:28:43.209947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:43.229593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21e734e7-f958-446b-a040-ce8a477fd47a tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 200 len: 1308 microversion: 2.1 time: 0.204885 Jul 19 20:28:43.239695 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2835/5775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:43 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:43.622605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:43.623354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:43.631569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:43.632026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:43.633086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:43.633636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:43.724445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:43.740029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1342ef6d-fca1-42d3-a7c9-16abd9368a5e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1361 microversion: 2.1 time: 0.122936 Jul 19 20:28:43.741182 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2941/5776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:43 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1361 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:44.261334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:44.262492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: c76a6ed8-fed9-48df-90ba-1f86fc15bcea] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:44.276676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:44.277502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:44.279269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:44.281785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:44.316584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] HTTP exception thrown: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Request method failure captured: Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea HTTP/1.1 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xNcE70oLoDZ6XH5ckDGKUFpB2Eb33TAx8NSLzgLbHYrjQpY7zMYHFsPcPMvYPAOpOH23HNP4TMUHYBwjcm8M6w3U1CJ9lPvdK5nzjyHa7jxt--bxnuQuX2UYL-YruwKEk45ubDTH6eB4IwmZqvbQ7iTsp-TShziL41XhcpVW829AQ0 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d9fe1901156747cea6abc7fe2df88863 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d9fe1901156747cea6abc7fe2df88863 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesSnapshotTestJSON-374230135-project Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d72cce68e2e042d2bf59f5e70d756af6 Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesSnapshotTestJSON-374230135-project Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c76a6ed8-fed9-48df-90ba-1f86fc15bcea'} Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:44.319977 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Returning 404 to user: Instance c76a6ed8-fed9-48df-90ba-1f86fc15bcea could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ff779453-0941-4e1a-a124-ee26de0c7309 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea" status: 404 len: 111 microversion: 2.1 time: 0.069798 Jul 19 20:28:44.330712 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2836/5777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:44 2022] GET /compute/v2.1/servers/c76a6ed8-fed9-48df-90ba-1f86fc15bcea => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:28:44.765641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:44.767704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:44.779821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:44.781595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:44.785139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:44.786404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:44.965429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:44.980346 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8007b369-da75-4555-93b4-a82f0c8c21f7 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1361 microversion: 2.1 time: 0.221836 Jul 19 20:28:44.981800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2942/5778] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:44 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:46.010336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:46.014106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:46.037490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:46.039737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:46.042764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:46.045296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:46.192250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:46.202659 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3e98c03f-8179-4368-8a0b-9919d9a24fd3 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1361 microversion: 2.1 time: 0.201573 Jul 19 20:28:46.213483 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2837/5779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:45 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:47.224493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:47.225696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:47.239562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:47.240217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:47.241633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:47.242204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:47.296620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:47.297406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:47.298242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lazy-loading 'fault' on Instance uuid c0d2a32b-30d0-49bc-82bb-36e73e00808e {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:28:47.379318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:47.396096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef0be55f-bb87-4269-bdd8-ba6f7a887ff4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 200 len: 1366 microversion: 2.1 time: 0.178723 Jul 19 20:28:47.397689 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2943/5780] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:47 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:48.437753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:48.439054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:48.456514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:48.458086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:48.460006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:48.461514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:48.496815 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e HTTP/1.1 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c0d2a32b-30d0-49bc-82bb-36e73e00808e'} Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:28:48.500472 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a282ed24-02ac-4c9c-8783-0d76983a8974 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 404 len: 111 microversion: 2.1 time: 0.077098 Jul 19 20:28:48.513068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2838/5781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:48 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:28:54.009839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2000649588", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "b35d6d79-6eab-4958-b11f-88c28da03169"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:54.069414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] validate_networks() for [('b35d6d79-6eab-4958-b11f-88c28da03169', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:28:54.094116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:54.095199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:54.109904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.110734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.112110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.112819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.154026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:28:54.224922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:54.315227 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef8cb3b5-fe28-41e0-8c03-e39d6fb63d39 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 204 len: 0 microversion: 2.1 time: 0.228274 Jul 19 20:28:54.316286 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2839/5782] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:28:54 2022] DELETE /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:28:54.335230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:54.336647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:54.353383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.353944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.354896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.355450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.736822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:54.749740 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f12ced58-e357-4444-a010-86ca0a81b6bb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1411 microversion: 2.1 time: 0.423035 Jul 19 20:28:54.750945 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2840/5783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:54 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1411 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:54.872225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:28:54.872885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:28:54.873605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:28:54.874228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:28:54.875266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:28:54.889315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.890071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.891558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:54.892335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:54.918491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Getting quotas for project d9fe1901156747cea6abc7fe2df88863. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:28:54.925992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Getting quotas for user d72cce68e2e042d2bf59f5e70d756af6 and project d9fe1901156747cea6abc7fe2df88863. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:28:54.943449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:28:54.946306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:28:55.002873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8624932e-30e4-4f63-8eef-ba778ca62e3b tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996932 Jul 19 20:28:55.007461 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2944/5784] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:28:55.021065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e47550c-5bfd-46b8-8019-09eccd0aed35 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:55.022110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e47550c-5bfd-46b8-8019-09eccd0aed35 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:55.116730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e47550c-5bfd-46b8-8019-09eccd0aed35 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:55.130599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e47550c-5bfd-46b8-8019-09eccd0aed35 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1219 microversion: 2.1 time: 0.116792 Jul 19 20:28:55.132737 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2841/5785] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:55 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:55.781341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:55.782499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:55.796023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:55.797037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:55.798510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:55.799498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:55.808407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:56.158124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:56.159415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:56.165735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:56.171757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:56.175756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:56.176490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:56.177709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:56.178734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:56.193789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-605aab0d-2a70-4a85-a0f1-e701768c38c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1411 microversion: 2.1 time: 0.418693 Jul 19 20:28:56.195914 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2945/5786] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:55 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1411 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:56.350626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:56.363272 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-856fed84-9e1e-4830-8f75-17bd86897635 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1271 microversion: 2.1 time: 0.209433 Jul 19 20:28:56.374439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2842/5787] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:56 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:56.899515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-fde1e68e-8fb2-4b91-82ca-310d4ad9cf52 req-fa3a2045-5626-408b-af28-94b0914dd2da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0b90ee-a463-4693-ae0c-6468b6d7f5ef", "name": "network-vif-deleted", "tag": "132f60ef-7e6e-49d1-a3be-a14c2dccfd6c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:56.920927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fde1e68e-8fb2-4b91-82ca-310d4ad9cf52 req-fa3a2045-5626-408b-af28-94b0914dd2da service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:56.922461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-fde1e68e-8fb2-4b91-82ca-310d4ad9cf52 req-fa3a2045-5626-408b-af28-94b0914dd2da service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:56.951026 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-fde1e68e-8fb2-4b91-82ca-310d4ad9cf52 req-fa3a2045-5626-408b-af28-94b0914dd2da service nova] Creating event network-vif-deleted:132f60ef-7e6e-49d1-a3be-a14c2dccfd6c for instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef on n-h1-843834-3 Jul 19 20:28:56.961132 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-fde1e68e-8fb2-4b91-82ca-310d4ad9cf52 req-fa3a2045-5626-408b-af28-94b0914dd2da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070759 Jul 19 20:28:56.962667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2946/5788] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:57.223843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:57.224796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:57.240284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.241049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.242736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.243629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.398655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:57.400041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:57.401204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:57.421349 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bccd761f-a40a-4c69-b95e-9ad7a2bb0945 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.202374 Jul 19 20:28:57.422490 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2843/5789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:57 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:28:57.425213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:28:57.430854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.432276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.437183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:57.438833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:57.737370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:57.753905 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2fb1baee-bc00-4a64-97ea-d83d64cb02bf tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1319 microversion: 2.1 time: 0.372439 Jul 19 20:28:57.755075 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2947/5790] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:57 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:58.442718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:58.444012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:58.455456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:58.456780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:58.457946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:58.458956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:58.552224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:58.568204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7974ff24-9657-4528-998e-5e3fd30382bd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.130837 Jul 19 20:28:58.570605 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2844/5791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:58 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:58.711526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2b49583c-8007-473c-a05f-431366c34833 req-2971e5ce-8846-49e0-ab71-e70dda68b376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17c69a7-f5e2-46f9-a047-90e367c6e4a5", "tag": "b0d5c5f7-006c-4a14-a69c-985d5266596c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:28:58.735133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2b49583c-8007-473c-a05f-431366c34833 req-2971e5ce-8846-49e0-ab71-e70dda68b376 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:58.736609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2b49583c-8007-473c-a05f-431366c34833 req-2971e5ce-8846-49e0-ab71-e70dda68b376 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:58.761873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2b49583c-8007-473c-a05f-431366c34833 req-2971e5ce-8846-49e0-ab71-e70dda68b376 service nova] Creating event network-changed:b0d5c5f7-006c-4a14-a69c-985d5266596c for instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 on n-h2-843834-3 Jul 19 20:28:58.772663 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2b49583c-8007-473c-a05f-431366c34833 req-2971e5ce-8846-49e0-ab71-e70dda68b376 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067879 Jul 19 20:28:58.773767 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2948/5792] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:28:58.788031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:58.789298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:58.803022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:58.803914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:58.805452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:58.807096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:59.017735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:59.030515 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1546666e-8c6c-4554-8773-93e2ef125615 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1319 microversion: 2.1 time: 0.252014 Jul 19 20:28:59.031618 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2845/5793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:58 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:28:59.592417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:28:59.593243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:28:59.601208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:59.601874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:59.602776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:28:59.603336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:28:59.699990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:28:59.709598 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1550f58b-6c26-4d2e-acad-5016092bd5a5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.122147 Jul 19 20:28:59.710335 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2949/5794] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:28:59 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:00.060549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:00.061892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:00.077063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.077866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.079337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.081040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.341538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:00.361378 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-53e90a21-48de-4b2c-bcac-e8222416b7f2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1319 microversion: 2.1 time: 0.307986 Jul 19 20:29:00.379512 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2846/5795] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:00 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:00.738428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:00.740591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:00.754418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.755400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.756933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:00.758095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:00.900720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:00.911036 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e9a33231-1081-4823-88d5-2b272ee0d7f4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.180896 Jul 19 20:29:00.912604 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2950/5796] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:00 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:01.387123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:01.388286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:01.397188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.397663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:01.398592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.399169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:01.605110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:01.616649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e31c9dd9-6734-46bf-99c8-d2780ddfef96 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1319 microversion: 2.1 time: 0.233834 Jul 19 20:29:01.617532 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2847/5797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:01 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:01.942140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:01.943480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:01.956347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.957119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:01.958374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:01.959096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.059860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:02.074372 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ed43dcd-9c03-4b64-8913-0d37f869e0ef tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.139335 Jul 19 20:29:02.075492 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2951/5798] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:01 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:02.438956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3af8e02b-88cf-47a5-b078-ac2617bea5a2 req-c8fb233d-30fb-463e-bec3-6a7bc46206f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17c69a7-f5e2-46f9-a047-90e367c6e4a5", "name": "network-vif-plugged", "status": "completed", "tag": "b0d5c5f7-006c-4a14-a69c-985d5266596c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:02.454595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3af8e02b-88cf-47a5-b078-ac2617bea5a2 req-c8fb233d-30fb-463e-bec3-6a7bc46206f6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:02.455756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3af8e02b-88cf-47a5-b078-ac2617bea5a2 req-c8fb233d-30fb-463e-bec3-6a7bc46206f6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.473529 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3af8e02b-88cf-47a5-b078-ac2617bea5a2 req-c8fb233d-30fb-463e-bec3-6a7bc46206f6 service nova] Creating event network-vif-plugged:b0d5c5f7-006c-4a14-a69c-985d5266596c for instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 on n-h2-843834-3 Jul 19 20:29:02.481724 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3af8e02b-88cf-47a5-b078-ac2617bea5a2 req-c8fb233d-30fb-463e-bec3-6a7bc46206f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046683 Jul 19 20:29:02.482941 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2848/5799] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:02.640522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:02.641912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:02.654011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:02.655387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.657254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:02.658669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:02.879599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:02.890843 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e42e659-e655-4e15-a467-b2a7ae65f6df tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1319 microversion: 2.1 time: 0.258034 Jul 19 20:29:02.891608 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2952/5800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:02 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:03.103105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:03.104076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:03.120154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.122763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:03.125486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.129077 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:03.258182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:03.272800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae7eb325-99e0-41f4-9888-0f87809d1acb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 200 len: 1202 microversion: 2.1 time: 0.177800 Jul 19 20:29:03.274180 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2849/5801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:03 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:03.914657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:03.915845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:03.927712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.928320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:03.929211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:03.929801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.109181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:04.124132 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2dd2d676-bda1-438a-8b56-a6602dd8b687 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1507 microversion: 2.1 time: 0.216429 Jul 19 20:29:04.125200 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2953/5802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:03 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:04.157238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c36b7a4-37ae-4e2b-8ec5-954f82313364", "device": "/dev/sdb"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:04.159478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:04.175310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.176057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.177628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.178517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.294866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:04.297003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:04.309198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.310144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.311745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:04.312650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:04.342842 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef HTTP/1.1 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ac0b90ee-a463-4693-ae0c-6468b6d7f5ef'} Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:04.346313 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a5919eff-c4ec-43f3-acbf-8dad13314f92 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 404 len: 111 microversion: 2.1 time: 0.061089 Jul 19 20:29:04.360503 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2954/5803] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:04 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:29:04.634551 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-468bea1f-54a5-4f99-8bf7-9de69041b981 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "POST /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484885 Jul 19 20:29:04.642614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2850/5804] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:29:04 2022] POST /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:07.636742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:07.637760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:07.642886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:07.645202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:07.657384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.658630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.660160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.661140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.693941 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e HTTP/1.1 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c0d2a32b-30d0-49bc-82bb-36e73e00808e'} Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:07.697799 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:07.703177 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b999f3a-e032-40c4-a3fd-285cf23309b9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 404 len: 111 microversion: 2.1 time: 0.071573 Jul 19 20:29:07.706964 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2955/5805] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:29:07 2022] DELETE /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:29:07.710166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:07.717316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:07.718252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: c0d2a32b-30d0-49bc-82bb-36e73e00808e] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:07.728193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.728834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.729911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:07.730503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:07.747819 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e HTTP/1.1 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c0d2a32b-30d0-49bc-82bb-36e73e00808e'} Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:07.749824 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance c0d2a32b-30d0-49bc-82bb-36e73e00808e could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-282143fc-fb7d-4250-8358-5cb6a640c7d8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e" status: 404 len: 111 microversion: 2.1 time: 0.043120 Jul 19 20:29:07.769225 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2851/5806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:07 2022] GET /compute/v2.1/servers/c0d2a32b-30d0-49bc-82bb-36e73e00808e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:29:08.491869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:08.492386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:08.499826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.500829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.501971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.502677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.521544 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef HTTP/1.1 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ac0b90ee-a463-4693-ae0c-6468b6d7f5ef'} Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:08.523808 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e1618a3-fb82-4902-beb8-b7757bbdfb24 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 404 len: 111 microversion: 2.1 time: 0.038756 Jul 19 20:29:08.537387 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2956/5807] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:29:08 2022] DELETE /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:29:08.542865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:08.543268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: ac0b90ee-a463-4693-ae0c-6468b6d7f5ef] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:08.552110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.552775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.553780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:08.554423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:08.575499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef HTTP/1.1 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'ac0b90ee-a463-4693-ae0c-6468b6d7f5ef'} Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:08.577573 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance ac0b90ee-a463-4693-ae0c-6468b6d7f5ef could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:08.590078 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-29a22fa5-1d00-4360-890a-43bdcdf6a3e5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef" status: 404 len: 111 microversion: 2.1 time: 0.046096 Jul 19 20:29:08.594148 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2852/5808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:08 2022] GET /compute/v2.1/servers/ac0b90ee-a463-4693-ae0c-6468b6d7f5ef => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:29:08.710886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57549c90-814a-4330-b0a1-75179208fac6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: .version_select at 0x7f23ef6c2820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-633272481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDerYNsF0NQl95OQKQALTQroZC4MPcsxk2DTTtCQJMnCPcM3B6zTrYAMGaszjvJRC3dCemOKsDpPAFXvILhJBcRDdSC++30o1C/gk6pGpS+X5CLT2K1r9vE0h7nx189Y+g=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:08.733729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-57549c90-814a-4330-b0a1-75179208fac6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:29:08.743350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-57549c90-814a-4330-b0a1-75179208fac6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:29:08.795055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57549c90-814a-4330-b0a1-75179208fac6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.090468 Jul 19 20:29:08.796114 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2957/5809] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:29:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:31.543792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:31.544682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:31.549349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=21 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:31.550495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:31.560982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:31.561801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:31.562660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:31.563166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:31.629166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1591869597", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-633272481", "security_groups": [{"name": "tempest-secgroup-smoke-956173158"}], "block_device_mapping_v2": [{"uuid": "cc1069da-d3ad-42fb-96d4-65979930195d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:31.639060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=51 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:31.639867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:31.640712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:31.675981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lazy-loading 'services' on Instance uuid a17c69a7-f5e2-46f9-a047-90e367c6e4a5 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:29:31.765137 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a91b6810-565d-461c-9a4a-b4e0a6f8cfc2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5/os-volume_attachments/0c36b7a4-37ae-4e2b-8ec5-954f82313364" status: 202 len: 0 microversion: 2.1 time: 0.228492 Jul 19 20:29:31.766188 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2853/5810] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:29:31 2022] DELETE /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5/os-volume_attachments/0c36b7a4-37ae-4e2b-8ec5-954f82313364 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:29:31.799476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:29:32.272312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:29:32.273083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:29:32.273600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:29:32.274022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:29:32.274446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:29:32.286213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:32.286537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:32.287425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:32.287881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:32.313751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:29:32.324309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:29:32.389628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:29:32.391895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc1069da-d3ad-42fb-96d4-65979930195d',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:29:32.539411 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa272c20-d881-46f7-a0b9-529362987551 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.913682 Jul 19 20:29:32.540207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2958/5811] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:29:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:29:32.551473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17a1d0fe-47e1-4f15-a9f1-04d9e88f4463 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:32.553117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-17a1d0fe-47e1-4f15-a9f1-04d9e88f4463 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:32.622252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-17a1d0fe-47e1-4f15-a9f1-04d9e88f4463 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:32.636267 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17a1d0fe-47e1-4f15-a9f1-04d9e88f4463 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1094 microversion: 2.1 time: 0.088885 Jul 19 20:29:32.637349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2854/5812] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:32 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:33.662871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:33.663808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:33.674154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:33.675593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:33.677098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:33.677871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:33.851237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:33.864777 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fdeb96c8-add0-4938-9fc6-6a47d9b54462 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1192 microversion: 2.1 time: 0.205441 Jul 19 20:29:33.865732 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2959/5813] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:33 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1192 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:34.883831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:34.885687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:34.896468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:34.897388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:34.898766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:34.899623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:35.337987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:35.371774 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4386e274-92c3-41b3-a90a-1790b09a84b1 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.492193 Jul 19 20:29:35.373007 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2855/5814] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:34 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:36.392605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:36.393971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:36.403613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:36.404416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:36.405503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:36.406138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:36.455259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-25fd084e-7779-4957-883f-74f5a6e230b8 req-527b6ed3-a3e5-4cb4-8a41-cc860c9a7cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebee0d2-95b4-4bef-b673-41afae8a48b8", "tag": "06586477-053e-4059-93cf-07e179a481b8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:36.494139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-25fd084e-7779-4957-883f-74f5a6e230b8 req-527b6ed3-a3e5-4cb4-8a41-cc860c9a7cfe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:36.495395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-25fd084e-7779-4957-883f-74f5a6e230b8 req-527b6ed3-a3e5-4cb4-8a41-cc860c9a7cfe service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:36.520773 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-25fd084e-7779-4957-883f-74f5a6e230b8 req-527b6ed3-a3e5-4cb4-8a41-cc860c9a7cfe service nova] Creating event network-changed:06586477-053e-4059-93cf-07e179a481b8 for instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 on n-h1-843834-3 Jul 19 20:29:36.534676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-25fd084e-7779-4957-883f-74f5a6e230b8 req-527b6ed3-a3e5-4cb4-8a41-cc860c9a7cfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102057 Jul 19 20:29:36.541068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2856/5815] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:36.800979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:36.817219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1652bbc8-0dd8-4fe5-804f-97ff8217dce6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.428282 Jul 19 20:29:36.818546 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2960/5816] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:36 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:29:37.851357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:37.852578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:37.864893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:37.865692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:37.867294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:37.868177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:38.284947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:38.285883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:38.300282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:38.301159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:38.302594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:38.303420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:38.358231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:29:38.498487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0cbcd0b5-80c8-471c-a773-448175bb441e tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 204 len: 0 microversion: 2.1 time: 0.219894 Jul 19 20:29:38.499830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2961/5817] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:29:38 2022] DELETE /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:29:38.511934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:38.513582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:38.527626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:38.528508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:38.531400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:38.532216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:38.747891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:38.765966 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4103e948-9cf1-48ab-9173-bac04260931b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.925810 Jul 19 20:29:38.767520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2857/5818] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:37 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:38.816215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:38.832771 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4db592d8-5e48-450c-b2c8-53b446ad5986 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1513 microversion: 2.1 time: 0.327057 Jul 19 20:29:38.833869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2962/5819] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:38 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:39.793943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:39.795901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:39.804893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:39.805634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:39.806631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:39.807264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:39.866000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:39.867291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:39.878421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:39.879219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:39.881116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:39.881951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:40.098746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:40.114134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48f149ce-d4d5-4913-90a1-03e289c7522d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.324523 Jul 19 20:29:40.115998 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2858/5820] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:39 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:40.158118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:40.169103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-44be9ce8-d864-4576-9d31-4678cc1488a2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1513 microversion: 2.1 time: 0.320410 Jul 19 20:29:40.169904 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2963/5821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:39 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:29:41.035427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7faa1b22-7077-43e0-93f1-cc8ac3d2c461 req-76ba2b9a-6205-4764-b47d-65be16ab408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17c69a7-f5e2-46f9-a047-90e367c6e4a5", "name": "network-vif-deleted", "tag": "b0d5c5f7-006c-4a14-a69c-985d5266596c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:41.050360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7faa1b22-7077-43e0-93f1-cc8ac3d2c461 req-76ba2b9a-6205-4764-b47d-65be16ab408e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.051140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7faa1b22-7077-43e0-93f1-cc8ac3d2c461 req-76ba2b9a-6205-4764-b47d-65be16ab408e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.070848 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7faa1b22-7077-43e0-93f1-cc8ac3d2c461 req-76ba2b9a-6205-4764-b47d-65be16ab408e service nova] Creating event network-vif-deleted:b0d5c5f7-006c-4a14-a69c-985d5266596c for instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 on n-h2-843834-3 Jul 19 20:29:41.084165 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7faa1b22-7077-43e0-93f1-cc8ac3d2c461 req-76ba2b9a-6205-4764-b47d-65be16ab408e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057038 Jul 19 20:29:41.085723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2859/5822] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:41.147646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:41.149098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:41.164668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.166048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.167739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.168830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.212375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:41.220796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:41.234798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.236429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.239365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.240202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.311002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:41.312362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:41.313545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lazy-loading 'fault' on Instance uuid a17c69a7-f5e2-46f9-a047-90e367c6e4a5 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:29:41.393645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72cce68e2e042d2bf59f5e70d756af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fe1901156747cea6abc7fe2df88863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:41.406159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-72e1b3d8-bc32-4417-b905-820442377aa2 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 200 len: 1309 microversion: 2.1 time: 0.206520 Jul 19 20:29:41.407254 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2860/5823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:41 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:41.430016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:41.444045 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-23d7277c-1fab-4bd5-b8db-491d9068fbbd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.305267 Jul 19 20:29:41.445346 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2964/5824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:41 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:42.429239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:42.429959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] [instance: a17c69a7-f5e2-46f9-a047-90e367c6e4a5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:42.438500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:42.439158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:42.440033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:42.440483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:42.457201 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] HTTP exception thrown: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Request method failure captured: Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 HTTP/1.1 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xNcE70oLoDZ6XH5ckDGKUFpB2Eb33TAx8NSLzgLbHYrjQpY7zMYHFsPcPMvYPAOpOH23HNP4TMUHYBwjcm8M6w3U1CJ9lPvdK5nzjyHa7jxt--bxnuQuX2UYL-YruwKEk45ubDTH6eB4IwmZqvbQ7iTsp-TShziL41XhcpVW829AQ0 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: d9fe1901156747cea6abc7fe2df88863 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fe1901156747cea6abc7fe2df88863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: d9fe1901156747cea6abc7fe2df88863 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-374230135 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-VolumesSnapshotTestJSON-374230135-project Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: d72cce68e2e042d2bf59f5e70d756af6 Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-VolumesSnapshotTestJSON-374230135-project Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'a17c69a7-f5e2-46f9-a047-90e367c6e4a5'} Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:29:42.459054 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] Returning 404 to user: Instance a17c69a7-f5e2-46f9-a047-90e367c6e4a5 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec5f7128-242e-41b9-8317-cefb333148d5 tempest-VolumesSnapshotTestJSON-374230135 tempest-VolumesSnapshotTestJSON-374230135-project] 10.222.0.23 "GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5" status: 404 len: 111 microversion: 2.1 time: 0.036024 Jul 19 20:29:42.471187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2861/5825] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:42 2022] GET /compute/v2.1/servers/a17c69a7-f5e2-46f9-a047-90e367c6e4a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:29:42.484554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:42.486941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:42.496442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:42.497785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:42.500687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:42.501688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:42.502817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:42.503606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:42.713420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:42.727991 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-280437a5-92b1-477d-a067-19d89a0a2e9a tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1277 microversion: 2.1 time: 0.248881 Jul 19 20:29:42.729095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2965/5826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:42 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:43.754125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:43.755204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:43.759341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:29:43.771515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:43.772358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:43.773754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:43.774557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:43.995029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:44.005576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9474c0fb-2415-427b-aac5-d42a74bdda03 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.259600 Jul 19 20:29:44.006480 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2862/5827] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:43 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:45.030961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:45.032295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:45.045437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:45.046185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:45.047951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:45.047951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:45.254888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:45.269202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-954641d0-7043-498d-a092-d3067e55dc65 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.246058 Jul 19 20:29:45.270520 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2966/5828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:45 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:46.290644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:46.291457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:46.301674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:46.302158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:46.303099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:46.303651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:46.490150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:46.499565 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b23fe26f-756f-4824-b0c4-039a9ea42e67 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.213972 Jul 19 20:29:46.500400 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2863/5829] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:46 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:47.519255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:47.520314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:47.530260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:47.530938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:47.531928 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:47.532505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:47.734147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:47.747659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-373508e7-650d-47c0-9ea1-3bbf0e4bb27b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.232574 Jul 19 20:29:47.748709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2967/5830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:47 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:48.779843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:48.781274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:48.794517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:48.795519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:48.797068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:48.797924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:49.030039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:49.045636 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be18ee15-63ba-4c94-81bd-c22388cfb87f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.273144 Jul 19 20:29:49.046729 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2864/5831] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:48 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:50.080566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:50.081751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:50.094413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:50.095260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:50.096624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:50.097389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:50.384768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:50.401594 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95872bae-eb16-43ad-98f2-012b0087ae60 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.329192 Jul 19 20:29:50.402782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2968/5832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:50 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:51.435086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:51.436224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:51.448882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:51.449706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:51.451705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:51.452569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:51.712301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:51.725311 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e518e084-b906-4a0b-a9e7-498c4ad90651 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.297458 Jul 19 20:29:51.725923 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2865/5833] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:51 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:52.746610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:52.747567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:52.759173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:52.761003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:52.762786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:52.764435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:52.948804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-17550b62-3395-4b71-a61a-74dbbbeeb07d req-0aed6719-7f2e-428c-ab0c-345b988efb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebee0d2-95b4-4bef-b673-41afae8a48b8", "name": "network-vif-plugged", "status": "completed", "tag": "06586477-053e-4059-93cf-07e179a481b8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:52.967459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17550b62-3395-4b71-a61a-74dbbbeeb07d req-0aed6719-7f2e-428c-ab0c-345b988efb43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:52.968344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17550b62-3395-4b71-a61a-74dbbbeeb07d req-0aed6719-7f2e-428c-ab0c-345b988efb43 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:52.996759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-17550b62-3395-4b71-a61a-74dbbbeeb07d req-0aed6719-7f2e-428c-ab0c-345b988efb43 service nova] Creating event network-vif-plugged:06586477-053e-4059-93cf-07e179a481b8 for instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 on n-h1-843834-3 Jul 19 20:29:53.007404 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-17550b62-3395-4b71-a61a-74dbbbeeb07d req-0aed6719-7f2e-428c-ab0c-345b988efb43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069750 Jul 19 20:29:53.009276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2866/5834] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:29:53.108212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:53.145650 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a553588-5edb-4be4-a62f-3d3794effca9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.404851 Jul 19 20:29:53.156332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2969/5835] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:52 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:54.179022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:54.181647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:54.194264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:54.195375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:54.196485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:54.197728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:54.483421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:54.500935 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-04464a99-9808-4b3a-8c5e-5a7f84b8239f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1265 microversion: 2.1 time: 0.333181 Jul 19 20:29:54.502165 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2867/5836] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:54 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:55.526493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:55.528903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:55.543233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:55.544001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:55.545721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:55.546506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:55.796629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:55.805211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77f865a5-2e95-4436-81d3-1e63e104f66d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1453 microversion: 2.1 time: 0.288188 Jul 19 20:29:55.817164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2970/5837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:55 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1453 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:55.828063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:29:55.829233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:29:55.842351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:55.843213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:55.844733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:55.845580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:56.113750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:29:56.141037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e28f860-0951-4bcb-9913-06190c5e1ef2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1453 microversion: 2.1 time: 0.321287 Jul 19 20:29:56.143487 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2868/5838] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:29:55 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1453 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:29:58.683075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-878e29ee-4cbc-428a-ab18-357a98705afb req-7aa58d47-5018-4fdb-8c4b-db8e20f55bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebee0d2-95b4-4bef-b673-41afae8a48b8", "tag": "06586477-053e-4059-93cf-07e179a481b8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:29:58.702356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-878e29ee-4cbc-428a-ab18-357a98705afb req-7aa58d47-5018-4fdb-8c4b-db8e20f55bc5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:29:58.703278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-878e29ee-4cbc-428a-ab18-357a98705afb req-7aa58d47-5018-4fdb-8c4b-db8e20f55bc5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:29:58.721119 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-878e29ee-4cbc-428a-ab18-357a98705afb req-7aa58d47-5018-4fdb-8c4b-db8e20f55bc5 service nova] Creating event network-changed:06586477-053e-4059-93cf-07e179a481b8 for instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 on n-h1-843834-3 Jul 19 20:29:58.730541 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-878e29ee-4cbc-428a-ab18-357a98705afb req-7aa58d47-5018-4fdb-8c4b-db8e20f55bc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054943 Jul 19 20:29:58.731854 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2971/5839] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:30:46.106743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=36 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:46.107934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:46.348553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: .version_select at 0x7f23ee9ed280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-624904523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC8QOAdt0qJDLc8/eA7QTbRFi/nuEhhNjkbgU1vV3ySMEOpVDssWIwucMT9bqSry/VRnapR0qwUeFeC8LPWMUUcH49SSjUcXNuMOyFoViSKyEzx2Fp4OnZ8UqdfYOExmg=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:46.366086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:30:46.372492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:30:46.389737 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:30:47.400812 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 48570. Jul 19 20:30:47.426948 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2ca12bea-4b2e-4462-b961-b8d422239245 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.329460 Jul 19 20:30:47.427841 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2869/5840] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:30:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:30:56.417098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:56.418096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:56.423131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-913951831", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "6a2c4713-79f5-4885-bac7-ea6e9ed0ffa4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-624904523", "security_groups": [{"name": "tempest-secgroup-smoke-1128859296"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:30:56.991868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] validate_networks() for [('6a2c4713-79f5-4885-bac7-ea6e9ed0ffa4', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:30:57.604953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:30:57.606031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:30:57.606456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:30:57.607072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:30:57.607645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:30:57.622996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:57.623515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:57.624311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:57.624783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:57.656158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:30:57.667023 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:30:57.690386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:30:57.694746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:30:57.764361 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7059edf7-afd8-44b4-bc86-eb395bde7771 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.350284 Jul 19 20:30:57.765800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2972/5841] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:30:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:30:57.776608 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:57.779158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:30:57.788341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f76a283-a584-4f93-a507-fbb364c3d19b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:57.788795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9f76a283-a584-4f93-a507-fbb364c3d19b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:58.048808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9f76a283-a584-4f93-a507-fbb364c3d19b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:58.084200 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f76a283-a584-4f93-a507-fbb364c3d19b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1265 microversion: 2.1 time: 0.309736 Jul 19 20:30:58.095506 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2870/5842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:57 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:30:59.115124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:30:59.117237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:30:59.130271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:59.131401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:59.133776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:30:59.134993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:30:59.253411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:30:59.279689 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a70eaf7f-37d9-4a19-9f40-f676cc777e4b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1317 microversion: 2.1 time: 0.172641 Jul 19 20:30:59.280213 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2973/5843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:30:59 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:00.308093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:00.309586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:00.323352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:00.324654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:00.326201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:00.327037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:00.449387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:00.468073 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8dc76d5c-89b0-43f1-9db9-d120324fc786 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1323 microversion: 2.1 time: 0.171123 Jul 19 20:31:00.470315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2871/5844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:00 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:01.507553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:01.508684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:01.521577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:01.522377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:01.524306 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:01.525085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:01.752431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:01.762968 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a73ac3e4-9628-4ea3-a910-041b2029d312 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.263056 Jul 19 20:31:01.763927 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2974/5845] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:01 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:02.154427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-cafb24a1-6b49-4381-9efd-482530996a4c req-cf7c18a0-c8c3-41b7-aa0d-b1ff17733215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:02.171112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cafb24a1-6b49-4381-9efd-482530996a4c req-cf7c18a0-c8c3-41b7-aa0d-b1ff17733215 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:02.172266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cafb24a1-6b49-4381-9efd-482530996a4c req-cf7c18a0-c8c3-41b7-aa0d-b1ff17733215 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:02.190780 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-cafb24a1-6b49-4381-9efd-482530996a4c req-cf7c18a0-c8c3-41b7-aa0d-b1ff17733215 service nova] Creating event network-changed:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h2-843834-3 Jul 19 20:31:02.201262 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-cafb24a1-6b49-4381-9efd-482530996a4c req-cf7c18a0-c8c3-41b7-aa0d-b1ff17733215 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050875 Jul 19 20:31:02.203736 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2872/5846] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:02.784056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:02.784968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:02.793130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:02.793592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:02.794410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:02.794855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:03.003904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:03.018624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1e6edfbf-ca4b-4e16-a63b-e73565dabe21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.238388 Jul 19 20:31:03.021321 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2975/5847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:02 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:04.045488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:04.046393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:04.054477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:04.055198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:04.056375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:04.057078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:04.270228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:04.279231 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c4184d99-3ee1-4c58-b671-2d64a41f80ae tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.240765 Jul 19 20:31:04.280033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2873/5848] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:04 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:05.298763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:05.299898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:05.309016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:05.309503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:05.310462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:05.310944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:05.526066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:05.535920 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-caacbbb9-ae45-48d0-9f4e-c0bc82e49ba7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.241393 Jul 19 20:31:05.536630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2976/5849] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:05 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:06.558753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:06.559969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:06.573493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:06.574169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:06.575593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:06.576470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:06.847932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:06.858699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e516ad5c-e114-42e4-8a85-8a796ec5d651 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.307634 Jul 19 20:31:06.860308 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2874/5850] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:06 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:07.886897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:07.887605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:07.890566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:07.891616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:07.899113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:07.899924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:07.901366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:07.902016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:08.088387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:08.097469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-71116939-cde3-4745-8da1-950a753c69ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.214433 Jul 19 20:31:08.098089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2977/5851] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:07 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:08.920272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2e91c89d-9038-4f89-9023-243624969d7d req-434033ac-52d4-4c4f-b863-6f31e79e62f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "name": "network-vif-plugged", "status": "completed", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:08.929031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:08.937182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e91c89d-9038-4f89-9023-243624969d7d req-434033ac-52d4-4c4f-b863-6f31e79e62f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:08.937998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e91c89d-9038-4f89-9023-243624969d7d req-434033ac-52d4-4c4f-b863-6f31e79e62f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:08.954869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2e91c89d-9038-4f89-9023-243624969d7d req-434033ac-52d4-4c4f-b863-6f31e79e62f1 service nova] Creating event network-vif-plugged:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h2-843834-3 Jul 19 20:31:08.962452 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2e91c89d-9038-4f89-9023-243624969d7d req-434033ac-52d4-4c4f-b863-6f31e79e62f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046864 Jul 19 20:31:08.963628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2875/5852] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:31:09.127454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:09.129575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:09.142974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:09.143754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:09.145217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:09.146140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:09.360976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:09.375220 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf02dd7c-e756-4e12-8df8-502c350399bb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1391 microversion: 2.1 time: 0.262433 Jul 19 20:31:09.376328 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2978/5853] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:09 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:10.396870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:10.397664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:10.404636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.405096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.405897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.406345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.634750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:10.647792 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e018335-2974-4c7c-8c1a-678e57cf0443 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1560 microversion: 2.1 time: 0.256674 Jul 19 20:31:10.648411 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2876/5854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:10 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1560 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:10.670814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:10.672043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:10.685988 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.686761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.688232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:10.689025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:10.902280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:10.915505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ad62e493-c4e6-4194-b55a-edccd8db2ed7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1560 microversion: 2.1 time: 0.251529 Jul 19 20:31:10.916505 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2979/5855] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:10 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:13.658493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:13.659758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:13.667858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a5d9fb17-3f29-407b-a63d-3aa9e14e408d req-3933813b-f642-4947-9037-989fd9f6feca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:13.668784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:13.668784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:13.669518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:13.669994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:13.690031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a5d9fb17-3f29-407b-a63d-3aa9e14e408d req-3933813b-f642-4947-9037-989fd9f6feca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:13.690947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a5d9fb17-3f29-407b-a63d-3aa9e14e408d req-3933813b-f642-4947-9037-989fd9f6feca service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:13.714523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a5d9fb17-3f29-407b-a63d-3aa9e14e408d req-3933813b-f642-4947-9037-989fd9f6feca service nova] Creating event network-changed:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h2-843834-3 Jul 19 20:31:13.724358 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a5d9fb17-3f29-407b-a63d-3aa9e14e408d req-3933813b-f642-4947-9037-989fd9f6feca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066430 Jul 19 20:31:13.726439 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2980/5856] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:31:13.920702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:13.935953 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8eb31d7a-d285-41e0-8469-7664a1344ea7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1560 microversion: 2.1 time: 0.283358 Jul 19 20:31:13.938433 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2877/5857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:13 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1560 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:36.406754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:36.408195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=46 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:36.416311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:36.418217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:36.432723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:36.433525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:36.435049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:36.435827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:36.513265 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa123359-6357-437a-aa84-d5a531dc60fa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action" status: 200 len: 24528 microversion: 2.1 time: 0.110274 Jul 19 20:31:36.513994 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2981/5858] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:31:36 2022] POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action => generated 24528 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:31:42.935094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:42.936023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:42.939752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=18 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:42.940727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:31:42.949748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:42.950540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:42.951471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:42.952152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:43.518994 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6003d0bd-a3ad-4094-bf77-ac6376257575 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1830 microversion: 2.1 time: 0.587735 Jul 19 20:31:43.520522 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2878/5859] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:42 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1830 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:43.543054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:43.544446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:43.559556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:43.560353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:43.561809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:43.562617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:43.856417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:43.870034 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b000b67-f7c0-4c85-8c08-02ac6edc153f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1679 microversion: 2.1 time: 0.335283 Jul 19 20:31:43.870796 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2982/5860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:43 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:44.000968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:44.002070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:44.013603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.014323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.015680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.016436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.085523 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-285aad0c-7db9-4f94-8e0e-6daa51e2b815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action" status: 200 len: 32600 microversion: 2.1 time: 0.088326 Jul 19 20:31:44.086741 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2879/5861] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:31:43 2022] POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action => generated 32600 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:31:44.303191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:31:44.304019 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:44.314698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.315434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.316554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.317197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.439169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '906c9045d3904b33854b142356c97d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fe90b33a9e44fa93836b83d94beba8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:44.440246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] flavor_id is None. Assuming migration. {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 20:31:44.441081 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:31:44.844666 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-365cae72-8621-4c44-be52-f627d40f02d9 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action" status: 202 len: 0 microversion: 2.1 time: 0.547224 Jul 19 20:31:44.851571 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2983/5862] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:31:44 2022] POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:31:44.858440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:44.868600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:44.886441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.887207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:44.888123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:44.888600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:45.150829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:45.172869 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d7b996c7-b13d-4f11-8798-c5e227e777d1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.319291 Jul 19 20:31:45.174465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2880/5863] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:44 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:31:46.197777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:46.198884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:46.209296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:46.210070 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:46.211550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:46.212303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:46.425731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:46.438301 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-362f0fb0-f8b0-40b1-9a1e-8210423a9d33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.247761 Jul 19 20:31:46.438935 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2984/5864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:46 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:47.465147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:47.466023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:47.478306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:47.478839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:47.479789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:47.480364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:47.662181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:47.673269 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c7f76e2-0b36-4931-8b87-33ffb9793a7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.212213 Jul 19 20:31:47.674218 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2881/5865] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:47 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:48.697500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:48.698547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:48.707834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:48.708375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:48.709274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:48.709795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:48.935575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:48.950231 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-25f2a38b-e369-4eff-9d19-1cb513c24faf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.257160 Jul 19 20:31:48.951171 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2985/5866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:48 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:49.974587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:49.975819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:49.988281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:49.989117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:49.991570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:49.991570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:50.213008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:50.227806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65fc694b-c2a8-4259-ac39-9dddc39cc051 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.260761 Jul 19 20:31:50.228778 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2882/5867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:49 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:51.252239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:51.253213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:51.266366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:51.267385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:51.268827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:51.269742 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:51.477285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:51.486060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c797021b-1299-4d4b-8797-3bf2d454c69c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1688 microversion: 2.1 time: 0.241932 Jul 19 20:31:51.486859 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2986/5868] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:51 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:52.506325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:52.507238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:52.516224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:52.516830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:52.517847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:52.518298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:52.735972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:52.750528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-719ca25d-35a3-48c2-b6c9-d518b47c9243 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.248898 Jul 19 20:31:52.751637 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2883/5869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:52 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:53.779582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:53.780656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:53.788981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:53.789534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:53.790550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:53.791083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:53.995234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:54.007518 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3704d486-4db9-4b40-99d6-c2d7e2ea90c8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.233847 Jul 19 20:31:54.008359 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2987/5870] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:53 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:55.031348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:55.032137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:55.042439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:55.043133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:55.044067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:55.044561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:55.236822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:55.247293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8050ea27-9dcf-4984-baf6-9dd6d8aa526e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.221273 Jul 19 20:31:55.248221 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2884/5871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:55 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:56.268080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:56.268707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:56.277327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:56.278138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:56.279622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:56.280430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:56.495789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:56.505377 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f0ca3352-aa70-4930-8d08-346806866d9a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.241809 Jul 19 20:31:56.506364 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2988/5872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:56 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:57.457013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:57.458017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:57.468979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.469730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.471195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.471942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.509301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:31:57.535808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:57.536998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:57.550783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.551648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.553093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.553859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.629935 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24da8f6f-5f31-4c85-bb30-9fdc031cf43c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 204 len: 0 microversion: 2.1 time: 0.325273 Jul 19 20:31:57.631232 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2885/5873] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:31:57 2022] DELETE /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:31:57.646063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:57.647115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:57.662108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.662962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.664071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:57.664812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:57.826231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:57.841124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-59efc8f2-b389-42af-ae84-3c4f229c3c44 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.313673 Jul 19 20:31:57.841956 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2989/5874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:57 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:57.921533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:57.935105 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-76d8cb3f-5d0f-4448-8308-05135d4d83b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1578 microversion: 2.1 time: 0.297124 Jul 19 20:31:57.936117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2886/5875] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:57 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:31:58.861649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:58.862679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:58.873765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:58.874844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:58.876674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:58.877516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:58.959488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:31:58.960400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:31:58.969069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:58.969801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:58.970988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:31:58.971601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:31:59.196328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:59.209607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-28c678fa-12d4-4a16-a317-88df569794b1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.352733 Jul 19 20:31:59.210800 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2990/5876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:58 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:31:59.282235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:31:59.299013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b87c073-cfec-4152-bac2-27e8d035ba8f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1578 microversion: 2.1 time: 0.343273 Jul 19 20:31:59.300089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2887/5877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:31:58 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1578 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:00.237717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:00.238848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:00.252131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.252918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.254502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.255345 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.317758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:00.318620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:00.327507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.328278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.329459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.330248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.541209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:00.558403 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1038867f-5b58-4257-ba5e-ca7e98440c4d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1511 microversion: 2.1 time: 0.244400 Jul 19 20:32:00.560170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2888/5878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:00 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:00.663957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:00.685156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f902eef9-a5db-48cc-be9d-338524b750d0 req-c56e3d45-2045-4a4c-a663-5c529349ae26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebee0d2-95b4-4bef-b673-41afae8a48b8", "name": "network-vif-deleted", "tag": "06586477-053e-4059-93cf-07e179a481b8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:00.695724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f902eef9-a5db-48cc-be9d-338524b750d0 req-c56e3d45-2045-4a4c-a663-5c529349ae26 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:00.696104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-713bef08-48f1-408c-8c56-8d81c93a98ef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.463209 Jul 19 20:32:00.696237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f902eef9-a5db-48cc-be9d-338524b750d0 req-c56e3d45-2045-4a4c-a663-5c529349ae26 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:00.697565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2991/5879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:00 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:00.718337 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f902eef9-a5db-48cc-be9d-338524b750d0 req-c56e3d45-2045-4a4c-a663-5c529349ae26 service nova] Creating event network-vif-deleted:06586477-053e-4059-93cf-07e179a481b8 for instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 on n-h1-843834-3 Jul 19 20:32:00.726070 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f902eef9-a5db-48cc-be9d-338524b750d0 req-c56e3d45-2045-4a4c-a663-5c529349ae26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044443 Jul 19 20:32:00.727293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2889/5880] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:32:01.591799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:01.592815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:01.606476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.607423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.608823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.609654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.720818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:01.721943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:01.722852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:01.736495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.738228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0519ea1f-c9cc-43a2-b0e0-8ca11d5cf21d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1225 microversion: 2.1 time: 0.153378 Jul 19 20:32:01.738953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.742035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:01.743175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:01.757438 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2992/5881] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:01 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:02.016514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:02.038429 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-32845328-37d5-46e4-be20-37835307c2fc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.323762 Jul 19 20:32:02.039600 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2890/5882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:01 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:02.767937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:02.768868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:02.778747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:02.779481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:02.780570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:02.781462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:02.870002 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:02.884830 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61827c07-e7dd-4042-b87c-056822367918 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1225 microversion: 2.1 time: 0.122903 Jul 19 20:32:02.885869 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2993/5883] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:02 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:03.065415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:03.066552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:03.075253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.075789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:03.076599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.077139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:03.292969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:03.301414 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f21e5c7c-28e7-4332-b0b6-ef3e5e553564 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1693 microversion: 2.1 time: 0.240174 Jul 19 20:32:03.313508 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2891/5884] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:03 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:03.909329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:03.910835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:03.923031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.924153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:03.925739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:03.927923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.061904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:04.075670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-31cb7649-0104-4881-909e-0d4b16de979f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1225 microversion: 2.1 time: 0.175782 Jul 19 20:32:04.076924 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2994/5885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:03 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:04.324740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:04.325516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:04.334969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.335601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.336737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:04.338185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:04.783187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:04.795319 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7f7e0b8-4c92-41ac-9389-581884e264de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1692 microversion: 2.1 time: 0.477283 Jul 19 20:32:04.796134 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2892/5886] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:04 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1692 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:04.987842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "name": "network-vif-unplugged", "status": "completed", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:05.020454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.022159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.051669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] Creating event network-vif-unplugged:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h1-843834-3 Jul 19 20:32:05.068202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:32:05.112664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:05.113802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:05.117457 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ea3e71c1-9b19-4561-8d73-b22f1fc8f587 req-75d899d5-af45-49c4-9c14-f26cc19c390c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134691 Jul 19 20:32:05.119433 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2995/5887] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:05.151891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.152894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.154482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.156500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.341635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:05.352374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:05.356520 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3f0a6b17-f965-4c69-be47-36cd30552bda tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1225 microversion: 2.1 time: 0.255531 Jul 19 20:32:05.358181 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2893/5888] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:05 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1225 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:05.828134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:05.829564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:05.841803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.842662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.844359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:05.845098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:05.885636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:06.176192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:06.188473 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1611319b-fb16-4d4b-aead-8c7f6a97775e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1692 microversion: 2.1 time: 0.368826 Jul 19 20:32:06.189454 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2996/5889] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:05 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1692 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:06.379621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:06.381743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:06.394746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.399600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.401518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:06.404050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:06.545910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:06.566280 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a695d7da-7042-4f9a-aca8-d5ffa7125916 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 200 len: 1225 microversion: 2.1 time: 0.191108 Jul 19 20:32:06.567471 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2894/5890] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:06 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:07.151805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:07.160130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:07.171861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.172494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.187398 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] Creating event network-changed:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h1-843834-3 Jul 19 20:32:07.194243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:32:07.208247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-15881e6f-8897-4f25-b1d8-f154bcba66cb req-4462f8f6-fea1-49dd-b844-158058e459e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063525 Jul 19 20:32:07.209069 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2997/5891] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:07.215714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:07.216423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:07.224352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.224912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.226011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.226451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.587705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:07.595242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:07.600671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:07.606228 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6a12777-0126-4cce-a80c-11edcb46a4eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1692 microversion: 2.1 time: 0.394979 Jul 19 20:32:07.608409 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2895/5892] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:07 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1692 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:07.630691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.632067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.634119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:07.635441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:07.663268 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 HTTP/1.1 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '5ebee0d2-95b4-4bef-b673-41afae8a48b8'} Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:07.665568 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41f13a05-8751-4a3a-b216-3924b626ac94 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 404 len: 111 microversion: 2.1 time: 0.082669 Jul 19 20:32:07.684507 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2998/5893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:07 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:07.749029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1336040337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-633272481", "security_groups": [{"name": "tempest-secgroup-smoke-956173158"}], "block_device_mapping_v2": [{"uuid": "cc1069da-d3ad-42fb-96d4-65979930195d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:07.981058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:32:08.632111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:32:08.632768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:32:08.633256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:32:08.633754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:32:08.634259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:32:08.636493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:08.637914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:08.647976 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.648828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.650351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.650703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.650901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.651462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.652844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:08.653616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:08.676014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:32:08.683042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:32:08.763159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:32:08.765650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc1069da-d3ad-42fb-96d4-65979930195d',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:32:08.871503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:08.883967 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-827c3046-29c0-4680-8a3b-e9828c35e1e6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1690 microversion: 2.1 time: 0.254490 Jul 19 20:32:08.896785 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 2999/5894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:08 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:08.941794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ec5e966-e738-4b71-ac26-039deb08b2b4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.197979 Jul 19 20:32:08.943042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2896/5895] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:32:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:32:08.957912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90ec4727-88e8-4854-a9a4-adc3b2e366b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:08.958570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90ec4727-88e8-4854-a9a4-adc3b2e366b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:09.087120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90ec4727-88e8-4854-a9a4-adc3b2e366b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:09.098958 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90ec4727-88e8-4854-a9a4-adc3b2e366b5 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1094 microversion: 2.1 time: 0.145934 Jul 19 20:32:09.099638 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3000/5896] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:08 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1094 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:09.906360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:09.907793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:09.916128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:09.916594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:09.917694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:09.918157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.099270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:10.133308 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a737a7f-2dd9-4ad3-b8bf-a6af8ef4f815 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1687 microversion: 2.1 time: 0.214178 Jul 19 20:32:10.133660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:10.134735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:10.137912 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2897/5897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:09 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:10.150159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.151557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.153466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.154645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.158658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:10.159819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:10.168801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.169422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.170257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.170712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.283424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad4c980c-f899-411d-9c9b-533ffd08dd87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action" status: 204 len: 0 microversion: 2.1 time: 0.131300 Jul 19 20:32:10.284959 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2898/5898] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:32:10 2022] POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:32:10.292635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:10.317778 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f5ee079-5bf5-4a36-8449-ac1b0dd56ef6 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1192 microversion: 2.1 time: 0.193063 Jul 19 20:32:10.325488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:10.328466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3001/5899] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:10 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1192 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:10.334123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:10.343176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.344321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.346043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:10.346852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:10.797773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:10.825672 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6675f7ae-73d2-4a4a-8254-eb72a5359711 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1687 microversion: 2.1 time: 0.522851 Jul 19 20:32:10.826469 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2899/5900] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:10 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1687 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:11.360787 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.363115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.379767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.399006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.406623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.407570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.575789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:11.606395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6946c4e-3bab-4317-94f6-a9beb5522e55 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1210 microversion: 2.1 time: 0.251981 Jul 19 20:32:11.609163 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3002/5901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1210 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:32:11.850183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:11.851400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:11.879960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.881383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.886242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.887628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.923798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "name": "network-vif-plugged", "status": "completed", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:11.952626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:11.953466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:11.991264 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] Creating event network-vif-plugged:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h1-843834-3 Jul 19 20:32:12.005009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:32:12.034857 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7638d006-02ae-4395-8dcf-437d3a0f913e req-84bbea57-7341-405f-87ba-1aac01a121c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268250 Jul 19 20:32:12.036277 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2900/5902] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:12.299425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:12.310056 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98b83f3a-7e9c-47b0-9439-a28752db896c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1687 microversion: 2.1 time: 0.467785 Jul 19 20:32:12.310675 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3003/5903] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:11 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1687 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:12.639758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:12.641538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:12.655633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:12.656901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:12.658658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:12.659787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:12.965353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:12.980970 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e55bfe23-b2ef-400e-a182-ba2f1222253c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1277 microversion: 2.1 time: 0.349500 Jul 19 20:32:12.982437 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2901/5904] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:12 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:13.339955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:13.342226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:13.353299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.365011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.369238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.369565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.721079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-00a8ea81-3324-432e-b7a2-6d094b259d81 req-850f234d-c41d-438e-a1e7-551397268b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d9432d-05b8-4cfd-8e93-c9ff2316f820", "tag": "80394263-7c58-4086-b651-cb4f45cb39d5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:13.726797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:13.737275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-00a8ea81-3324-432e-b7a2-6d094b259d81 req-850f234d-c41d-438e-a1e7-551397268b1a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:13.739358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-00a8ea81-3324-432e-b7a2-6d094b259d81 req-850f234d-c41d-438e-a1e7-551397268b1a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:13.750273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:13.775094 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01b6eb26-0750-4006-a371-48f77a95e148 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1679 microversion: 2.1 time: 0.433278 Jul 19 20:32:13.775461 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-00a8ea81-3324-432e-b7a2-6d094b259d81 req-850f234d-c41d-438e-a1e7-551397268b1a service nova] Creating event network-changed:80394263-7c58-4086-b651-cb4f45cb39d5 for instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 on n-h1-843834-3 Jul 19 20:32:13.777330 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3004/5905] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:13 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1679 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:13.816422 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-00a8ea81-3324-432e-b7a2-6d094b259d81 req-850f234d-c41d-438e-a1e7-551397268b1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308851 Jul 19 20:32:13.820237 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2902/5906] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:32:14.011691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:14.013563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:14.025802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.027144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.028872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:14.029663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:14.337907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:14.356300 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-836e336e-24ec-4930-8397-b4b24bc3fe79 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1277 microversion: 2.1 time: 0.353045 Jul 19 20:32:14.357652 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3005/5907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:14 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1277 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:15.392424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:15.393708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:15.403177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.403919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.404997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:15.405683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:15.635948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:15.653522 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d5111c1c-2e1e-4b36-8d8e-d86496edb800 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1277 microversion: 2.1 time: 0.275191 Jul 19 20:32:15.654638 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2903/5908] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:15 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:16.679248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:16.679993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:16.689932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.690636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:16.691744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:16.692298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:16.894048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:16.902646 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c689ee75-0e42-456a-ac99-ae2e9153a855 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1277 microversion: 2.1 time: 0.227527 Jul 19 20:32:16.903285 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3006/5909] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:16 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:17.930516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:17.931414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:17.941570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:17.942482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:17.943575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:17.944884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:18.170102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:18.184893 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7f52021-cc31-40c8-8b1a-8d23e718835c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1277 microversion: 2.1 time: 0.265163 Jul 19 20:32:18.185958 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2904/5910] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:17 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:19.210775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:19.211744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:19.215241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:19.222777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.223342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.224203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:19.224705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:19.426457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:19.435495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd3b801f-29a5-4ee0-90e7-63bccf256260 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.228784 Jul 19 20:32:19.436127 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3007/5911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:19 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:20.463560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:20.464669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:20.467592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:20.468542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:20.477558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:20.478189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:20.479193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:20.479840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:20.649237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:20.658328 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc59adac-9b57-4825-8aaf-228ebb945c2b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.199323 Jul 19 20:32:20.658991 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2905/5912] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:20 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:21.677762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:21.678781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:21.688136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:21.688773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:21.689731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:21.690403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:21.870108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:21.880022 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e41a03a4-f8cc-41f4-bd53-8823e45a6d40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.206699 Jul 19 20:32:21.880761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3008/5913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:21 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:22.906153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:22.907125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:22.916119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.916753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:22.917743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:22.918562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:23.142154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:23.152105 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a84e8997-a8e6-481a-a214-96d6f2021149 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.250536 Jul 19 20:32:23.153187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2906/5914] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:22 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:24.175916 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:24.176909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:24.185886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:24.186513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.187609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:24.188157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:24.400854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:24.411033 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd696941-3a26-4f4c-af1f-0ab470d6af78 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.243044 Jul 19 20:32:24.411710 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3009/5915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:24 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:25.432467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:25.433507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:25.442698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.443193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.444009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:25.444465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:25.666403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:25.682715 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab3e568c-86eb-4556-b774-59f604bd8b99 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.256952 Jul 19 20:32:25.684061 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2907/5916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:25 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:26.709394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:26.710111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:26.718424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:26.718973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:26.720763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:26.721285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:26.905421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:26.920278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9ecf0324-1536-4dcb-a668-72e5d351f8fe tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.214877 Jul 19 20:32:26.921350 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3010/5917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:26 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:27.755790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-fe4bf714-3757-4702-a5ec-54480ee7022d req-a403aba1-0694-43f0-bf60-9917144adcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d9432d-05b8-4cfd-8e93-c9ff2316f820", "name": "network-vif-plugged", "status": "completed", "tag": "80394263-7c58-4086-b651-cb4f45cb39d5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:27.766634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fe4bf714-3757-4702-a5ec-54480ee7022d req-a403aba1-0694-43f0-bf60-9917144adcfd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.767691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-fe4bf714-3757-4702-a5ec-54480ee7022d req-a403aba1-0694-43f0-bf60-9917144adcfd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:27.791034 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-fe4bf714-3757-4702-a5ec-54480ee7022d req-a403aba1-0694-43f0-bf60-9917144adcfd service nova] Creating event network-vif-plugged:80394263-7c58-4086-b651-cb4f45cb39d5 for instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 on n-h1-843834-3 Jul 19 20:32:27.801660 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-fe4bf714-3757-4702-a5ec-54480ee7022d req-a403aba1-0694-43f0-bf60-9917144adcfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053945 Jul 19 20:32:27.802686 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2908/5918] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:27.952409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:27.954648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:27.968814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.969619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:27.971423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:27.972303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:28.685008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:28.700151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90d9b189-4dd3-40cd-9f54-ef8f0abf7afa tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.755958 Jul 19 20:32:28.702466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3011/5919] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:27 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:29.729169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:29.730243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:29.738473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:29.738979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:29.739801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:29.740261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:29.932500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:29.942000 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a205b055-8339-4662-8e7a-cef45dbb7692 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1265 microversion: 2.1 time: 0.219209 Jul 19 20:32:29.942856 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2909/5920] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:29 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:30.965914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:30.967128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:30.980494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:30.980965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:30.981781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:30.982244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.158570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:31.167328 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-38c1c452-0d22-4b83-974b-5fca9b471370 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1453 microversion: 2.1 time: 0.206579 Jul 19 20:32:31.168141 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3012/5921] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:30 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:31.187461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:31.188593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:31.197707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:31.198230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.199313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:31.199876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:31.431661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:31.442142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21c80352-a50b-4045-8e1c-820edec55332 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1453 microversion: 2.1 time: 0.261220 Jul 19 20:32:31.442798 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2910/5922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:31 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1453 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:34.072314 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-b5553c5a-f366-4a26-bc6c-00397b56767f req-9d98c8ec-6195-4f54-b9da-af4bd21bdbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d9432d-05b8-4cfd-8e93-c9ff2316f820", "tag": "80394263-7c58-4086-b651-cb4f45cb39d5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:34.097740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b5553c5a-f366-4a26-bc6c-00397b56767f req-9d98c8ec-6195-4f54-b9da-af4bd21bdbce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:34.098493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-b5553c5a-f366-4a26-bc6c-00397b56767f req-9d98c8ec-6195-4f54-b9da-af4bd21bdbce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:34.123195 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-b5553c5a-f366-4a26-bc6c-00397b56767f req-9d98c8ec-6195-4f54-b9da-af4bd21bdbce service nova] Creating event network-changed:80394263-7c58-4086-b651-cb4f45cb39d5 for instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 on n-h1-843834-3 Jul 19 20:32:34.138052 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-b5553c5a-f366-4a26-bc6c-00397b56767f req-9d98c8ec-6195-4f54-b9da-af4bd21bdbce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071875 Jul 19 20:32:34.139019 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3013/5923] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:36.054236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:36.055960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:36.068052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:36.068389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:36.069202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:36.069660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:36.139164 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ddefacdc-172a-4a75-ad96-134022bc9f9d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action" status: 200 len: 24573 microversion: 2.1 time: 0.090060 Jul 19 20:32:36.140222 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2911/5924] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:32:36 2022] POST /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:32:47.178167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:47.179098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=88 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:47.186634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:47.187885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:47.200628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:47.201280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:47.202315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:47.202873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:47.440695 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-833231a7-9b46-44b3-b91b-8bddfaefae2c tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1830 microversion: 2.1 time: 0.264227 Jul 19 20:32:47.441830 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3014/5925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:47 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1830 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:48.696435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:48.697611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:48.702062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=19 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:48.702512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c7bf1a85-f986-408f-8fac-e688f6bcf20a req-9ee85cac-bfc1-4825-892e-3fe228d527e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:48.703428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:32:48.708584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:48.709075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:48.709891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:48.710348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:48.720859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c7bf1a85-f986-408f-8fac-e688f6bcf20a req-9ee85cac-bfc1-4825-892e-3fe228d527e7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:48.721600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c7bf1a85-f986-408f-8fac-e688f6bcf20a req-9ee85cac-bfc1-4825-892e-3fe228d527e7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:48.742453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c7bf1a85-f986-408f-8fac-e688f6bcf20a req-9ee85cac-bfc1-4825-892e-3fe228d527e7 service nova] Creating event network-changed:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h1-843834-3 Jul 19 20:32:48.744945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:32:48.753254 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c7bf1a85-f986-408f-8fac-e688f6bcf20a req-9ee85cac-bfc1-4825-892e-3fe228d527e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058169 Jul 19 20:32:48.754768 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3015/5926] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:32:48.897317 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0026191c-ecbb-4846-8559-90a280e4ff18 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 204 len: 0 microversion: 2.1 time: 0.206754 Jul 19 20:32:48.898549 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2912/5927] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:32:48 2022] DELETE /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:32:48.915481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:48.916823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:48.929393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:48.930206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:48.932588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:48.933420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:49.166836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:49.182155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e38ab0b3-26b0-4c92-8e1b-262cdbe1f898 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1685 microversion: 2.1 time: 0.274771 Jul 19 20:32:49.183224 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3016/5928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:48 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1685 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:50.210789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:50.211840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:50.221951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:50.223125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:50.224044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:50.224789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:50.498541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:50.514514 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f11990f9-5d02-4453-979c-f01f4adc9c2b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1685 microversion: 2.1 time: 0.307497 Jul 19 20:32:50.515205 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2913/5929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:50 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1685 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:51.541896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:51.542841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:51.553071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:51.553549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:51.554665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:51.555435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:51.855798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:32:51.869961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-07728906-ba88-46f5-992b-b44b0b551c29 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 200 len: 1685 microversion: 2.1 time: 0.332559 Jul 19 20:32:51.871345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3017/5930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:51 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 1685 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:32:52.020873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-cf7dda1d-4f50-4d76-b1fc-c4dad82db80a req-8cabf351-6d9e-4bf5-85e8-03e43a2a0090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44", "name": "network-vif-deleted", "tag": "245c1c8f-f0b6-4588-8014-fa547442090d"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:52.035537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cf7dda1d-4f50-4d76-b1fc-c4dad82db80a req-8cabf351-6d9e-4bf5-85e8-03e43a2a0090 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:52.036323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-cf7dda1d-4f50-4d76-b1fc-c4dad82db80a req-8cabf351-6d9e-4bf5-85e8-03e43a2a0090 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:52.051907 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-cf7dda1d-4f50-4d76-b1fc-c4dad82db80a req-8cabf351-6d9e-4bf5-85e8-03e43a2a0090 service nova] Creating event network-vif-deleted:245c1c8f-f0b6-4588-8014-fa547442090d for instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 on n-h1-843834-3 Jul 19 20:32:52.058491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-cf7dda1d-4f50-4d76-b1fc-c4dad82db80a req-8cabf351-6d9e-4bf5-85e8-03e43a2a0090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044480 Jul 19 20:32:52.059179 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2914/5931] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:32:52.922949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:52.924125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:32:52.933308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:52.933760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:52.934567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:32:52.935047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:32:52.957467 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] HTTP exception thrown: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Request method failure captured: Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 HTTP/1.1 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xR1ilYflLlCzjvaEYMxud1Nz8RdrJ1aTK1NMCXklnLH9NYbEtwhr9vwhbTVHr7nndQIlM7Ztfhr0WO4O_46FOZjbP2KKrsM3pev14wM5rVAWg_GPLy993yZA5ymzV3yKB-YrVcqftpilLaZhuon1nn5D6k1hjIzflBx1oLk3_FV6lg Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/581db377dc15414fbb171828ade98746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_581db377dc15414fbb171828ade98746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7cb1482ceb334a05997d6b95a0499721 Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44'} Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:52.959244 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Returning 404 to user: Instance bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-36b9b215-0edb-46c7-8a70-24431067b74c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44" status: 404 len: 111 microversion: 2.1 time: 0.058180 Jul 19 20:32:52.968380 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3018/5932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:32:52 2022] GET /compute/v2.1/servers/bdc1d2e9-cdb8-4ae7-b4dd-3f861dfb8a44 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:32:57.869524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc4230e6-ab1e-4705-b57b-e738874a37f4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '.version_select at 0x7f23ef72da60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:32:57.902290 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc4230e6-ab1e-4705-b57b-e738874a37f4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-624904523" status: 202 len: 0 microversion: 2.1 time: 0.043426 Jul 19 20:32:57.903449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2915/5933] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 20:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-624904523 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:32:57.955527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-090e4f6d-6a95-4aac-a5ea-c54901776b2e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: .version_select at 0x7f23ef550d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-5783222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVUw3hghBjzihdbTI41Z+Z8paDKQNBjHv8mpWHSTG2A+w0pwtANzUVWAIr/QSCEoe+cK/Af4cPqZUN3FQjXTPAv5xERo+EOIRWb+lRCMzMYLbN4vjyHPNv7z2SEb2kYfg=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:32:57.982639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-090e4f6d-6a95-4aac-a5ea-c54901776b2e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:32:57.993638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-090e4f6d-6a95-4aac-a5ea-c54901776b2e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:32:58.029854 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-090e4f6d-6a95-4aac-a5ea-c54901776b2e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.083524 Jul 19 20:32:58.030759 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3019/5934] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:32:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:06.056701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:06.072476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-514699733", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "0046456e-b882-4cc3-a17b-078ac4dcbefe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-5783222", "security_groups": [{"name": "tempest-secgroup-smoke-1782034641"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:06.273652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] validate_networks() for [('0046456e-b882-4cc3-a17b-078ac4dcbefe', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:33:06.974875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:33:06.976526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:33:06.977738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:33:06.978881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:33:06.980450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:33:06.994741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:06.995347 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:06.996385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:06.996941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:07.019064 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:33:07.025933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:33:07.042253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:33:07.044869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:33:07.098900 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eaedad52-dd1f-408f-95c8-4e2cd4393421 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.045210 Jul 19 20:33:07.105619 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2916/5935] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:33:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:33:07.123004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=22 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:07.158880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc3b4529-a923-4d1e-8650-4e2ea0b06c06 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:07.160284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc3b4529-a923-4d1e-8650-4e2ea0b06c06 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:07.265696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc3b4529-a923-4d1e-8650-4e2ea0b06c06 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:07.280707 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc3b4529-a923-4d1e-8650-4e2ea0b06c06 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1263 microversion: 2.1 time: 0.172470 Jul 19 20:33:07.282595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3020/5936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:07 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:08.304762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:08.306412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:08.320358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:08.321260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:08.323037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:08.330440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:08.457598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:08.476627 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b19577a5-176f-40d0-a7e9-3afe3fbaeb81 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1315 microversion: 2.1 time: 0.178422 Jul 19 20:33:08.493342 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2917/5937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:08 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:09.504931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:09.506305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:09.514450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:09.514948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:09.515814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:09.516244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:09.626218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:09.640600 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b1f9237-a2dd-41e0-a823-ce60625294f3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1321 microversion: 2.1 time: 0.139864 Jul 19 20:33:09.641609 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3021/5938] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:09 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:10.666970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:10.667690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:10.683774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:10.684255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:10.685097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:10.685562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:10.977687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:11.005642 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-12e6aefa-5031-4cfa-9aff-fbfbe09c906e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.344774 Jul 19 20:33:11.009535 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2918/5939] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:10 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:11.215791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-73c217f7-25af-4029-9462-c24a93740ee7 req-6917c633-2e59-4e97-a5b7-ec93556cd4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:11.239067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-73c217f7-25af-4029-9462-c24a93740ee7 req-6917c633-2e59-4e97-a5b7-ec93556cd4cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:11.242542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-73c217f7-25af-4029-9462-c24a93740ee7 req-6917c633-2e59-4e97-a5b7-ec93556cd4cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:11.282745 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-73c217f7-25af-4029-9462-c24a93740ee7 req-6917c633-2e59-4e97-a5b7-ec93556cd4cb service nova] Creating event network-changed:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:33:11.293304 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-73c217f7-25af-4029-9462-c24a93740ee7 req-6917c633-2e59-4e97-a5b7-ec93556cd4cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294466 Jul 19 20:33:11.295137 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3022/5940] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:12.036702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:12.037784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:12.051084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:12.051939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:12.053371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:12.054184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:12.259467 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:12.273328 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20290941-f41f-4756-98ac-737d90668cb4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.244185 Jul 19 20:33:12.274388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2919/5941] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:12 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:13.302492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:13.303454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:13.311458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:13.312033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:13.312858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:13.313307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:13.534190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:13.549278 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d045a883-cc9f-490a-ad7b-e072003cb2a4 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.253000 Jul 19 20:33:13.550204 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3023/5942] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:13 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:14.569268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:14.591237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:14.592870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:14.593421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:14.594560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:14.595284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:14.788248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:14.798609 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d4254ac-944a-49ef-8cbd-aefed7d37e7a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.233576 Jul 19 20:33:14.799468 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2920/5943] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:14 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:15.823078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:15.824338 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:15.837678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:15.838482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:15.839984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:15.840803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:16.057393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:16.069168 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ec7da3f1-4596-44ed-b6f2-c78bc961fa11 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.255043 Jul 19 20:33:16.070184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3024/5944] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:15 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:17.098187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:17.099394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:17.104157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:17.105393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:17.120035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:17.120035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:17.120035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:17.120839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:17.312439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:17.327184 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb6e0c6c-acc9-4d59-88d2-7a7b1f1acd33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.236176 Jul 19 20:33:17.328260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2921/5945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:17 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:17.609483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-df773f38-9b69-4f3c-9b16-9ca9002f00f4 req-d1d77c5c-d360-4370-927f-ddaf2ee7df22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "name": "network-vif-plugged", "status": "completed", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:17.615188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:17.615883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:17.623101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-df773f38-9b69-4f3c-9b16-9ca9002f00f4 req-d1d77c5c-d360-4370-927f-ddaf2ee7df22 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:17.623472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-df773f38-9b69-4f3c-9b16-9ca9002f00f4 req-d1d77c5c-d360-4370-927f-ddaf2ee7df22 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:17.637151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-df773f38-9b69-4f3c-9b16-9ca9002f00f4 req-d1d77c5c-d360-4370-927f-ddaf2ee7df22 service nova] Creating event network-vif-plugged:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:33:17.642681 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-df773f38-9b69-4f3c-9b16-9ca9002f00f4 req-d1d77c5c-d360-4370-927f-ddaf2ee7df22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037323 Jul 19 20:33:17.643424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3025/5946] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:18.345240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:18.345905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:18.353496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:18.353975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:18.355157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:18.355622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:18.520050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:18.528964 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ffa2d75b-323d-4211-9f1c-98abfd54494e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1389 microversion: 2.1 time: 0.187684 Jul 19 20:33:18.529743 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2922/5947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:18 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1389 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:19.553605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:19.554943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:19.568699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:19.569697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:19.571353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:19.572434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:19.778340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:19.788882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1735bfa5-b95c-48f1-898e-805e3e2b5413 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1561 microversion: 2.1 time: 0.244838 Jul 19 20:33:19.789998 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3026/5948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:19 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:19.817773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:19.818628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:19.823472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:19.833602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:19.834413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:19.835787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:19.836438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:20.062540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:20.072087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-371c8919-f234-498b-b1ee-1198e21037a1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1561 microversion: 2.1 time: 0.261363 Jul 19 20:33:20.072776 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2923/5949] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:19 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1561 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:22.430585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f3747b46-5cdc-4bf5-8fb3-0fd05a68885a req-e04c70c6-94ed-4825-a0a0-64a69416bf93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:22.433962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:22.436547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:22.443466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f3747b46-5cdc-4bf5-8fb3-0fd05a68885a req-e04c70c6-94ed-4825-a0a0-64a69416bf93 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:22.444374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f3747b46-5cdc-4bf5-8fb3-0fd05a68885a req-e04c70c6-94ed-4825-a0a0-64a69416bf93 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:22.452425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:22.453930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:22.455587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:22.456408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:22.465672 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f3747b46-5cdc-4bf5-8fb3-0fd05a68885a req-e04c70c6-94ed-4825-a0a0-64a69416bf93 service nova] Creating event network-changed:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:33:22.474628 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f3747b46-5cdc-4bf5-8fb3-0fd05a68885a req-e04c70c6-94ed-4825-a0a0-64a69416bf93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048413 Jul 19 20:33:22.479076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2924/5950] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:33:22.728492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:22.739415 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-248a3aa6-0ec3-47e5-83a7-8e4b9a1e59a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1561 microversion: 2.1 time: 0.314321 Jul 19 20:33:22.740028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3027/5951] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:22 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1561 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:43.178411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.179757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=46 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.187729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:43.189783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:43.203284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:43.204087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:43.205426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:43.206124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:43.279252 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5129c169-b760-44c0-84c3-08f650dd1b1b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action" status: 200 len: 24566 microversion: 2.1 time: 0.104306 Jul 19 20:33:43.280030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2925/5952] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:33:43 2022] POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action => generated 24566 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:33:54.231307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:54.232170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:54.235369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=5 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.236670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.245699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.246474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.247997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.248877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.421131 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-450a14ea-cf20-41c0-b9fa-badcdf805a9f tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1831 microversion: 2.1 time: 0.193787 Jul 19 20:33:54.422117 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3028/5953] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:54 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1831 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:54.449459 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:54.450405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:54.453039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.453729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.461091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.461652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.462362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.462814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.654797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:54.666369 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f9cbebba-7287-4ad0-ab98-7dcd8cbcf1eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1680 microversion: 2.1 time: 0.221930 Jul 19 20:33:54.666977 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2926/5954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:54 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:54.781327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:54.782359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:54.789528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.789975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.790769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:54.791240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:54.859527 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97e85eff-415a-4005-8277-ce6f045add53 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action" status: 200 len: 32641 microversion: 2.1 time: 0.082989 Jul 19 20:33:54.860852 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3029/5955] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:33:54 2022] POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:33:55.033117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:33:55.033877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:55.042708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.043359 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.044483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.045011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.095853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '906c9045d3904b33854b142356c97d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fe90b33a9e44fa93836b83d94beba8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:55.096736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] flavor_id is None. Assuming migration. {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 20:33:55.097391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:33:55.373169 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7a1673c5-6f0a-463a-97e6-e952d5b85e35 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action" status: 202 len: 0 microversion: 2.1 time: 0.345470 Jul 19 20:33:55.374384 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2927/5956] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:33:55 2022] POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:33:55.393720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:55.397972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:55.412437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.413222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.414696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:55.416057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:55.662955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:55.676032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4d5f60f4-fb68-4ede-95c2-714cbb8fd3c7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1689 microversion: 2.1 time: 0.296454 Jul 19 20:33:55.677153 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3030/5957] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:55 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:56.700116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:56.701167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:56.709933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:56.710727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:56.711964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:56.712697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:56.949293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:56.964983 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bec95aef-8a9b-4227-8111-d47670cf5137 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1689 microversion: 2.1 time: 0.270849 Jul 19 20:33:56.965951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2928/5958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:56 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1689 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:57.998602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:58.000757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:58.013734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:58.014591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:58.016262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:58.017167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:58.236444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:58.252497 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7e90688-a4a0-4e1a-a01d-50049065300d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1689 microversion: 2.1 time: 0.261944 Jul 19 20:33:58.253748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3031/5959] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:57 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:59.274832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:33:59.275578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:33:59.284345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:59.284851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:59.285701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:33:59.286193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:33:59.500390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:33:59.515110 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce2f8273-37c6-4f1d-9a99-83a3b1336b39 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.244085 Jul 19 20:33:59.516192 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2929/5960] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:33:59 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:00.541627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:00.542644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:00.552210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:00.552755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:00.553700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:00.554288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:00.754612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:00.769144 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a89efbc1-5ccb-4f59-9dac-79961b8dcf85 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.231970 Jul 19 20:34:00.770240 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3032/5961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:00 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:01.793291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:01.794348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:01.807140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:01.807935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:01.809499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:01.810243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:01.976853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:01.986694 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7c39cbc-15d1-4143-85a2-a1c0b37ab326 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.200135 Jul 19 20:34:01.987477 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2930/5962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:01 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:03.005919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:03.006899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:03.015862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:03.016410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:03.017391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:03.017921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:03.212074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:03.223907 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f090d74c-26ff-4b49-8b33-67fc8773e3cc tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.219751 Jul 19 20:34:03.223907 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3033/5963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:03 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:04.240796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:04.241722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:04.250582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:04.251247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:04.252387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:04.252984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:04.434618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:04.449806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7cf1dbd4-37bf-419b-9bd1-2843952dcb21 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.212761 Jul 19 20:34:04.450973 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2931/5964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:04 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:05.480607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:05.481676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:05.495357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:05.495999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:05.497430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:05.498227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:05.708833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:05.717861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-748b8725-910a-4007-af5c-bfb11e830943 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.244532 Jul 19 20:34:05.718480 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3034/5965] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:05 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:06.739973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:06.741156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:06.752714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:06.753294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:06.754553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:06.755258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:06.942885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:06.957882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-85ff1ac1-3ec2-417d-98b5-15310f3b914d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.225070 Jul 19 20:34:06.958804 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2932/5966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:06 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:07.986229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:07.987092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:07.995086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:07.995526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:07.996372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:07.996820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:08.172769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:08.182393 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f6dbaee3-b8ea-488f-9f5e-3aaf77b653c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.201634 Jul 19 20:34:08.183043 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3035/5967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:07 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:09.201599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:09.202312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:09.211533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:09.212284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:09.213194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:09.214136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:09.393131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:09.402326 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fc94cda-8f9c-4195-a916-98e85c076266 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.205457 Jul 19 20:34:09.403076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2933/5968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:09 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:09.455823 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:34:09.456837 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:34:10.423118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:10.423700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:10.432303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:10.432768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:10.434013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:10.434480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:10.626707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:10.636345 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1adddcdc-9403-451f-b1d3-4dfdc0d8dd73 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.218111 Jul 19 20:34:10.637166 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3036/5969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:10 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:11.660722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:11.661716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:11.672211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:11.672726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:11.673640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:11.674155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:11.854171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:11.863051 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d7fb96b5-7329-4590-a633-f79c5875a775 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.208703 Jul 19 20:34:11.863681 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2934/5970] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:11 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:12.883166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:12.884168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:12.893244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:12.893699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:12.894505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:12.894974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:13.086090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:13.096013 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c37774a1-6663-41f6-bc1a-de4cee6ceddd tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.217941 Jul 19 20:34:13.096974 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3037/5971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:12 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:14.115102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:14.116147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:14.126500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:14.127128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:14.128327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:14.129293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:14.310316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:14.325597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd51f592-b2a7-4601-95be-f8aceffb1d59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1694 microversion: 2.1 time: 0.214704 Jul 19 20:34:14.326717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2935/5972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:14 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:15.349220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:15.350075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:15.357601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:15.358068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:15.358902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:15.359388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:15.630797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:15.643048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5857733a-9a2c-418e-a5f3-387f6f905b30 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1693 microversion: 2.1 time: 0.297774 Jul 19 20:34:15.643998 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3038/5973] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:15 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1693 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:15.930582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "name": "network-vif-unplugged", "status": "completed", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:15.947214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:15.947848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:15.970942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] Creating event network-vif-unplugged:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h1-843834-3 Jul 19 20:34:15.981026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:34:16.000528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-22140e18-7a04-47f0-8540-bab608121014 req-6060522c-e0a0-4faf-b47f-f614eeabd53e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074296 Jul 19 20:34:16.001226 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2936/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:34:16.689173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:16.690464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:16.703404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:16.705222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:16.707645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:16.708413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:17.086214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:17.096763 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46be6d8e-18c1-44ee-b233-8df74bee6393 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1693 microversion: 2.1 time: 0.429507 Jul 19 20:34:17.097435 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3039/5975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:16 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1693 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:18.022502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:18.040632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:18.041487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:18.064910 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] Creating event network-changed:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h1-843834-3 Jul 19 20:34:18.079618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:34:18.097727 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3ca81f7a-fe1f-4340-a31c-bb14e54a95d5 req-5e39e9ad-136c-4f5b-9d08-814fe19dbaf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082597 Jul 19 20:34:18.099030 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2937/5976] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:34:18.127253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:18.129228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:18.143536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:18.144284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:18.145947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:18.146655 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:18.907848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:18.921642 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aace2e7d-98d2-491f-93e9-6a13d8b486d9 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1691 microversion: 2.1 time: 0.802370 Jul 19 20:34:18.923013 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3040/5977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:18 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1691 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:19.947983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:19.949042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:19.959834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:19.960632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:19.975216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:19.975216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:20.166049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:20.178003 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3cd7850-bd8c-4272-aac0-e2822b08e240 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1688 microversion: 2.1 time: 0.239254 Jul 19 20:34:20.179011 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2938/5978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:19 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1688 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:20.201621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:20.202427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:20.210677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:20.211392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:20.212474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:20.212955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:20.380291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9c1ed3be-5053-4110-884e-180a46da3bc6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action" status: 202 len: 0 microversion: 2.1 time: 0.183480 Jul 19 20:34:20.381719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3041/5979] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:34:20 2022] POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:34:20.395623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:20.397578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:20.411057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:20.412150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:20.413553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:20.414483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:20.762971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:20.774204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d1a6245-ad69-4400-b01c-ed2975c03e35 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.384573 Jul 19 20:34:20.776823 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2939/5980] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:20 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:21.806441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:21.807558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:21.818513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:21.819292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:21.820218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:21.820669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:22.013618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:22.024607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2c70f97-dfde-424f-af2d-981c1309da05 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.226159 Jul 19 20:34:22.025661 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3042/5981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:21 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:23.051294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:23.052104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:23.060721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:23.061614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:23.062518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:23.063588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:23.326443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:23.343990 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba6ec42b-c22f-4f0e-ace7-ea238bca18f7 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.296395 Jul 19 20:34:23.345254 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2940/5982] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:23 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:24.373537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:24.375366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:24.382806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:24.391429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:24.392646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:24.394341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:24.395566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:24.454966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:24.706105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:24.732221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb53f842-593a-4356-b46d-2a333e6435b6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.365698 Jul 19 20:34:24.735096 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3043/5983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:24 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:25.706822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:25.755184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=33 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.760026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:25.760973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:25.782426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:25.792955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:25.810079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.826333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:25.831666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:25.839960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:25.841133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:25.861717 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] Creating event network-changed:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:34:25.891652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:34:25.945186 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0ad6ef38-5e58-4fa8-8421-516b571f4acb req-7d1a5576-d4bc-4f64-a865-eb1a8bef4d41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246011 Jul 19 20:34:25.947904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2941/5984] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:34:26.432093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:26.451633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c7ff33a-d8fc-47a3-9c32-baf2c26e6cca tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.678566 Jul 19 20:34:26.452575 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3044/5985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:25 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:27.491963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:27.494417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:27.507804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:27.508464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:27.510768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:27.511499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:27.815640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:27.828763 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d76b2041-7660-48ec-bef2-5305fa74b160 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1687 microversion: 2.1 time: 0.346771 Jul 19 20:34:27.840265 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2942/5986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:27 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1687 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:28.857930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:28.862718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:28.872801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:28.873677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:28.875235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:28.876333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:29.113867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:29.126627 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-32afd0e0-8dd2-4e31-ae21-580679fd5b3b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1680 microversion: 2.1 time: 0.277864 Jul 19 20:34:29.127518 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3045/5987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:28 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:32.003148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3ec124ee-f601-47a2-9b62-72dd97d87a13 req-32ba204d-eb90-439e-8373-52561342f3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "name": "network-vif-plugged", "status": "completed", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:32.032592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ec124ee-f601-47a2-9b62-72dd97d87a13 req-32ba204d-eb90-439e-8373-52561342f3f5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:32.036186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3ec124ee-f601-47a2-9b62-72dd97d87a13 req-32ba204d-eb90-439e-8373-52561342f3f5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:32.065418 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3ec124ee-f601-47a2-9b62-72dd97d87a13 req-32ba204d-eb90-439e-8373-52561342f3f5 service nova] Creating event network-vif-plugged:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:34:32.076302 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3ec124ee-f601-47a2-9b62-72dd97d87a13 req-32ba204d-eb90-439e-8373-52561342f3f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086657 Jul 19 20:34:32.077472 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2943/5988] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:34:32.687716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-873394441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-633272481", "security_groups": [{"name": "tempest-secgroup-smoke-956173158"}], "block_device_mapping_v2": [{"uuid": "d33c8139-dc64-4354-aee3-07ea45087d1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:32.844495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] validate_networks() for [('8164c7d1-b0f3-4b8c-bf40-c73ddf3c1339', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:34:33.384534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:34:33.385123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:34:33.385683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:34:33.386186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:34:33.386664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:34:33.403339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:33.403843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:33.404917 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:33.405467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:33.429786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:34:33.438563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Getting quotas for user a3b4901dfc1c481fad2193601e82551d and project a29be0f9ac3640bebc24d2508d31a5fc. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:34:33.523864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:34:33.527694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d33c8139-dc64-4354-aee3-07ea45087d1e',volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:34:33.741453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5bd5973b-1c17-4901-8287-fc7577373265 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.060807 Jul 19 20:34:33.742804 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3046/5989] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:34:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:34:33.758764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb4ab7b6-8736-4566-b2e0-df12b796312b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:33.759738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb4ab7b6-8736-4566-b2e0-df12b796312b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:33.846848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eb4ab7b6-8736-4566-b2e0-df12b796312b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:33.861772 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb4ab7b6-8736-4566-b2e0-df12b796312b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1093 microversion: 2.1 time: 0.109389 Jul 19 20:34:33.863303 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2944/5990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:33 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:34.888007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:34.888007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:34.898684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:34.899422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:34.900773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:34.901579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:35.000778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:35.011498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3c3554f1-5066-485e-82f4-21a4c6afc217 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1191 microversion: 2.1 time: 0.129959 Jul 19 20:34:35.012488 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3047/5991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:34 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1191 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:36.046981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:36.048786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:36.071681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:36.073448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:36.078194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:36.082769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:36.214671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:36.238561 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2dfe001b-0e7c-4170-9c8e-e37fa71648e8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1209 microversion: 2.1 time: 0.203035 Jul 19 20:34:36.240116 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2945/5992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:36 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:37.267069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:37.271576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:37.291175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:37.292667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:37.294858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:37.296843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:37.693644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:37.706171 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-658b0a96-d25f-482f-8da6-369673fd81f0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1276 microversion: 2.1 time: 0.447551 Jul 19 20:34:37.707707 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3048/5993] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:37 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1276 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:37.881524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0d796b8d-e902-4620-9c93-ad857cd36e1d req-3d898243-cc60-4b60-af72-1d1a9cbe0e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461eed2b-f520-4e07-9218-dcdc02c2ccc2", "tag": "64cc4d5e-b4f7-40f1-90b5-92eebd0433da"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:37.904029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d796b8d-e902-4620-9c93-ad857cd36e1d req-3d898243-cc60-4b60-af72-1d1a9cbe0e62 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:37.908273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d796b8d-e902-4620-9c93-ad857cd36e1d req-3d898243-cc60-4b60-af72-1d1a9cbe0e62 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:37.938082 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0d796b8d-e902-4620-9c93-ad857cd36e1d req-3d898243-cc60-4b60-af72-1d1a9cbe0e62 service nova] Creating event network-changed:64cc4d5e-b4f7-40f1-90b5-92eebd0433da for instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 on n-h1-843834-3 Jul 19 20:34:37.946222 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0d796b8d-e902-4620-9c93-ad857cd36e1d req-3d898243-cc60-4b60-af72-1d1a9cbe0e62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070201 Jul 19 20:34:37.947578 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2946/5994] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:34:38.745512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:38.746758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:38.759593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:38.760155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:38.761120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:38.761649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:39.177617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:39.194602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e840eb57-099a-44df-82ea-10f71884c304 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1276 microversion: 2.1 time: 0.456658 Jul 19 20:34:39.203342 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3049/5995] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:38 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1276 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:40.226209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:40.229048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:40.240890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:40.241600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:40.242896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:40.243675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:40.476899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:40.488437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66bcd1e5-996d-4254-b5f7-ca84920d3b81 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1276 microversion: 2.1 time: 0.271684 Jul 19 20:34:40.490059 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2947/5996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:40 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:41.512770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:41.513624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:41.522249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:41.522941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:41.524044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:41.524582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:41.764858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:41.779876 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d8f7f695-52ce-46e2-908e-9da958f54043 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1276 microversion: 2.1 time: 0.271744 Jul 19 20:34:41.780988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3050/5997] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:41 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:42.803449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:42.804413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:42.817720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:42.818422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:42.820179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:42.820931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:43.057331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:43.070088 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60a80773-26b2-417b-85e7-8b39c6647c4b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1276 microversion: 2.1 time: 0.273427 Jul 19 20:34:43.071198 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2948/5998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:42 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:44.098230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:44.099321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:44.104164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.105456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.117580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:44.118378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:44.119802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:44.120635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:44.341244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:44.350552 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9b1eb567-5758-4d76-af1e-fde0068d85e9 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.260719 Jul 19 20:34:44.351466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3051/5999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:44 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:45.369289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.377886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:45.379122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:45.391668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:45.393065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:45.394897 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:45.396290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:45.756751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:45.771918 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a7b5391b-c413-4d56-bc1a-6ebe127a71e4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.405526 Jul 19 20:34:45.773302 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2949/6000] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:45 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:46.797641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:46.798590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:46.807913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:46.808466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:46.809353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:46.809890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:47.010330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:47.024688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-763d8a50-8d4e-42fc-9b4f-6ca16f179d4e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.231234 Jul 19 20:34:47.025440 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3052/6001] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:46 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:48.051773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:48.052858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:48.061905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:48.062537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:48.063714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:48.064486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:48.310795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:48.321433 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d60c80b-bf3c-4143-94e0-924c9d99e977 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.273696 Jul 19 20:34:48.322824 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2950/6002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:48 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:49.343282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:49.344719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:49.357525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:49.358385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:49.360116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:49.360875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:49.609776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:49.622389 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-744c27a7-6da0-403d-91c6-0426533dc8a2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.285034 Jul 19 20:34:49.623118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3053/6003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:49 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:50.650793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:50.651601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:50.659278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:50.659756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:50.660650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:50.661190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:50.849541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:50.858069 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-46cec947-3a8c-4b18-b5fb-0ae6f1cfa811 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.212173 Jul 19 20:34:50.858686 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2951/6004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:50 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:51.880110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:51.880996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:51.891829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:51.892571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:51.893938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:51.894722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:52.097183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:52.106435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa43a688-34e2-4bde-aded-78a2144e1489 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.233517 Jul 19 20:34:52.107270 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3054/6005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:51 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:53.135136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:53.137458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:53.152686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:53.152686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:53.152686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:53.153248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:53.371066 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:53.381251 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a76507a5-cf1f-471f-91d4-834896c930c8 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.253834 Jul 19 20:34:53.381852 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2952/6006] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:53 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:53.457465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:53.459175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:53.467238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:53.467701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:53.468660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:53.469114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:53.529539 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-324c8485-12fd-4487-928a-9c39d7a08d37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action" status: 200 len: 63202 microversion: 2.1 time: 0.079262 Jul 19 20:34:53.530272 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3055/6007] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:34:53 2022] POST /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336/action => generated 63202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:34:54.404525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:54.406871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:54.419737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:54.420528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:54.421968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:54.422700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:54.479039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-091a7fdf-65f2-4f3a-9abb-d4ea19640dff req-7f9b2391-f867-4ff2-b8af-3497a48cd11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461eed2b-f520-4e07-9218-dcdc02c2ccc2", "name": "network-vif-plugged", "status": "completed", "tag": "64cc4d5e-b4f7-40f1-90b5-92eebd0433da"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:34:54.493902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.506606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-091a7fdf-65f2-4f3a-9abb-d4ea19640dff req-7f9b2391-f867-4ff2-b8af-3497a48cd11a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:54.507391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-091a7fdf-65f2-4f3a-9abb-d4ea19640dff req-7f9b2391-f867-4ff2-b8af-3497a48cd11a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:54.518179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=72 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.537827 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-091a7fdf-65f2-4f3a-9abb-d4ea19640dff req-7f9b2391-f867-4ff2-b8af-3497a48cd11a service nova] Creating event network-vif-plugged:64cc4d5e-b4f7-40f1-90b5-92eebd0433da for instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 on n-h1-843834-3 Jul 19 20:34:54.552258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-091a7fdf-65f2-4f3a-9abb-d4ea19640dff req-7f9b2391-f867-4ff2-b8af-3497a48cd11a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077923 Jul 19 20:34:54.553403 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3056/6008] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:34:54.764237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:54.775118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a11e684e-bcc5-4323-8219-474736c5ccd2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.378338 Jul 19 20:34:54.775803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2953/6009] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:54 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:55.804033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:55.804919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:55.813379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:55.814194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:55.815705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:55.816410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:56.027927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:56.039133 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a1f3d4ef-ec7f-4a9f-b007-95b6ae3931b0 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1264 microversion: 2.1 time: 0.240889 Jul 19 20:34:56.039907 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3057/6010] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:55 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:57.063309 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:57.064227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:57.068098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.075346 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.075816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.076641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.077089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.080726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=62 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.274747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:57.289535 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-99e9927a-ca47-423c-b9e0-836c7eb37780 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1451 microversion: 2.1 time: 0.230504 Jul 19 20:34:57.290558 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2954/6011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:57 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:57.316572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:57.317639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:57.331055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.331841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.333325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:57.334121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:57.517642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:34:57.529312 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f3f7210-4ef5-4c61-952f-7affc944c002 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1451 microversion: 2.1 time: 0.220142 Jul 19 20:34:57.530264 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3058/6012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:57 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:59.819610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:34:59.820751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:34:59.834319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:59.835282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:34:59.836268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:34:59.837071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:00.181301 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d1800c0d-db85-4291-ae61-fa59cd73cb7e tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1831 microversion: 2.1 time: 0.368460 Jul 19 20:35:00.182492 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2955/6013] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:34:59 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1831 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:00.261096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-16cbddce-186a-4d3e-89d1-897e610e8909 req-5910acd1-be91-493f-828e-67286c9714e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461eed2b-f520-4e07-9218-dcdc02c2ccc2", "tag": "64cc4d5e-b4f7-40f1-90b5-92eebd0433da"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:00.278951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-16cbddce-186a-4d3e-89d1-897e610e8909 req-5910acd1-be91-493f-828e-67286c9714e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:00.279853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-16cbddce-186a-4d3e-89d1-897e610e8909 req-5910acd1-be91-493f-828e-67286c9714e3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:00.307374 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-16cbddce-186a-4d3e-89d1-897e610e8909 req-5910acd1-be91-493f-828e-67286c9714e3 service nova] Creating event network-changed:64cc4d5e-b4f7-40f1-90b5-92eebd0433da for instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 on n-h1-843834-3 Jul 19 20:35:00.318317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-16cbddce-186a-4d3e-89d1-897e610e8909 req-5910acd1-be91-493f-828e-67286c9714e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064548 Jul 19 20:35:00.320311 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3059/6014] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:01.776635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-40f268d4-8c38-4282-a4ef-6cb4cec6a127 req-22b01684-3f32-4b34-8b69-202b3fe82f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:01.777414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:01.778197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:01.794205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:01.795197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:01.795943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-40f268d4-8c38-4282-a4ef-6cb4cec6a127 req-22b01684-3f32-4b34-8b69-202b3fe82f2b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:01.796759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-40f268d4-8c38-4282-a4ef-6cb4cec6a127 req-22b01684-3f32-4b34-8b69-202b3fe82f2b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:01.799586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:01.800947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:01.823402 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-40f268d4-8c38-4282-a4ef-6cb4cec6a127 req-22b01684-3f32-4b34-8b69-202b3fe82f2b service nova] Creating event network-changed:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:35:01.832968 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-40f268d4-8c38-4282-a4ef-6cb4cec6a127 req-22b01684-3f32-4b34-8b69-202b3fe82f2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064212 Jul 19 20:35:01.833534 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3060/6015] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:35:01.852814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:35:02.035039 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-226079f0-d504-4496-94b6-5c3e178d13e0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 204 len: 0 microversion: 2.1 time: 0.271662 Jul 19 20:35:02.037629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2956/6016] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:35:01 2022] DELETE /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:35:02.055347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:02.057103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:02.074724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:02.076761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:02.078365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:02.079366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:02.301215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:02.315172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5185825b-14e3-407f-83c9-053524f73e1f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1686 microversion: 2.1 time: 0.272253 Jul 19 20:35:02.316206 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3061/6017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:02 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1686 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:03.353599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:03.355681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:03.371352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:03.372649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:03.375701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:03.384057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:03.730160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:03.751266 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-426a8feb-8d70-4c21-9388-472e14eff4c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1686 microversion: 2.1 time: 0.410533 Jul 19 20:35:03.751996 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2957/6018] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:03 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1686 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:04.205387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d7b2b215-4fc0-4b24-804c-e741e130b106 req-99a852fc-6022-48a8-87df-f7551a0e0614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f016210a-a10a-47a7-afef-7cfeaa9ca336", "name": "network-vif-deleted", "tag": "013af1c7-1423-44a2-beb5-a03897c98b60"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:04.222281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d7b2b215-4fc0-4b24-804c-e741e130b106 req-99a852fc-6022-48a8-87df-f7551a0e0614 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.223037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d7b2b215-4fc0-4b24-804c-e741e130b106 req-99a852fc-6022-48a8-87df-f7551a0e0614 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.245664 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d7b2b215-4fc0-4b24-804c-e741e130b106 req-99a852fc-6022-48a8-87df-f7551a0e0614 service nova] Creating event network-vif-deleted:013af1c7-1423-44a2-beb5-a03897c98b60 for instance f016210a-a10a-47a7-afef-7cfeaa9ca336 on n-h2-843834-3 Jul 19 20:35:04.251301 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d7b2b215-4fc0-4b24-804c-e741e130b106 req-99a852fc-6022-48a8-87df-f7551a0e0614 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050437 Jul 19 20:35:04.252309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3062/6019] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:04.777887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:04.779127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:04.788868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.789344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.790173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.790631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.843289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:04.843772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:04.844262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lazy-loading 'fault' on Instance uuid f016210a-a10a-47a7-afef-7cfeaa9ca336 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:35:04.896817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:04.910842 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df22dd92-ba48-4c71-811e-ff28e215561d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 200 len: 1353 microversion: 2.1 time: 0.140035 Jul 19 20:35:04.918951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2958/6020] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:04 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:05.940155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:05.941311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f016210a-a10a-47a7-afef-7cfeaa9ca336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:05.956100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:05.956944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:05.958401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:05.959263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:05.979291 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] HTTP exception thrown: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Request method failure captured: Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 HTTP/1.1 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xR1ilYflLlCzjvaEYMxud1Nz8RdrJ1aTK1NMCXklnLH9NYbEtwhr9vwhbTVHr7nndQIlM7Ztfhr0WO4O_46FOZjbP2KKrsM3pev14wM5rVAWg_GPLy993yZA5ymzV3yKB-YrVcqftpilLaZhuon1nn5D6k1hjIzflBx1oLk3_FV6lg Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/581db377dc15414fbb171828ade98746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_581db377dc15414fbb171828ade98746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7cb1482ceb334a05997d6b95a0499721 Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f016210a-a10a-47a7-afef-7cfeaa9ca336'} Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:35:05.981728 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Returning 404 to user: Instance f016210a-a10a-47a7-afef-7cfeaa9ca336 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-179e1c6c-a4cb-4132-ac27-2769ca12e431 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336" status: 404 len: 111 microversion: 2.1 time: 0.054332 Jul 19 20:35:05.991538 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3063/6021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:05 2022] GET /compute/v2.1/servers/f016210a-a10a-47a7-afef-7cfeaa9ca336 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:35:11.885866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-135d091c-9455-47fd-ad10-74b63b575a2f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '.version_select at 0x7f23ef31a430>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:11.941817 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-135d091c-9455-47fd-ad10-74b63b575a2f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5783222" status: 202 len: 0 microversion: 2.1 time: 0.060976 Jul 19 20:35:11.943454 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2959/6022] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5783222 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:35:11.998331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-321a12ba-f558-4757-b29f-8643b294d2a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: .version_select at 0x7f23ee245550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-120797566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuylcOoSk+Sq6u10JCsnlINggs27/Adp28FweCiAlvRV/A0VTosguioxkz/jGYg9nbB70lkmwRG8PuAsEx42AENkTA7s99xmFkc8DzZfn54fOXIDS3BL+h5v7bEdxoMwQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:12.026250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-321a12ba-f558-4757-b29f-8643b294d2a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:35:12.035992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-321a12ba-f558-4757-b29f-8643b294d2a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:35:12.078671 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-321a12ba-f558-4757-b29f-8643b294d2a8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.086448 Jul 19 20:35:12.079751 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3064/6023] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:35:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:20.635110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-251290956", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "2a28c75b-7cb0-4958-bdcc-f84fccd45be9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-120797566", "security_groups": [{"name": "tempest-secgroup-smoke-1355441485"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:20.650026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.834753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] validate_networks() for [('2a28c75b-7cb0-4958-bdcc-f84fccd45be9', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:35:21.566056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:35:21.566510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:35:21.567134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:35:21.567838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:35:21.569144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:35:21.588931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:21.590954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:21.593090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:21.594111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:21.626988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:35:21.633967 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:35:21.656046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:35:21.659235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:35:21.763629 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6fac9ddf-d8d8-4fbd-a62e-f551f5393793 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134591 Jul 19 20:35:21.764790 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2960/6024] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:35:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:35:21.779268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=27 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.789058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77f5eefb-ae66-4431-a4be-260918b799eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:21.790593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77f5eefb-ae66-4431-a4be-260918b799eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:21.897677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77f5eefb-ae66-4431-a4be-260918b799eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:21.912134 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77f5eefb-ae66-4431-a4be-260918b799eb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1265 microversion: 2.1 time: 0.135368 Jul 19 20:35:21.930725 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3065/6025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:21 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:22.959906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:22.961059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:23.008578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:23.010266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:23.011918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:23.013764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:23.127657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:23.142751 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-acccd9d8-33b2-4558-91bf-ad776e576862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1317 microversion: 2.1 time: 0.207590 Jul 19 20:35:23.143720 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2961/6026] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:22 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:24.166763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:24.169381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:24.182342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:24.183251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:24.185433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:24.186550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:24.321418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:24.337733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e7353596-a559-49d8-9bd0-9e6933d2a1ab tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1323 microversion: 2.1 time: 0.179678 Jul 19 20:35:24.339005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3066/6027] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:24 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:25.365424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:25.366263 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:25.376624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:25.377261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:25.378760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:25.379566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:25.689214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:25.703291 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4b06c6df-2414-4064-973f-879e4f9cc89f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.342324 Jul 19 20:35:25.704913 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2962/6028] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:25 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:26.295462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-cb2c311f-f9f8-42a2-8ebb-ffaa8209f047 req-58f0e471-7783-409f-a8b7-29eff256765d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:26.305693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.316580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cb2c311f-f9f8-42a2-8ebb-ffaa8209f047 req-58f0e471-7783-409f-a8b7-29eff256765d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:26.317240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cb2c311f-f9f8-42a2-8ebb-ffaa8209f047 req-58f0e471-7783-409f-a8b7-29eff256765d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:26.343377 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-cb2c311f-f9f8-42a2-8ebb-ffaa8209f047 req-58f0e471-7783-409f-a8b7-29eff256765d service nova] Creating event network-changed:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:35:26.356853 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-cb2c311f-f9f8-42a2-8ebb-ffaa8209f047 req-58f0e471-7783-409f-a8b7-29eff256765d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072780 Jul 19 20:35:26.358478 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3067/6029] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:26.729931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:26.730545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:26.738661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:26.739162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:26.739980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:26.740438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:27.131580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:27.145932 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7354b7a2-8cad-4bf6-82d9-11236a885eeb tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.420426 Jul 19 20:35:27.147049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2963/6030] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:26 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:28.174143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:28.175215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:28.185124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:28.185940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:28.187553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:28.188418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:28.487066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:28.496877 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78f983bb-a911-458e-a17d-c723b7dc1b15 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.328128 Jul 19 20:35:28.497953 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3068/6031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:28 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:29.522723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:29.524148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:29.529596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.541952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:29.543055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:29.544671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:29.545575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:29.754826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:29.769782 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23af9139-a66f-49cb-b0d2-13c8ccb1fc58 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.255061 Jul 19 20:35:29.770446 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2964/6032] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:29 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:30.793060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:30.794172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:30.805805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:30.806435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:30.807530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:30.808294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:30.999638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:31.009217 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c45bf07b-fa47-46f1-8e98-0b9a51b803a2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.223878 Jul 19 20:35:31.009950 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3069/6033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:30 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:32.031100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:32.032150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:32.037380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:32.038697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:32.049806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:32.050615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:32.052059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:32.052781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:32.272711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:32.288707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b4197bd1-82f6-47e1-9357-6879a46f160a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.261814 Jul 19 20:35:32.290520 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2965/6034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:32 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:32.381053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-04f78c87-8e6a-4184-9038-62faaee3c3e3 req-b2590960-87b1-40e6-916a-5bf25d267895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "name": "network-vif-plugged", "status": "completed", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:32.390494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:32.405139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-04f78c87-8e6a-4184-9038-62faaee3c3e3 req-b2590960-87b1-40e6-916a-5bf25d267895 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:32.406119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-04f78c87-8e6a-4184-9038-62faaee3c3e3 req-b2590960-87b1-40e6-916a-5bf25d267895 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:32.429048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-04f78c87-8e6a-4184-9038-62faaee3c3e3 req-b2590960-87b1-40e6-916a-5bf25d267895 service nova] Creating event network-vif-plugged:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:35:32.439633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-04f78c87-8e6a-4184-9038-62faaee3c3e3 req-b2590960-87b1-40e6-916a-5bf25d267895 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065127 Jul 19 20:35:32.440826 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3070/6035] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:33.310340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:33.311290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:33.319840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:33.320318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:33.321108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:33.321580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:33.531714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:33.541101 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05d9fe59-aa18-4b00-9d5d-eeb3c37b400d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1391 microversion: 2.1 time: 0.235264 Jul 19 20:35:33.541922 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2966/6036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:33 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:34.562602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:34.563644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:34.575467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:34.575939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:34.576816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:34.577252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:34.775054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:34.783955 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9fc5c220-c178-4b25-90a6-0a309ddecded tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1562 microversion: 2.1 time: 0.227245 Jul 19 20:35:34.784684 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3071/6037] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:34 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:35:34.813185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:34.814267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:34.825177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:34.825968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:34.827628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:34.828457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:35.041709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:35.054974 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-90c29349-aab5-4962-a178-64c8cf0eaa00 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1562 microversion: 2.1 time: 0.248425 Jul 19 20:35:35.056339 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2967/6038] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:34 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:37.256832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b069c45a-9298-47e4-920c-419c7b889857 req-bf7c5f00-1c6f-4ea8-b0f8-6f9336b90cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:35:37.261959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:35:37.263056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:35:37.274706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:37.275603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:37.276930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:37.277620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:37.283647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b069c45a-9298-47e4-920c-419c7b889857 req-bf7c5f00-1c6f-4ea8-b0f8-6f9336b90cb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:35:37.284395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b069c45a-9298-47e4-920c-419c7b889857 req-bf7c5f00-1c6f-4ea8-b0f8-6f9336b90cb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:35:37.310609 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b069c45a-9298-47e4-920c-419c7b889857 req-bf7c5f00-1c6f-4ea8-b0f8-6f9336b90cb5 service nova] Creating event network-changed:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:35:37.319479 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b069c45a-9298-47e4-920c-419c7b889857 req-bf7c5f00-1c6f-4ea8-b0f8-6f9336b90cb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069157 Jul 19 20:35:37.320596 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2968/6039] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:35:37.539958 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:35:37.554625 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-adc87f1e-dfd3-4655-9da1-30a922d11978 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1562 microversion: 2.1 time: 0.309585 Jul 19 20:35:37.555872 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3072/6040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:35:37 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1562 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:00.008711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:00.010051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=46 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:00.099029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:00.100962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:00.113184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:00.114015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:00.115591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:00.116409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:00.199297 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a935feed-10cf-45b0-903e-f1418b448785 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action" status: 200 len: 24564 microversion: 2.1 time: 0.194525 Jul 19 20:36:00.200010 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2969/6041] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:00 2022] POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action => generated 24564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:06.594833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:06.595821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:06.598381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=11 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:06.599423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:06.607380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:06.607981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:06.608993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:06.609498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:06.910055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:06.923699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7160bf4-8524-4d43-a49f-4f0a9c452baa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1679 microversion: 2.1 time: 0.333106 Jul 19 20:36:06.924831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3073/6042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:06 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:07.056337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:07.057635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:07.067419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.067957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.068915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.069590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.128962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a1910331-2507-4ff2-bca2-c31af4441757 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action" status: 200 len: 32638 microversion: 2.1 time: 0.077218 Jul 19 20:36:07.129838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2970/6043] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:07 2022] POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action => generated 32638 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:07.427831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:07.428552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:07.436054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.436749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.437623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.438199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.635722 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2952f56f-c728-45b1-8117-b3b4100d413a tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1830 microversion: 2.1 time: 0.274412 Jul 19 20:36:07.637132 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3074/6044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:07 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1830 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:07.679947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:07.681385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:07.691060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.691735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.692719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:07.693219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:07.733157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lazy-loading 'flavor' on Instance uuid 3582644a-59a7-4e4d-8f6d-17d9a2635cda {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:36:07.757415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Going to try to live migrate instance to another host {{(pid=131230) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 20:36:09.526900 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb6916f3-4948-4b30-a3de-67a0ad67d653 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action" status: 202 len: 0 microversion: 2.1 time: 1.854143 Jul 19 20:36:09.528371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2971/6045] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:07 2022] POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action => generated 0 bytes in 1857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:36:09.543518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:09.544827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:09.558601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:09.559771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:09.570789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:09.572269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:09.960748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:09.973500 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1efc542-b51a-43b6-bfac-2512ce8e1d87 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.437394 Jul 19 20:36:09.974419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3075/6046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:09 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:11.002438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:11.003670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:11.019234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.020109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.021638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.022469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.383926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5807f13a-76fc-4233-99f7-abdcc4539797 req-9bc9e94f-84a6-4a5d-9aaf-220b7d460398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "name": "network-vif-unplugged", "status": "completed", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:11.401436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5807f13a-76fc-4233-99f7-abdcc4539797 req-9bc9e94f-84a6-4a5d-9aaf-220b7d460398 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:11.402213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5807f13a-76fc-4233-99f7-abdcc4539797 req-9bc9e94f-84a6-4a5d-9aaf-220b7d460398 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:11.425354 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5807f13a-76fc-4233-99f7-abdcc4539797 req-9bc9e94f-84a6-4a5d-9aaf-220b7d460398 service nova] Creating event network-vif-unplugged:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:36:11.435636 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5807f13a-76fc-4233-99f7-abdcc4539797 req-9bc9e94f-84a6-4a5d-9aaf-220b7d460398 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059096 Jul 19 20:36:11.437280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3076/6047] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:36:11.536272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:11.553500 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae9619b2-70b4-4786-a548-abefa92eefad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.558562 Jul 19 20:36:11.555377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2972/6048] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:10 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:12.590317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:12.592842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:12.605308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.606093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:12.607944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:12.608724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:12.865834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:12.876147 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-17d9d69d-5826-4c9a-adf4-424873808d1c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.296187 Jul 19 20:36:12.877060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3077/6049] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:12 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:13.470141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f0df22d6-d96e-46fc-b59c-7446db5f6e68 req-c5537283-6f6e-4115-b968-d687260ca37c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:13.481727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0df22d6-d96e-46fc-b59c-7446db5f6e68 req-c5537283-6f6e-4115-b968-d687260ca37c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:13.482194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f0df22d6-d96e-46fc-b59c-7446db5f6e68 req-c5537283-6f6e-4115-b968-d687260ca37c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:13.498214 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f0df22d6-d96e-46fc-b59c-7446db5f6e68 req-c5537283-6f6e-4115-b968-d687260ca37c service nova] Creating event network-changed:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:36:13.506047 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f0df22d6-d96e-46fc-b59c-7446db5f6e68 req-c5537283-6f6e-4115-b968-d687260ca37c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039394 Jul 19 20:36:13.507049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2973/6050] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:13.901095 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:13.902418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:13.916119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:13.916977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:13.918460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:13.919318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:14.320298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:14.330327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-86cf71c0-4d41-40a0-93a7-70d51e7674f6 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.436948 Jul 19 20:36:14.331221 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3078/6051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:13 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:15.351340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:15.352474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:15.360534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:15.361249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:15.362167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:15.362662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:15.557376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:15.572492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3508f02d-7f51-4c9a-a811-1c0e64b1e539 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.227067 Jul 19 20:36:15.573573 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2974/6052] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:15 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:16.607074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:16.608193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:16.621537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:16.622334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:16.623845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:16.624635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:16.872592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:16.881233 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8dfaa60c-cbca-4a90-8d70-a9738cbed8c5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.284221 Jul 19 20:36:16.881843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3079/6053] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:16 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:17.902197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:17.903238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:17.916185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:17.916888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:17.918234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:17.918950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:18.206045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:18.219886 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-62140d9d-f321-4dad-a4a8-69481ce0f61f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.324072 Jul 19 20:36:18.221088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2975/6054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:17 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:18.288138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f39983d2-16ff-48ac-8a9e-fe74864a35e8 req-59eebc48-91c8-4e8b-9740-c1bde3f1aa99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "name": "network-vif-unplugged", "status": "completed", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:18.301050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f39983d2-16ff-48ac-8a9e-fe74864a35e8 req-59eebc48-91c8-4e8b-9740-c1bde3f1aa99 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:18.301696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f39983d2-16ff-48ac-8a9e-fe74864a35e8 req-59eebc48-91c8-4e8b-9740-c1bde3f1aa99 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:18.323841 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f39983d2-16ff-48ac-8a9e-fe74864a35e8 req-59eebc48-91c8-4e8b-9740-c1bde3f1aa99 service nova] Creating event network-vif-unplugged:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h2-843834-3 Jul 19 20:36:18.332641 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f39983d2-16ff-48ac-8a9e-fe74864a35e8 req-59eebc48-91c8-4e8b-9740-c1bde3f1aa99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049481 Jul 19 20:36:18.333713 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3080/6055] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:36:19.249159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:19.250474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:19.263485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:19.264307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:19.265723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:19.266502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:19.578552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:19.593625 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7214b93e-88a7-41c9-a6b9-f6788b6b0b08 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1689 microversion: 2.1 time: 0.348799 Jul 19 20:36:19.594605 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2976/6056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:19 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1689 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:20.621799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:20.622737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:20.630275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:20.630746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:20.631681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:20.632154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:20.826068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:20.835882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f965633-45fb-4721-acd2-8306161dabf5 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1679 microversion: 2.1 time: 0.220440 Jul 19 20:36:20.836687 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3081/6057] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:20 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:20.862771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:20.864143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:20.872308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:20.872818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:20.873642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:20.874098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:21.088429 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a51993ae-b087-42ab-8e27-2abfc6814f84 tempest-TestNetworkAdvancedServerOps-617228810 tempest-TestNetworkAdvancedServerOps-617228810-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1830 microversion: 2.1 time: 0.229386 Jul 19 20:36:21.089356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2977/6058] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:20 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1830 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:21.112248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:21.112873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:21.120353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:21.120816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:21.121833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:21.122280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:21.314786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:21.325379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0496594-1e07-46ab-bb77-67bea3191427 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1679 microversion: 2.1 time: 0.219471 Jul 19 20:36:21.326345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3082/6059] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:21 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:21.436516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:21.437531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:21.445970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:21.446895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:21.447939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:21.448438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:21.531426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9727457c-8ec6-4322-b8e7-21ebd612c3c0 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action" status: 200 len: 38624 microversion: 2.1 time: 0.098581 Jul 19 20:36:21.533263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2978/6060] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:36:21 2022] POST /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda/action => generated 38624 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:36:26.828563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:26.834172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:26.837785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0c4248a3-a76b-441f-8c41-66417b2ce580 req-36cb2242-2d52-424c-8039-b7b1d9c9ee01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:26.846108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:26.846852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:26.848251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:26.849005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:26.856795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0c4248a3-a76b-441f-8c41-66417b2ce580 req-36cb2242-2d52-424c-8039-b7b1d9c9ee01 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:26.858166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0c4248a3-a76b-441f-8c41-66417b2ce580 req-36cb2242-2d52-424c-8039-b7b1d9c9ee01 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:26.888926 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0c4248a3-a76b-441f-8c41-66417b2ce580 req-36cb2242-2d52-424c-8039-b7b1d9c9ee01 service nova] Creating event network-changed:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h1-843834-3 Jul 19 20:36:26.898112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0c4248a3-a76b-441f-8c41-66417b2ce580 req-36cb2242-2d52-424c-8039-b7b1d9c9ee01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068375 Jul 19 20:36:26.899803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2979/6061] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:26.900366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:36:27.041025 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-298bc3f7-6f68-47b8-8a87-feaaefd1bffa tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 204 len: 0 microversion: 2.1 time: 0.217880 Jul 19 20:36:27.041930 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3083/6062] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:36:26 2022] DELETE /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:36:27.057274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:27.064185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:27.076549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:27.077941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:27.079788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:27.081087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:27.441737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:27.456409 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e28f9a57-85f4-4103-bc21-d97388079352 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1685 microversion: 2.1 time: 0.408876 Jul 19 20:36:27.457300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2980/6063] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:27 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1685 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:28.487445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:28.488679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:28.498124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:28.498768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:28.499761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:28.500396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:28.889707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-677a43c6-bc32-4cfa-80fa-1965cddbd7df req-7f8f1a6e-e47c-4f87-bfb9-63a5574ffd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582644a-59a7-4e4d-8f6d-17d9a2635cda", "name": "network-vif-deleted", "tag": "bff12765-b534-4148-97ba-ea8106c89409"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:28.912968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-677a43c6-bc32-4cfa-80fa-1965cddbd7df req-7f8f1a6e-e47c-4f87-bfb9-63a5574ffd3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:28.914832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-677a43c6-bc32-4cfa-80fa-1965cddbd7df req-7f8f1a6e-e47c-4f87-bfb9-63a5574ffd3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:28.922419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:28.930768 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-677a43c6-bc32-4cfa-80fa-1965cddbd7df req-7f8f1a6e-e47c-4f87-bfb9-63a5574ffd3f service nova] Creating event network-vif-deleted:bff12765-b534-4148-97ba-ea8106c89409 for instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda on n-h1-843834-3 Jul 19 20:36:28.936789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4f9b7eba-b5bc-4584-992a-a543a320f44b tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 200 len: 1568 microversion: 2.1 time: 0.455090 Jul 19 20:36:28.937814 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3084/6064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:28 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:28.941142 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-677a43c6-bc32-4cfa-80fa-1965cddbd7df req-7f8f1a6e-e47c-4f87-bfb9-63a5574ffd3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057977 Jul 19 20:36:28.942665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2981/6065] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:36:29.963605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:29.964723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: 3582644a-59a7-4e4d-8f6d-17d9a2635cda] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:29.977474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:29.978231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:29.979578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:29.980340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:30.007252 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] HTTP exception thrown: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Request method failure captured: Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda HTTP/1.1 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xR1ilYflLlCzjvaEYMxud1Nz8RdrJ1aTK1NMCXklnLH9NYbEtwhr9vwhbTVHr7nndQIlM7Ztfhr0WO4O_46FOZjbP2KKrsM3pev14wM5rVAWg_GPLy993yZA5ymzV3yKB-YrVcqftpilLaZhuon1nn5D6k1hjIzflBx1oLk3_FV6lg Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/581db377dc15414fbb171828ade98746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_581db377dc15414fbb171828ade98746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7cb1482ceb334a05997d6b95a0499721 Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '3582644a-59a7-4e4d-8f6d-17d9a2635cda'} Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:36:30.010495 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Returning 404 to user: Instance 3582644a-59a7-4e4d-8f6d-17d9a2635cda could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a4b2a750-07d7-4ab0-b313-c22e27a58f82 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda" status: 404 len: 111 microversion: 2.1 time: 0.056715 Jul 19 20:36:30.020020 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3085/6066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:29 2022] GET /compute/v2.1/servers/3582644a-59a7-4e4d-8f6d-17d9a2635cda => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:36:34.761041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4dc9c05f-d099-45b6-b142-d8af2f1cf63a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '.version_select at 0x7f23efbaa1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:34.771222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=29 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:34.791710 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4dc9c05f-d099-45b6-b142-d8af2f1cf63a tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-120797566" status: 202 len: 0 microversion: 2.1 time: 0.040433 Jul 19 20:36:34.792430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2982/6067] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 20:36:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-120797566 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:36:34.826866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-809a8635-df66-451e-b2db-f543feaef7ff tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: .version_select at 0x7f23ee1dd3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-785818248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh8qf1UPiDzeYJVHwm4rBuj+LOAooeGLZ9fip5ovItJ6dU+/H60MvFm3WOJGE07hKTJW+9TA87Ifw2xBW12a4sbhKnhIRtHNtSrvEyMLvt0TAzUK7ejW9ovgTI0w28Xdw=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:34.844835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-809a8635-df66-451e-b2db-f543feaef7ff tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:36:34.852518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-809a8635-df66-451e-b2db-f543feaef7ff tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:36:34.884447 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-809a8635-df66-451e-b2db-f543feaef7ff tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.061565 Jul 19 20:36:34.885218 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3086/6068] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:36:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:36:43.415032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-381134418", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "ca933367-5e4a-47ae-ad27-b604d45a5fd9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-785818248", "security_groups": [{"name": "tempest-secgroup-smoke-1639475169"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:43.430345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:43.584311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] validate_networks() for [('ca933367-5e4a-47ae-ad27-b604d45a5fd9', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:36:44.228228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:36:44.228884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:36:44.229614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:36:44.230269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:36:44.230899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:36:44.245960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:44.246644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:44.248059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:44.248710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:44.277000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:36:44.284771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Getting quotas for user 7cb1482ceb334a05997d6b95a0499721 and project 581db377dc15414fbb171828ade98746. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:36:44.303141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:36:44.306412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:36:44.367006 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d07dda7c-05a0-40c7-ac19-d2e7ff78ed32 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.957629 Jul 19 20:36:44.367710 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2983/6069] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:36:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:36:44.379595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:44.385429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-efdf1bc8-2cca-4d96-ab2e-3b4e63fe7924 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:44.386165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-efdf1bc8-2cca-4d96-ab2e-3b4e63fe7924 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:44.388573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:44.487383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-efdf1bc8-2cca-4d96-ab2e-3b4e63fe7924 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:44.507125 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-efdf1bc8-2cca-4d96-ab2e-3b4e63fe7924 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1265 microversion: 2.1 time: 0.128931 Jul 19 20:36:44.509502 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3087/6070] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:44 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:45.537215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:45.539859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:45.549699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:45.550267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:45.551364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:45.551888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:45.651213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:45.661180 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d79e394a-b911-4b2a-8999-0f7d532ebf99 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1317 microversion: 2.1 time: 0.129083 Jul 19 20:36:45.662484 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2984/6071] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:45 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1317 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:46.690493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:46.690493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:46.698695 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:46.699265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:46.700157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:46.700816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:46.836645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:46.852190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-997e459f-d6d8-4dad-bcd3-b30cd67b2a9c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1323 microversion: 2.1 time: 0.168504 Jul 19 20:36:46.855891 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3088/6072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:46 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:47.890009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:47.892284 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:47.909297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:47.910125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:47.911733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:47.912495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:48.222462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:48.243716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4948051e-8d70-4cfe-882b-775070bdd2de tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.361264 Jul 19 20:36:48.245788 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2985/6073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:47 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:49.153287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-55665319-5f09-4a98-963c-32475281459d req-3167f9c0-9cb7-4d64-b56a-ef428a1b2995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:49.177193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55665319-5f09-4a98-963c-32475281459d req-3167f9c0-9cb7-4d64-b56a-ef428a1b2995 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:49.178766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-55665319-5f09-4a98-963c-32475281459d req-3167f9c0-9cb7-4d64-b56a-ef428a1b2995 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:49.204847 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-55665319-5f09-4a98-963c-32475281459d req-3167f9c0-9cb7-4d64-b56a-ef428a1b2995 service nova] Creating event network-changed:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:36:49.216111 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-55665319-5f09-4a98-963c-32475281459d req-3167f9c0-9cb7-4d64-b56a-ef428a1b2995 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071721 Jul 19 20:36:49.217563 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3089/6074] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:49.278568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:49.280929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:49.297979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:49.298802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:49.300317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:49.301128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:49.738403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:49.752157 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7ffbf0ab-2487-466d-86f3-19578b88a11f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.485695 Jul 19 20:36:49.766949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2986/6075] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:49 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:50.761099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:50.762153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:50.773553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:50.774722 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:50.775440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:50.776048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:50.786154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:50.788530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:50.797986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:50.798769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:50.799992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:50.800453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:50.828320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:36:51.000092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4f422f2-caae-4090-84e1-2ad9b0cf34fb tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 204 len: 0 microversion: 2.1 time: 0.242178 Jul 19 20:36:51.007473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3090/6076] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:36:50 2022] DELETE /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:36:51.019165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:51.021113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:51.028578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.029042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.029866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.030541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.086116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:51.101492 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-20404733-78a4-4f44-856f-7bcbc290dcd8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.324252 Jul 19 20:36:51.103518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2987/6077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:50 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:51.314073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a8f13456-e9bf-45f7-9174-6ec84ac588c9 req-93241ab5-7795-4347-850b-2005da958b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461eed2b-f520-4e07-9218-dcdc02c2ccc2", "tag": "64cc4d5e-b4f7-40f1-90b5-92eebd0433da"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:51.330633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a8f13456-e9bf-45f7-9174-6ec84ac588c9 req-93241ab5-7795-4347-850b-2005da958b09 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:51.332383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a8f13456-e9bf-45f7-9174-6ec84ac588c9 req-93241ab5-7795-4347-850b-2005da958b09 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:51.354752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a8f13456-e9bf-45f7-9174-6ec84ac588c9 req-93241ab5-7795-4347-850b-2005da958b09 service nova] Creating event network-changed:64cc4d5e-b4f7-40f1-90b5-92eebd0433da for instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 on n-h1-843834-3 Jul 19 20:36:51.363347 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a8f13456-e9bf-45f7-9174-6ec84ac588c9 req-93241ab5-7795-4347-850b-2005da958b09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053499 Jul 19 20:36:51.364309 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2988/6078] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:51.433414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:51.460743 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d2154eba-b33e-480c-b10e-3e49bcf15f1f tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1575 microversion: 2.1 time: 0.450215 Jul 19 20:36:51.462366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3091/6079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:51 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1575 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:52.128111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:52.129397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:52.139291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.140003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.141067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.141699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.406680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:52.426348 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e4955f70-835e-4960-aea0-33131175fdda tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.305499 Jul 19 20:36:52.428584 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2989/6080] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:52 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:52.495123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:52.496226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:52.508400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.509076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.510385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:52.511132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:52.822315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:52.836342 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5fd8e033-ffd3-4af0-970c-ccaacdc4555e tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1575 microversion: 2.1 time: 0.348595 Jul 19 20:36:52.837382 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3092/6081] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:52 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1575 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:53.451667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:53.452599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:53.461418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.462642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:53.463641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.464252 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:53.838668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:53.847546 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-253ac197-9c73-4273-a7b4-ca8ddfab50ad tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.400566 Jul 19 20:36:53.848156 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2990/6082] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:53 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:53.855968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:53.857376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:53.865380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.865828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:53.866864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:53.867336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:54.433129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-01888b5e-5397-49f7-8973-1bacc1df7bd5 req-24dda352-4db3-4edb-b49f-0a6aa4354595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "name": "network-vif-plugged", "status": "completed", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:54.449635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:54.452452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:54.465572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-01888b5e-5397-49f7-8973-1bacc1df7bd5 req-24dda352-4db3-4edb-b49f-0a6aa4354595 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:54.466398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-01888b5e-5397-49f7-8973-1bacc1df7bd5 req-24dda352-4db3-4edb-b49f-0a6aa4354595 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:54.488595 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-01888b5e-5397-49f7-8973-1bacc1df7bd5 req-24dda352-4db3-4edb-b49f-0a6aa4354595 service nova] Creating event network-vif-plugged:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:36:54.501501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:54.502374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-01888b5e-5397-49f7-8973-1bacc1df7bd5 req-24dda352-4db3-4edb-b49f-0a6aa4354595 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085998 Jul 19 20:36:54.504274 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2991/6083] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:54.790568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e0b82edd-8956-4d81-b200-7a4d76aaefab req-9215369c-9c45-467a-8693-604399655bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461eed2b-f520-4e07-9218-dcdc02c2ccc2", "name": "network-vif-deleted", "tag": "64cc4d5e-b4f7-40f1-90b5-92eebd0433da"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:54.807447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e0b82edd-8956-4d81-b200-7a4d76aaefab req-9215369c-9c45-467a-8693-604399655bcd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:54.808279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e0b82edd-8956-4d81-b200-7a4d76aaefab req-9215369c-9c45-467a-8693-604399655bcd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:54.834583 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e0b82edd-8956-4d81-b200-7a4d76aaefab req-9215369c-9c45-467a-8693-604399655bcd service nova] Creating event network-vif-deleted:64cc4d5e-b4f7-40f1-90b5-92eebd0433da for instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 on n-h1-843834-3 Jul 19 20:36:54.844508 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e0b82edd-8956-4d81-b200-7a4d76aaefab req-9215369c-9c45-467a-8693-604399655bcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060121 Jul 19 20:36:54.845884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2992/6084] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:54.875850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:54.877777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:54.888685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:54.889794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:54.892157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:54.893518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:54.920027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:54.939807 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6e267aed-7a31-4d16-b321-df2ae0185143 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1457 microversion: 2.1 time: 1.087452 Jul 19 20:36:54.955034 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3093/6085] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:53 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1457 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:55.126833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:55.141447 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2946a480-2f96-4b6a-b9b5-a6ffdb44c830 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1391 microversion: 2.1 time: 0.272366 Jul 19 20:36:55.145402 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2993/6086] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:54 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:36:55.974385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:55.975712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:55.990563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:55.991421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:55.993103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:55.993801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.113335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:56.127775 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2f8eeeb-447b-4bc4-b139-0a9b4c6eac07 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1224 microversion: 2.1 time: 0.162263 Jul 19 20:36:56.128849 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3094/6087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:55 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:56.172218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:56.174531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:56.187671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.188917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.190493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.191387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.405119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:56.420016 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-47116091-d7a9-4800-903f-025677f0a862 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1563 microversion: 2.1 time: 0.255623 Jul 19 20:36:56.421462 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2994/6088] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:56 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:56.440547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:56.441352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:56.450380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.451042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.452049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:56.452607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:56.692485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:56.707556 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7f5634a3-b282-42c3-8cc9-bf7771b05c59 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1563 microversion: 2.1 time: 0.270978 Jul 19 20:36:56.708644 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3095/6089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:56 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:57.157738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:57.159403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:57.171408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:57.172657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:57.175197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:57.176338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:57.467981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:57.484381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-80a5d47a-55ab-4615-8325-dce7639e8311 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1224 microversion: 2.1 time: 0.334890 Jul 19 20:36:57.485796 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2995/6090] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:57 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1224 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:58.516871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:58.518597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:58.532807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:58.533831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:58.535548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:58.536515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:58.674568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:58.690530 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-268d242a-31af-47ae-89f4-fcdde59d4f66 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1224 microversion: 2.1 time: 0.180248 Jul 19 20:36:58.691988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3096/6091] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:58 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:59.378521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:59.379375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:59.386833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4c57ec54-dc97-44e4-b79e-0d583a8f7c51 req-1cb4c502-cca1-4cc8-84d2-728197f4f7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:36:59.408814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4c57ec54-dc97-44e4-b79e-0d583a8f7c51 req-1cb4c502-cca1-4cc8-84d2-728197f4f7f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.409977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4c57ec54-dc97-44e4-b79e-0d583a8f7c51 req-1cb4c502-cca1-4cc8-84d2-728197f4f7f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.411021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.411980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.413486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.414470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.428685 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4c57ec54-dc97-44e4-b79e-0d583a8f7c51 req-1cb4c502-cca1-4cc8-84d2-728197f4f7f2 service nova] Creating event network-changed:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:36:59.435029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4c57ec54-dc97-44e4-b79e-0d583a8f7c51 req-1cb4c502-cca1-4cc8-84d2-728197f4f7f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053184 Jul 19 20:36:59.436295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3097/6092] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:36:59.732388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:36:59.735201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:59.737813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:36:59.746333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd18be7c-b5bf-40ec-be90-332b3c95cbc8 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1563 microversion: 2.1 time: 0.374048 Jul 19 20:36:59.752755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2996/6093] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:59 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1563 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:36:59.762234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.763115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.764161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:36:59.764814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:36:59.909184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:36:59.921715 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e4ce1cf-8352-44ee-aeff-3ec3edcd9a40 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1224 microversion: 2.1 time: 0.208581 Jul 19 20:36:59.922897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3098/6094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:36:59 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:00.951587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:00.953824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:00.973218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:00.973994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:00.975177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:00.975775 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:01.046565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:01.047098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:01.047580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lazy-loading 'fault' on Instance uuid 461eed2b-f520-4e07-9218-dcdc02c2ccc2 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:37:01.105489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:01.139002 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-27917491-93ff-4d51-9d62-d37791ef5f88 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 200 len: 1229 microversion: 2.1 time: 0.193806 Jul 19 20:37:01.140579 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2997/6095] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:00 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 1229 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:02.170518 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:02.171647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 461eed2b-f520-4e07-9218-dcdc02c2ccc2] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:02.184213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:02.185012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:02.186394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:02.187149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:02.213505 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 HTTP/1.1 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '461eed2b-f520-4e07-9218-dcdc02c2ccc2'} Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:02.215914 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 461eed2b-f520-4e07-9218-dcdc02c2ccc2 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7224828a-5652-4c36-833d-c7777d67f32d tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2" status: 404 len: 111 microversion: 2.1 time: 0.054299 Jul 19 20:37:02.224382 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3099/6096] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:02 2022] GET /compute/v2.1/servers/461eed2b-f520-4e07-9218-dcdc02c2ccc2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:37:10.152940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1e25d17a-915d-4c47-9495-0b1d4b8116a2 req-bf4f6f11-1ea6-4c4a-aabe-aca14c17bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d9432d-05b8-4cfd-8e93-c9ff2316f820", "tag": "80394263-7c58-4086-b651-cb4f45cb39d5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:10.159343 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:10.160203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:10.166102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:10.172100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1e25d17a-915d-4c47-9495-0b1d4b8116a2 req-bf4f6f11-1ea6-4c4a-aabe-aca14c17bde2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.172857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1e25d17a-915d-4c47-9495-0b1d4b8116a2 req-bf4f6f11-1ea6-4c4a-aabe-aca14c17bde2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.181192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.181869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.183171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.183907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.193732 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1e25d17a-915d-4c47-9495-0b1d4b8116a2 req-bf4f6f11-1ea6-4c4a-aabe-aca14c17bde2 service nova] Creating event network-changed:80394263-7c58-4086-b651-cb4f45cb39d5 for instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 on n-h1-843834-3 Jul 19 20:37:10.203590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1e25d17a-915d-4c47-9495-0b1d4b8116a2 req-bf4f6f11-1ea6-4c4a-aabe-aca14c17bde2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056886 Jul 19 20:37:10.204951 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3100/6097] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:37:10.230094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:37:10.368754 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d0271ec9-1078-49aa-80a7-c319118a93ff tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 204 len: 0 microversion: 2.1 time: 0.231194 Jul 19 20:37:10.370838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2998/6098] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:37:10 2022] DELETE /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:37:10.389382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:10.390956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:10.403644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.404579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.406393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:10.407350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:10.722735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:10.736468 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6637852e-c920-4f45-b9e2-a53f6293c25c tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1578 microversion: 2.1 time: 0.357363 Jul 19 20:37:10.737576 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3101/6099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:10 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1578 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:11.767188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:11.768661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:11.779808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:11.780865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:11.782017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:11.782816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:12.128357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:12.144676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6bcabb10-eed1-47ce-b609-b2867620ebac tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1578 microversion: 2.1 time: 0.386696 Jul 19 20:37:12.145775 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 2999/6100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:11 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1578 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:13.083336 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f2aa52c7-ff58-4d0d-b371-e365f9ebc75d req-5fb3f928-85ee-450c-b80e-fa169938ed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d9432d-05b8-4cfd-8e93-c9ff2316f820", "name": "network-vif-deleted", "tag": "80394263-7c58-4086-b651-cb4f45cb39d5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:13.094448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f2aa52c7-ff58-4d0d-b371-e365f9ebc75d req-5fb3f928-85ee-450c-b80e-fa169938ed44 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:13.094955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f2aa52c7-ff58-4d0d-b371-e365f9ebc75d req-5fb3f928-85ee-450c-b80e-fa169938ed44 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:13.108234 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f2aa52c7-ff58-4d0d-b371-e365f9ebc75d req-5fb3f928-85ee-450c-b80e-fa169938ed44 service nova] Creating event network-vif-deleted:80394263-7c58-4086-b651-cb4f45cb39d5 for instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 on n-h1-843834-3 Jul 19 20:37:13.115017 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f2aa52c7-ff58-4d0d-b371-e365f9ebc75d req-5fb3f928-85ee-450c-b80e-fa169938ed44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Jul 19 20:37:13.116419 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3102/6101] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:37:13.174049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:13.175120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:13.184088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:13.184571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:13.185407 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:13.185867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:13.191172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:13.279316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:13.294191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef7fe315-4b1a-4e21-ac33-bb7133b687cd tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1225 microversion: 2.1 time: 0.125238 Jul 19 20:37:13.295530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3000/6102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:13 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:14.320959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:14.322089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:14.330564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:14.331120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:14.332009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:14.332501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:14.432425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:14.436687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:14.450961 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-486e9d77-5558-437c-ab85-43ccb520ba93 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1225 microversion: 2.1 time: 0.134637 Jul 19 20:37:14.451578 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3103/6103] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:14 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:15.472412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:15.473445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:15.485437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:15.486172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:15.487501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:15.488240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:15.750950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:15.766028 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d938c18-8d78-4239-ac57-df9aa6566ab4 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1225 microversion: 2.1 time: 0.300275 Jul 19 20:37:15.767154 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3001/6104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:15 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1225 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:16.794078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:16.795218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:16.800937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:16.810596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:16.811289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:16.812226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:16.812772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:16.894529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:16.905298 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48324d3c-3be6-4c6b-85ee-f244b66f0f36 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1225 microversion: 2.1 time: 0.116143 Jul 19 20:37:16.906309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3104/6105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:16 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:17.928422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:17.929565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:17.942130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:17.942957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:17.944443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:17.945227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:18.061622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:18.072381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-73f77289-91a0-4f89-85a7-fb1d7e0f4996 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1225 microversion: 2.1 time: 0.151000 Jul 19 20:37:18.073258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3002/6106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:17 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:19.098877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:19.100050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:19.108463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:19.108961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:19.109811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:19.110419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:19.157579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:19.158343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:19.159134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lazy-loading 'fault' on Instance uuid 50d9432d-05b8-4cfd-8e93-c9ff2316f820 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:37:19.395745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4901dfc1c481fad2193601e82551d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29be0f9ac3640bebc24d2508d31a5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:19.409421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bdd27fe0-f4ff-4148-af9e-76fbebb931cc tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 200 len: 1184 microversion: 2.1 time: 0.314780 Jul 19 20:37:19.410524 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3105/6107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:19 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 1184 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:20.433238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:20.434025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 50d9432d-05b8-4cfd-8e93-c9ff2316f820] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:20.442143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:20.442609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:20.443462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:20.444207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:20.463509 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 HTTP/1.1 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '50d9432d-05b8-4cfd-8e93-c9ff2316f820'} Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:20.465275 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 50d9432d-05b8-4cfd-8e93-c9ff2316f820 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f644ace1-1753-4377-9d3e-15a42f694a8b tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820" status: 404 len: 111 microversion: 2.1 time: 0.038036 Jul 19 20:37:20.474443 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3003/6108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:20 2022] GET /compute/v2.1/servers/50d9432d-05b8-4cfd-8e93-c9ff2316f820 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:37:21.065159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:21.066066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:21.077091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.077555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.078376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.083451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.100243 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 HTTP/1.1 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '5ebee0d2-95b4-4bef-b673-41afae8a48b8'} Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:37:21.102029 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b14fbc7c-2875-4650-9547-22309dbba719 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 404 len: 111 microversion: 2.1 time: 0.044101 Jul 19 20:37:21.110373 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3106/6109] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:37:21 2022] DELETE /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:37:21.116495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:21.117328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] [instance: 5ebee0d2-95b4-4bef-b673-41afae8a48b8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:21.127267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.127739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.128569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:21.129032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:21.146200 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] HTTP exception thrown: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Request method failure captured: Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 HTTP/1.1 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xMYS9XDlP0vCA_VFm1zfar698mnzxCJM7VUblcFTO3ocuXo1XaOCqC98VvsU3U29l3qrVwgC_4qzBA4Y-6DPcgt-YpVu5RlKFP5Mqbj7wpqP5OS4qOxGtbbdecPIs4i0ZW3oyEFd3d6c0sUsv7PUdgAEZ0zBc6Ho6GbNI88RJefB_4 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29be0f9ac3640bebc24d2508d31a5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: a29be0f9ac3640bebc24d2508d31a5fc Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestVolumeBootPattern-86789830 Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a3b4901dfc1c481fad2193601e82551d Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestVolumeBootPattern-86789830-project Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '5ebee0d2-95b4-4bef-b673-41afae8a48b8'} Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:37:21.148024 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Returning 404 to user: Instance 5ebee0d2-95b4-4bef-b673-41afae8a48b8 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-353a5ab0-3539-4d01-b2c4-f832047bc231 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8" status: 404 len: 111 microversion: 2.1 time: 0.038456 Jul 19 20:37:21.157317 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3004/6110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:21 2022] GET /compute/v2.1/servers/5ebee0d2-95b4-4bef-b673-41afae8a48b8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:37:22.211115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:22.212702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:22.220827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:22.221286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:22.222089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:22.222527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:22.276536 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-138ed8ee-8ea9-4ba1-9331-53ff0753aa45 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action" status: 200 len: 24568 microversion: 2.1 time: 0.069606 Jul 19 20:37:22.277288 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3107/6111] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:37:22 2022] POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:37:25.788803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7d61965-c7f4-4fd8-9f9f-7afc9ef75ed2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] Calling method '.version_select at 0x7f23efbaaf70>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:25.829766 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7d61965-c7f4-4fd8-9f9f-7afc9ef75ed2 tempest-TestVolumeBootPattern-86789830 tempest-TestVolumeBootPattern-86789830-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-633272481" status: 202 len: 0 microversion: 2.1 time: 0.052660 Jul 19 20:37:25.830705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3005/6112] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jul 19 20:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-633272481 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:37:28.592887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:28.595982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:28.611904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:28.613088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:28.614495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:28.615358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:28.734384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:37:28.735466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:37:28.736183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:37:28.736606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:37:28.737038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:37:28.811275 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [788f4915-6c3a-4488-a6b2-99d56976e390] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:37:29.824228 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [788f4915-6c3a-4488-a6b2-99d56976e390] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 49848. Jul 19 20:37:29.829412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:29.837348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:29.838211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:29.839316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:29.844610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:29.881781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-584e4833-493f-48e8-af74-7a9b4af6801e tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action" status: 202 len: 1137 microversion: 2.1 time: 1.294769 Jul 19 20:37:29.882789 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3108/6113] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:37:28 2022] POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action => generated 1137 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 19 20:37:29.919352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:29.929216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:29.946453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:29.948158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:29.950609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:29.951653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:30.311613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:30.349850 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-24feade6-c889-430b-b8ff-abbef2ca4012 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.435150 Jul 19 20:37:30.356152 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3006/6114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:29 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:31.376652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:31.377372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:31.385464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:31.385902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:31.386775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:31.387250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:31.590901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:31.601277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-643a3279-4311-4817-b007-07d54c6bd674 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.228774 Jul 19 20:37:31.608197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3109/6115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:31 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:32.625757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:32.626691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:32.641249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:32.642648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:32.644517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:32.645679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:32.873989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:32.887473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3629b5ab-0133-49a3-a72a-80d0f799dd2c tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.270999 Jul 19 20:37:32.888588 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3007/6116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:32 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:33.919030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:33.919995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:33.933866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:33.933866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:33.935413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:33.936230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:34.209276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:34.223707 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4dd2e041-eaf5-435e-a85a-65a283f4530d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.312025 Jul 19 20:37:34.224699 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3110/6117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:33 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:35.250124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:35.250780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:35.258308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:35.258564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:35.259405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:35.259851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:35.450466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:35.463032 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-efd197fc-5911-4c27-990e-7309ac0256bf tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.216438 Jul 19 20:37:35.464031 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3008/6118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:35 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:37:36.493298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:36.494485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:36.508517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:36.509392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:36.510979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:36.511811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:36.718580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:36.727765 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57bd1ffd-ce6f-4685-b8a3-1290d63c4be2 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.242104 Jul 19 20:37:36.728384 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3111/6119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:36 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:37.746266 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:37.747055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:37.755610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:37.756075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:37.756867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:37.757457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:37.921646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:37.940048 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30728e12-ff5f-4bf8-8f46-aac93a7ae386 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.197947 Jul 19 20:37:37.940676 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3009/6120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:37 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:38.964909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:38.965602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:38.973520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:38.973985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:38.974808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:38.975293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:39.168762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:39.179805 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef7e7f78-4dfe-4429-a3a9-f942b7a019c1 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.219036 Jul 19 20:37:39.180671 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3112/6121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:38 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:40.198621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:40.199368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:40.202312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:40.208810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:40.209273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:40.209931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:40.210394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:40.372146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:40.382099 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6050926-8d7b-4e94-b1f7-3f0b2cc0af4f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.187885 Jul 19 20:37:40.382715 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3010/6122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:40 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:41.408126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:41.408758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:41.416791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:41.417260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:41.418146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:41.418598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:41.594432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:41.611012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45ad0593-8109-4b31-8771-d53050676e37 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1691 microversion: 2.1 time: 0.206866 Jul 19 20:37:41.612077 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3113/6123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:41 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:42.633275 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:42.634403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:42.645622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:42.646199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:42.647262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:42.647882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:42.838296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:42.849258 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f772b61-0e7c-49a8-93a1-9cf034b9b70d tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1697 microversion: 2.1 time: 0.220418 Jul 19 20:37:42.861629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3011/6124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:42 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1697 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:43.870624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:43.871384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:43.879494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:43.879972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:43.880868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:43.881303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:44.080447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:44.089569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5a9e7e61-2c4c-4c57-95c8-d97ce8d6a5c3 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1697 microversion: 2.1 time: 0.224499 Jul 19 20:37:44.090373 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3114/6125] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:43 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:45.116566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:37:45.117786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:37:45.132609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:45.132609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:45.132609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:45.132609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:45.133180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=57 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:45.353843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:37:45.363547 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-be93387e-797d-4fc9-ba94-867c0acafd92 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1682 microversion: 2.1 time: 0.251915 Jul 19 20:37:45.364364 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3012/6126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:37:45 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:37:46.872891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-419f4d1c-4ab3-4421-b1e2-835c44ec6e8c req-f5e4209e-e7ba-4b5b-bf38-80f3dd2af214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "name": "network-vif-plugged", "status": "completed", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:37:46.877625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=28 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:46.886463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-419f4d1c-4ab3-4421-b1e2-835c44ec6e8c req-f5e4209e-e7ba-4b5b-bf38-80f3dd2af214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:37:46.888236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-419f4d1c-4ab3-4421-b1e2-835c44ec6e8c req-f5e4209e-e7ba-4b5b-bf38-80f3dd2af214 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:37:46.891006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:46.906003 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-419f4d1c-4ab3-4421-b1e2-835c44ec6e8c req-f5e4209e-e7ba-4b5b-bf38-80f3dd2af214 service nova] Creating event network-vif-plugged:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:37:46.912596 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-419f4d1c-4ab3-4421-b1e2-835c44ec6e8c req-f5e4209e-e7ba-4b5b-bf38-80f3dd2af214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136247 Jul 19 20:37:46.913423 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3115/6127] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:09.623336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:09.624352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:09.626632 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:09.627352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:09.634177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:09.634781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:09.635690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:09.636219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:09.696184 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55385b0e-9b63-4900-a0c6-8c732964f69f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action" status: 200 len: 24566 microversion: 2.1 time: 0.077378 Jul 19 20:38:09.697195 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3013/6128] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:38:09 2022] POST /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:38:21.852086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:21.862064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:21.862901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:21.874941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:21.875681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:21.876973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:21.877664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:21.900576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:21.901923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:21.921251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:38:21.997201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-9eaedb41-7cda-447f-8272-9d8c17b15e2d req-0246e4aa-8a75-41bd-b15d-4e06be127525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:22.014677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9eaedb41-7cda-447f-8272-9d8c17b15e2d req-0246e4aa-8a75-41bd-b15d-4e06be127525 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:22.015060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-9eaedb41-7cda-447f-8272-9d8c17b15e2d req-0246e4aa-8a75-41bd-b15d-4e06be127525 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:22.037460 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-9eaedb41-7cda-447f-8272-9d8c17b15e2d req-0246e4aa-8a75-41bd-b15d-4e06be127525 service nova] Creating event network-changed:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:38:22.047037 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-9eaedb41-7cda-447f-8272-9d8c17b15e2d req-0246e4aa-8a75-41bd-b15d-4e06be127525 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151957 Jul 19 20:38:22.049059 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3014/6129] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:38:22.076892 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f2bd2b3-cf9f-41b3-a4ea-f4fd6dadaf33 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 204 len: 0 microversion: 2.1 time: 0.227636 Jul 19 20:38:22.078718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3116/6130] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:38:21 2022] DELETE /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:38:22.090155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:22.091031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:22.099618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:22.100324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:22.101351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:22.102015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:22.332548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:22.342014 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2bbee5d4-107d-4571-bdd8-ea0ab5300222 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1688 microversion: 2.1 time: 0.257708 Jul 19 20:38:22.342868 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3015/6131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:22 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1688 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:38:23.367760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:23.369178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:23.385046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:23.386406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:23.388241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:23.389300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:23.683111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb1482ceb334a05997d6b95a0499721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581db377dc15414fbb171828ade98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:23.696343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b724471-d403-4e10-9e79-8164ba74255f tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 200 len: 1688 microversion: 2.1 time: 0.337146 Jul 19 20:38:23.697881 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3117/6132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:23 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 1688 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:24.067802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a4ce750a-9901-4a3e-b1ae-cc27e0697620 req-e825b6e3-dae9-45f1-a241-4c6f1e7de60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3759b18-7f4f-49bb-a50a-15be77100cd8", "name": "network-vif-deleted", "tag": "1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:24.086402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a4ce750a-9901-4a3e-b1ae-cc27e0697620 req-e825b6e3-dae9-45f1-a241-4c6f1e7de60e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:24.087247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a4ce750a-9901-4a3e-b1ae-cc27e0697620 req-e825b6e3-dae9-45f1-a241-4c6f1e7de60e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:24.104135 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a4ce750a-9901-4a3e-b1ae-cc27e0697620 req-e825b6e3-dae9-45f1-a241-4c6f1e7de60e service nova] Creating event network-vif-deleted:1bf2ed4d-bfba-4ae0-9337-f4bcee8b82c5 for instance f3759b18-7f4f-49bb-a50a-15be77100cd8 on n-h2-843834-3 Jul 19 20:38:24.109794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a4ce750a-9901-4a3e-b1ae-cc27e0697620 req-e825b6e3-dae9-45f1-a241-4c6f1e7de60e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048003 Jul 19 20:38:24.110742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3016/6133] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:24.717897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:24.718624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] [instance: f3759b18-7f4f-49bb-a50a-15be77100cd8] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:24.729204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:24.729656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:24.730446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:24.731191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:24.746044 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] HTTP exception thrown: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Request method failure captured: Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 HTTP/1.1 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xR1ilYflLlCzjvaEYMxud1Nz8RdrJ1aTK1NMCXklnLH9NYbEtwhr9vwhbTVHr7nndQIlM7Ztfhr0WO4O_46FOZjbP2KKrsM3pev14wM5rVAWg_GPLy993yZA5ymzV3yKB-YrVcqftpilLaZhuon1nn5D6k1hjIzflBx1oLk3_FV6lg Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/581db377dc15414fbb171828ade98746"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_581db377dc15414fbb171828ade98746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/581db377dc15414fbb171828ade98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 581db377dc15414fbb171828ade98746 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1645333064 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 7cb1482ceb334a05997d6b95a0499721 Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1645333064-project Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'f3759b18-7f4f-49bb-a50a-15be77100cd8'} Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:24.747781 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Returning 404 to user: Instance f3759b18-7f4f-49bb-a50a-15be77100cd8 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1c45e27b-957e-4f36-9a39-2f71afdf9d12 tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8" status: 404 len: 111 microversion: 2.1 time: 0.036922 Jul 19 20:38:24.753517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3118/6134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:24 2022] GET /compute/v2.1/servers/f3759b18-7f4f-49bb-a50a-15be77100cd8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:38:28.820909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6e8777a4-336d-4d9b-8d70-f40a8c262fef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] Calling method '.version_select at 0x7f2400a51790>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:28.852462 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6e8777a4-336d-4d9b-8d70-f40a8c262fef tempest-TestNetworkAdvancedServerOps-1645333064 tempest-TestNetworkAdvancedServerOps-1645333064-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-785818248" status: 202 len: 0 microversion: 2.1 time: 0.035980 Jul 19 20:38:28.854421 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3017/6135] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 20:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-785818248 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:38:41.953033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:41.953798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:42.095324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-786672593", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:42.152913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] validate_networks() for None {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:38:42.359872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:38:42.360291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:38:42.360759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:38:42.361162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:38:42.361575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:38:42.374386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:42.374837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:42.375682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:42.376128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:42.409814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Getting quotas for project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:38:42.415824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Getting quotas for user eea7fe5d1903414d8fe6eba9891e03d5 and project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:38:42.430789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:38:42.433142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:38:42.491566 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5555fc0b-504c-4788-8061-a2e1e664fefc tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543473 Jul 19 20:38:42.492781 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3119/6136] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:38:42.501708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:42.503191 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:42.508292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01f55742-c81a-4d67-adda-98a91d016ef2 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:42.510084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01f55742-c81a-4d67-adda-98a91d016ef2 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:42.567777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01f55742-c81a-4d67-adda-98a91d016ef2 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:42.578171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01f55742-c81a-4d67-adda-98a91d016ef2 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1221 microversion: 2.1 time: 0.077921 Jul 19 20:38:42.578797 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3018/6137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:42 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:43.597072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:43.597717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:43.605208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:43.605678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:43.606645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:43.606963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:43.690767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:43.699826 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed2f127a-34a8-4705-9751-38ebbd769152 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1273 microversion: 2.1 time: 0.107530 Jul 19 20:38:43.700686 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3120/6138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:43 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:44.730271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:44.732757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:44.758850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:44.759776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:44.762155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:44.762979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:45.040576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:45.055799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-97598bc4-f541-448d-ac92-e6ec878c5000 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.339769 Jul 19 20:38:45.056997 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3019/6139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:44 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:45.905667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-af46b14c-a1c6-4c99-ad11-48cc16764459 req-3a0a23f1-8297-47dc-8bce-f30524853462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fec5b04-76c1-4e62-941c-58115f3644d6", "tag": "59fde79d-4010-4878-b8f2-89d696cf8348"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:45.925318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-af46b14c-a1c6-4c99-ad11-48cc16764459 req-3a0a23f1-8297-47dc-8bce-f30524853462 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:45.926680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-af46b14c-a1c6-4c99-ad11-48cc16764459 req-3a0a23f1-8297-47dc-8bce-f30524853462 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:45.960136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-af46b14c-a1c6-4c99-ad11-48cc16764459 req-3a0a23f1-8297-47dc-8bce-f30524853462 service nova] Creating event network-changed:59fde79d-4010-4878-b8f2-89d696cf8348 for instance 9fec5b04-76c1-4e62-941c-58115f3644d6 on n-h1-843834-3 Jul 19 20:38:45.967255 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-af46b14c-a1c6-4c99-ad11-48cc16764459 req-3a0a23f1-8297-47dc-8bce-f30524853462 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137639 Jul 19 20:38:45.968105 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3121/6140] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:46.082244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:46.083182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:46.090137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:46.090586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:46.091430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:46.091890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:46.315721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:46.324192 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3396fd75-19fc-48f7-947b-50a9b9c630b9 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.246753 Jul 19 20:38:46.325150 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3020/6141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:46 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:47.343543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:47.344489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:47.351208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:47.351653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:47.352433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:47.352863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:47.525803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:47.534472 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e6a92693-90dd-47de-b090-d3606073a747 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.196410 Jul 19 20:38:47.535483 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3122/6142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:47 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:48.552054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:48.552663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:48.561106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:48.561584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:48.562403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:48.562858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:48.752317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:48.761489 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b6fdf487-f2c1-42f8-a0ee-3c5786d1983d tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.213598 Jul 19 20:38:48.762089 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3021/6143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:48 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:49.777925 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:49.778562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:49.786619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:49.787140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:49.787997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:49.788489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:49.994386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:50.003299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a42058fc-010c-424e-88bf-afb559741c80 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.229133 Jul 19 20:38:50.003931 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3123/6144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:49 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:51.021677 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:51.022342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:51.029962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:51.030428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:51.031265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:51.031713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:51.182242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:51.190679 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-75beaa0a-a1ff-421c-a971-bd5521cd1707 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.173049 Jul 19 20:38:51.191370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3022/6145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:51 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:51.457754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-42855940-eb3c-45dd-943e-822143b745df req-f302ea1b-cb63-41eb-9b57-e6e26db02aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fec5b04-76c1-4e62-941c-58115f3644d6", "name": "network-vif-plugged", "status": "completed", "tag": "59fde79d-4010-4878-b8f2-89d696cf8348"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:51.472903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-42855940-eb3c-45dd-943e-822143b745df req-f302ea1b-cb63-41eb-9b57-e6e26db02aa2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:51.473696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-42855940-eb3c-45dd-943e-822143b745df req-f302ea1b-cb63-41eb-9b57-e6e26db02aa2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:51.486145 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-42855940-eb3c-45dd-943e-822143b745df req-f302ea1b-cb63-41eb-9b57-e6e26db02aa2 service nova] Creating event network-vif-plugged:59fde79d-4010-4878-b8f2-89d696cf8348 for instance 9fec5b04-76c1-4e62-941c-58115f3644d6 on n-h1-843834-3 Jul 19 20:38:51.492028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-42855940-eb3c-45dd-943e-822143b745df req-f302ea1b-cb63-41eb-9b57-e6e26db02aa2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037753 Jul 19 20:38:51.493155 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3124/6146] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:52.210411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:52.211249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:52.218773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:52.219268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:52.220289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:52.220744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:52.370148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:52.378972 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a563647e-5c76-422d-a5da-d74c16aa5ae6 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1321 microversion: 2.1 time: 0.172366 Jul 19 20:38:52.379591 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3023/6147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:52 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:53.394000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:53.394803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:53.400308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:53.401025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:53.408800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:53.409259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:53.410075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:53.410520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:53.563745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:53.572440 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-344b40dd-06e4-412e-bbdd-4423125fb864 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1471 microversion: 2.1 time: 0.179204 Jul 19 20:38:53.573059 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3125/6148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:53 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:53.592559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:53.651485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dbb9f6b4-30b6-4477-a693-95d26f616a3c tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '.version_select at 0x7f23efbaaa60>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:53.726584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dbb9f6b4-30b6-4477-a693-95d26f616a3c tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5e1b9f01b5454b02981e3b781095d7cb" status: 200 len: 371 microversion: 2.1 time: 0.138875 Jul 19 20:38:53.727211 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3024/6149] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 20:38:53 2022] GET /compute/v2.1/os-quota-sets/5e1b9f01b5454b02981e3b781095d7cb => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:53.738963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2bd5a00f-6e11-49f0-8759-0c0e60950b71 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-444353174", "id": 782651920, "os-flavor-access:is_public": "True"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:53.740747 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:38:53.740747 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:38:53.759976 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2bd5a00f-6e11-49f0-8759-0c0e60950b71 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.025315 Jul 19 20:38:53.760582 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3126/6150] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:38:53 2022] POST /compute/v2.1/flavors => generated 434 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:53.778959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "782651920"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:53.780854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:53.792445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:53.793238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:53.794588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:53.795418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:53.999267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1569eae089d642d197d8255f5e9a6821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b9f01b5454b02981e3b781095d7cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:54.006571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-444353174 {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:38:54.014412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.014880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.015740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.016196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.043149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Getting quotas for project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:38:54.049425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Getting quotas for user eea7fe5d1903414d8fe6eba9891e03d5 and project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:38:54.063626 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] ram quota exceeded for 5e1b9f01b5454b02981e3b781095d7cb, tried to resize instance. Jul 19 20:38:54.064186 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Request method failure captured: Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action HTTP/1.1 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 38 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xZRHk6UTt52sGf5OqhuFGctFCnq_vSVLLtOAijIvDJoPRaSBYRCuflWyhnXKvJHe1sh-namNDHKw1sbkeXK1R8cInfnkdzA7HbthNcRz2p7B0V2xkVDS5OYqUoUuIZ4B0q_vfFMr1R14E8gChG8hoaxW3JSvmTlks7mZxIYSbTR9Nc Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 5e1b9f01b5454b02981e3b781095d7cb Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,admin,member Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,admin,member Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 5e1b9f01b5454b02981e3b781095d7cb Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersAdminNegativeTestJSON-850593102-project-admin Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 1569eae089d642d197d8255f5e9a6821 Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersAdminNegativeTestJSON-850593102-project-admin Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: {"resize": {"flavorRef": "782651920"}} Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '9fec5b04-76c1-4e62-941c-58115f3644d6', 'body': {'resize': {'flavorRef': '782651920'}}} Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.066368 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-900604c1-1c39-4cf4-a9b2-e14fd7f7d249 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action" status: 403 len: 118 microversion: 2.1 time: 0.296257 Jul 19 20:38:54.072978 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3025/6151] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:38:53 2022] POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action => generated 118 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:38:54.080524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2d20b524-0d1d-4422-9743-c2448bf65a4a tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.081314 n-d-843834-3 devstack@n-api.service[131229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:38:54.081314 n-d-843834-3 devstack@n-api.service[131229]: warnings.warn(msg) Jul 19 20:38:54.100255 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2d20b524-0d1d-4422-9743-c2448bf65a4a tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/782651920" status: 202 len: 0 microversion: 2.1 time: 0.023816 Jul 19 20:38:54.100961 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3127/6152] 10.222.0.23 () {58 vars in 1157 bytes} [Tue Jul 19 20:38:54 2022] DELETE /compute/v2.1/flavors/782651920 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:38:54.110482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1f2dbc7f-506a-4ba4-88a6-877269e86700 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.131381 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1f2dbc7f-506a-4ba4-88a6-877269e86700 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025281 Jul 19 20:38:54.132002 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3026/6153] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 20:38:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:38:54.151483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29ccccea-1026-4ce2-bdea-0ad036655079 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '.version_select at 0x7f23ee289ca0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.241137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29ccccea-1026-4ce2-bdea-0ad036655079 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5e1b9f01b5454b02981e3b781095d7cb" status: 200 len: 371 microversion: 2.1 time: 0.094589 Jul 19 20:38:54.242236 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3128/6154] 10.222.0.23 () {58 vars in 1241 bytes} [Tue Jul 19 20:38:54 2022] GET /compute/v2.1/os-quota-sets/5e1b9f01b5454b02981e3b781095d7cb => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:54.253529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3c3adfb0-a379-41e9-adb2-97039ffbf32e tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1148592725", "id": 1936055213, "os-flavor-access:is_public": "True"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:54.255533 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:38:54.255533 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 20:38:54.275162 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3c3adfb0-a379-41e9-adb2-97039ffbf32e tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.025463 Jul 19 20:38:54.275787 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3027/6155] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:38:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:54.292219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1936055213"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:54.294122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:54.305576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.306430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.307911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.308750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.528251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1569eae089d642d197d8255f5e9a6821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b9f01b5454b02981e3b781095d7cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:54.536274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1148592725 {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:38:54.544000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.544464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.545281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.545716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.568614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Getting quotas for project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:38:54.574603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Getting quotas for user eea7fe5d1903414d8fe6eba9891e03d5 and project 819e7e87bc404b8fb3241ecd30b82106. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:38:54.588308 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.compute.api [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] cores quota exceeded for 5e1b9f01b5454b02981e3b781095d7cb, tried to resize instance. Jul 19 20:38:54.588842 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Request method failure captured: Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action HTTP/1.1 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 39 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xZRHk6UTt52sGf5OqhuFGctFCnq_vSVLLtOAijIvDJoPRaSBYRCuflWyhnXKvJHe1sh-namNDHKw1sbkeXK1R8cInfnkdzA7HbthNcRz2p7B0V2xkVDS5OYqUoUuIZ4B0q_vfFMr1R14E8gChG8hoaxW3JSvmTlks7mZxIYSbTR9Nc Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 5e1b9f01b5454b02981e3b781095d7cb Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,admin,member Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,admin,member Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e1b9f01b5454b02981e3b781095d7cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 5e1b9f01b5454b02981e3b781095d7cb Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-850593102 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-850593102-project-admin Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 1569eae089d642d197d8255f5e9a6821 Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-850593102-project-admin Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: {"resize": {"flavorRef": "1936055213"}} Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '9fec5b04-76c1-4e62-941c-58115f3644d6', 'body': {'resize': {'flavorRef': '1936055213'}}} Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.590997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-064a4fc8-13b9-4e74-a9ac-e2b0056d358f tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action" status: 403 len: 113 microversion: 2.1 time: 0.308384 Jul 19 20:38:54.599102 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3129/6156] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:38:54 2022] POST /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6/action => generated 113 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:38:54.607068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf1aa442-80b2-4377-9ba2-aab21897c7f7 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.608431 n-d-843834-3 devstack@n-api.service[131230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:38:54.608431 n-d-843834-3 devstack@n-api.service[131230]: warnings.warn(msg) Jul 19 20:38:54.636015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf1aa442-80b2-4377-9ba2-aab21897c7f7 tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1936055213" status: 202 len: 0 microversion: 2.1 time: 0.035665 Jul 19 20:38:54.636781 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3028/6157] 10.222.0.23 () {58 vars in 1160 bytes} [Tue Jul 19 20:38:54 2022] DELETE /compute/v2.1/flavors/1936055213 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:38:54.647150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1757474c-f3d9-4e63-935f-ecdd9cf1118c tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.667285 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1757474c-f3d9-4e63-935f-ecdd9cf1118c tempest-ServersAdminNegativeTestJSON-850593102 tempest-ServersAdminNegativeTestJSON-850593102-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023856 Jul 19 20:38:54.667865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3130/6158] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Jul 19 20:38:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:54.685638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.686181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:54.693470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.693855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.694654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.695138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.724811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:38:54.836072 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7929afa-8d53-4443-9dbd-98d45e73f37f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 204 len: 0 microversion: 2.1 time: 0.154631 Jul 19 20:38:54.836707 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3029/6159] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:38:54 2022] DELETE /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:38:54.847362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:54.848118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:54.855901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.856520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:54.857434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:54.858037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:55.046046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:55.055219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e2dff12-21bb-464c-bbd8-7738cd0c8f5f tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1477 microversion: 2.1 time: 0.213094 Jul 19 20:38:55.055801 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3131/6160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:54 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:56.073338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:56.074270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:56.082487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:56.083049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:56.083985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:56.084702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:56.250891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:56.259954 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a381b5eb-1adf-4195-8e6e-871b8b022bff tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1477 microversion: 2.1 time: 0.191460 Jul 19 20:38:56.260680 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3030/6161] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:56 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:57.069285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-cdf5b998-81f3-41c4-97d2-8ef347d621d1 req-158ce45f-96c2-45d4-8b4e-af7989f0e803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fec5b04-76c1-4e62-941c-58115f3644d6", "name": "network-vif-deleted", "tag": "59fde79d-4010-4878-b8f2-89d696cf8348"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:38:57.083492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cdf5b998-81f3-41c4-97d2-8ef347d621d1 req-158ce45f-96c2-45d4-8b4e-af7989f0e803 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:57.083990 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-cdf5b998-81f3-41c4-97d2-8ef347d621d1 req-158ce45f-96c2-45d4-8b4e-af7989f0e803 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:57.112430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-cdf5b998-81f3-41c4-97d2-8ef347d621d1 req-158ce45f-96c2-45d4-8b4e-af7989f0e803 service nova] Creating event network-vif-deleted:59fde79d-4010-4878-b8f2-89d696cf8348 for instance 9fec5b04-76c1-4e62-941c-58115f3644d6 on n-h1-843834-3 Jul 19 20:38:57.122260 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-cdf5b998-81f3-41c4-97d2-8ef347d621d1 req-158ce45f-96c2-45d4-8b4e-af7989f0e803 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057028 Jul 19 20:38:57.124232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3132/6162] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:38:57.277833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:57.278466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:57.286386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:57.287226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:57.288042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:57.288496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:57.323505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:57.323991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:57.324450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lazy-loading 'fault' on Instance uuid 9fec5b04-76c1-4e62-941c-58115f3644d6 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:38:57.386155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea7fe5d1903414d8fe6eba9891e03d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819e7e87bc404b8fb3241ecd30b82106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:38:57.395282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-622705be-349a-401c-a913-b276a1c35972 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 200 len: 1311 microversion: 2.1 time: 0.121553 Jul 19 20:38:57.396027 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3031/6163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:57 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:38:58.414602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:38:58.415340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] [instance: 9fec5b04-76c1-4e62-941c-58115f3644d6] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:38:58.422327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:58.422801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:58.423648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:38:58.424092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:38:58.439645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] HTTP exception thrown: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Request method failure captured: Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 HTTP/1.1 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xZRbvUTduiRrvO7UXJPHPT65lP_MkE8UcbDX59ZMUY8PuuCM_86fbnvEeTAradMOeuwLGzKQkqAzGz-NcTY963tT8puiI9rQE3BvJXBRB1RZ-3RclWyKsIzD77X3JhO-G-1qPFAxPeqXNm0JlBLWV5jwzztfXb-d2X58jJOZlGKHns Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 819e7e87bc404b8fb3241ecd30b82106 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2113830222 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/819e7e87bc404b8fb3241ecd30b82106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/819e7e87bc404b8fb3241ecd30b82106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_819e7e87bc404b8fb3241ecd30b82106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/819e7e87bc404b8fb3241ecd30b82106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2113830222 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 819e7e87bc404b8fb3241ecd30b82106 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2113830222 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersAdminNegativeTestJSON-2113830222-project Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: eea7fe5d1903414d8fe6eba9891e03d5 Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2113830222-project Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '9fec5b04-76c1-4e62-941c-58115f3644d6'} Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:58.441423 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] Returning 404 to user: Instance 9fec5b04-76c1-4e62-941c-58115f3644d6 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d5321028-d6cf-4b77-b8cb-eced0a7f85c0 tempest-ServersAdminNegativeTestJSON-2113830222 tempest-ServersAdminNegativeTestJSON-2113830222-project] 10.222.0.23 "GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6" status: 404 len: 111 microversion: 2.1 time: 0.033633 Jul 19 20:38:58.450174 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3133/6164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:38:58 2022] GET /compute/v2.1/servers/9fec5b04-76c1-4e62-941c-58115f3644d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:39:06.051477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:06.053280 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:06.197930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1700600935", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "d351add4-029f-4ac8-b510-ff39839b8e20"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:06.257732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] validate_networks() for [('d351add4-029f-4ac8-b510-ff39839b8e20', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:39:06.694033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:39:06.694476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:39:06.695006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:39:06.695449 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:39:06.695886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:39:06.707036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:06.707850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:06.708692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:06.709149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:06.730208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Getting quotas for project f23c95319e79424d8814941818bad5ba. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:39:06.736446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Getting quotas for user 8287dbcc25a648d393211a8771515b72 and project f23c95319e79424d8814941818bad5ba. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:39:06.753517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:39:06.756072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:39:06.809951 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5137a073-02ad-40e0-a6b3-be24af0bf725 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767056 Jul 19 20:39:06.811218 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3032/6165] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:39:06.826662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-679e5a91-2eaa-4228-862e-eb22263a3758 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:06.829776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-679e5a91-2eaa-4228-862e-eb22263a3758 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:06.836930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:06.843357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:06.920293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-679e5a91-2eaa-4228-862e-eb22263a3758 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:06.929577 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-679e5a91-2eaa-4228-862e-eb22263a3758 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1215 microversion: 2.1 time: 0.110744 Jul 19 20:39:06.930323 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3134/6166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:06 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:07.951031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa6a20dd-a458-4f9f-867c-f97e8e2d2a05 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:07.951829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fa6a20dd-a458-4f9f-867c-f97e8e2d2a05 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:08.023718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fa6a20dd-a458-4f9f-867c-f97e8e2d2a05 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:08.036481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa6a20dd-a458-4f9f-867c-f97e8e2d2a05 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1215 microversion: 2.1 time: 0.091558 Jul 19 20:39:08.038296 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3033/6167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:07 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:09.087473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:09.091191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:09.096585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=53 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:09.132551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:09.134010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:09.135983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:09.137132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:09.258337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:09.269440 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cfdc5941-5cee-47a0-a4cb-6636872fba80 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1267 microversion: 2.1 time: 0.199394 Jul 19 20:39:09.270048 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3135/6168] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:09 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:09.379861 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:39:09.380131 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:39:10.300707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:10.301667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:10.311726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:10.312460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:10.313660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:10.314301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:11.162250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:11.178140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b14a8231-0d2d-42ba-bc4f-c7aa129379b1 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.886688 Jul 19 20:39:11.179626 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3034/6169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:10 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:12.145146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f819bd04-4988-4b3e-bc0e-48c3c9a1f1ce req-59a78fb4-1060-49fe-8560-ad52fed18d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:12.155513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:12.176671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f819bd04-4988-4b3e-bc0e-48c3c9a1f1ce req-59a78fb4-1060-49fe-8560-ad52fed18d11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:12.184253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f819bd04-4988-4b3e-bc0e-48c3c9a1f1ce req-59a78fb4-1060-49fe-8560-ad52fed18d11 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:12.208086 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f819bd04-4988-4b3e-bc0e-48c3c9a1f1ce req-59a78fb4-1060-49fe-8560-ad52fed18d11 service nova] Creating event network-changed:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h1-843834-3 Jul 19 20:39:12.209791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:12.211237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:12.217123 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f819bd04-4988-4b3e-bc0e-48c3c9a1f1ce req-59a78fb4-1060-49fe-8560-ad52fed18d11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090063 Jul 19 20:39:12.218878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3136/6170] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:12.230048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:12.231455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:12.233429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:12.234249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:12.487920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:12.497604 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d63902fc-f277-4268-a875-77590e267f3f tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.295015 Jul 19 20:39:12.506837 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3035/6171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:12 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:13.520453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:13.521057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:13.529753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:13.530201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:13.531033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:13.531477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:13.685163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:13.693306 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b808c12-cc33-4357-a03b-322341a64846 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.177480 Jul 19 20:39:13.693924 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3137/6172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:13 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:14.712205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:14.714703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:14.722412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:14.729736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:14.730435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:14.731675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:14.732571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:14.737504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:14.921535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:14.930017 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c92c35fd-c197-44b9-bb56-b75e23875a3d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.221961 Jul 19 20:39:14.930641 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3036/6173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:14 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:15.948798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:15.949523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:15.957389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:15.957855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:15.958659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:15.959228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:16.159689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:16.171943 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29d71879-1ed1-435f-b133-c1558fabd9f2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.227617 Jul 19 20:39:16.173215 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3138/6174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:15 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:17.192312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:17.193078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:17.196025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:17.202968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:17.203451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:17.204270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:17.204729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:17.362727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:17.372062 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c427ecc0-e7be-4065-bbe9-03e16874abdc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.183841 Jul 19 20:39:17.372849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3037/6175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:17 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:17.674757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f73031dc-b1ef-44bc-8f3c-895eb1d7b0b8 req-1acbbb0e-dfd7-4471-a3ee-dded554a2988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "name": "network-vif-plugged", "status": "completed", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:17.683812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:17.694325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f73031dc-b1ef-44bc-8f3c-895eb1d7b0b8 req-1acbbb0e-dfd7-4471-a3ee-dded554a2988 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:17.695148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f73031dc-b1ef-44bc-8f3c-895eb1d7b0b8 req-1acbbb0e-dfd7-4471-a3ee-dded554a2988 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:17.718623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f73031dc-b1ef-44bc-8f3c-895eb1d7b0b8 req-1acbbb0e-dfd7-4471-a3ee-dded554a2988 service nova] Creating event network-vif-plugged:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h1-843834-3 Jul 19 20:39:17.727994 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f73031dc-b1ef-44bc-8f3c-895eb1d7b0b8 req-1acbbb0e-dfd7-4471-a3ee-dded554a2988 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060120 Jul 19 20:39:17.729267 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3139/6176] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:18.390818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:18.391609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:18.393662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:18.401623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:18.402096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:18.402984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:18.403529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:18.575537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:18.584974 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ab6d5fa-415a-4494-9d8e-1d003e95e9e8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1315 microversion: 2.1 time: 0.198337 Jul 19 20:39:18.585599 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3038/6177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:18 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:19.611600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:19.612366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.620437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.621052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.621971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.622575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.779615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:19.794446 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8417a7f6-86be-4d2f-8c52-89d064a9e477 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1502 microversion: 2.1 time: 0.187819 Jul 19 20:39:19.795599 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3140/6178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:19 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:19.813071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:19.814516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.823919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.824438 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.825515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.826286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.866223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:19.873918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Old instance type m1.heat2, new instance type m1.heat {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:39:19.881946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:39:19.882379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:39:19.883189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:39:19.883552 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:39:19.884069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:39:19.963551 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ab6e05a9-e200-4235-9275-6c8dd01d5253 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "POST /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d/action" status: 202 len: 0 microversion: 2.1 time: 0.154564 Jul 19 20:39:19.964491 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3039/6179] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:39:19 2022] POST /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:39:19.977932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:19.979015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:19.990453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.991282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:19.992747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:19.993688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:20.212686 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:20.221729 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-30026380-8978-4850-9203-c3a296af2f0c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1511 microversion: 2.1 time: 0.251368 Jul 19 20:39:20.222348 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3141/6180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:19 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:21.254970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:21.256483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:21.274086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.274941 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.276477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:21.277223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:21.445235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:21.458713 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-00c54770-c85a-4470-b65e-b36792b2a5c6 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1511 microversion: 2.1 time: 0.211949 Jul 19 20:39:21.459863 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3040/6181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:21 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:22.489028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:22.490213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:22.503814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:22.504234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:22.505674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:22.506453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:22.699782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:22.709179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b8a3d51-dc70-4de3-b85b-eae0f8061b14 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.228138 Jul 19 20:39:22.709783 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3142/6182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:22 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:23.728620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:23.729381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:23.737269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:23.737778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:23.738581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:23.739073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:23.902760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:23.911888 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc23a91c-8988-4a2f-a0a6-e6db94ccb647 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.187730 Jul 19 20:39:23.912497 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3041/6183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:23 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:24.931372 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:24.932011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:24.939740 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:24.940250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:24.941119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:24.941610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:25.121598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:25.131113 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7dec5f17-39cb-4263-88d2-21cb99e12197 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.204465 Jul 19 20:39:25.132172 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3143/6184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:24 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:26.150653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:26.151674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:26.160103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:26.160625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:26.161568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:26.162103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:26.314129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:26.323117 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8b0f815-8975-4548-a76e-196b052012e7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.177101 Jul 19 20:39:26.323828 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3042/6185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:26 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:27.345944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:27.347137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:27.361088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:27.361894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:27.363393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:27.364143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:27.534854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:27.543662 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4aaaa6b5-71c7-42fb-8637-4d355078b0ea tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.205418 Jul 19 20:39:27.544236 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3144/6186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:27 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:28.561691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:28.562349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:28.570732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:28.571726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:28.572662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:28.573225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:28.741117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:28.755495 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9392cab5-45cb-49c9-878e-fed5bd56695c tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.197509 Jul 19 20:39:28.756373 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3043/6187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:28 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:29.781402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:29.782319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:29.790627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:29.791127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:29.791963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:29.792555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:29.945681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:29.954876 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58e9afea-b08a-4485-a91b-f250252a9b77 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.177483 Jul 19 20:39:29.955494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3145/6188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:29 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:30.974388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:30.976203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:30.984290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:30.984894 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:30.985890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:30.986468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:31.156043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:31.169680 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-097129ee-b241-43e9-b806-7b1cf2c42f66 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.199945 Jul 19 20:39:31.172754 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3044/6189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:30 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:32.190034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:32.191104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:32.200076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:32.200555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:32.201370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:32.201820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:32.396484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:32.405577 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-723837ac-f06e-4b30-a148-9304dbb7982a tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.220056 Jul 19 20:39:32.406227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3146/6190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:32 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:33.425229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:33.426121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:33.433358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:33.433867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:33.434748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:33.435395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:33.599098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:33.607844 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f2acf610-fab6-4808-ad8d-b7b31324babd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.186928 Jul 19 20:39:33.608467 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3045/6191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:33 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:34.626093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:34.626786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:34.637512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:34.638301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:34.639769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:34.640552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:34.831893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:34.840133 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e0937071-63c3-4fc6-b0c5-dbd8bc485a42 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.218065 Jul 19 20:39:34.840749 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3147/6192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:34 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:35.858725 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:35.859443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:35.867829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:35.868289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:35.869173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:35.869620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:36.028489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:36.039831 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-294f9e58-fa81-4af3-a05a-c06ebafcef79 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.184841 Jul 19 20:39:36.041035 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3046/6193] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:35 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:37.061578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:37.062490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:37.070373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:37.070840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:37.072085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:37.072523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:37.227826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:37.236603 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-56742193-2a01-43dc-8fa5-0bcf3dd1ad65 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.179546 Jul 19 20:39:37.237197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3148/6194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:37 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:38.255368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:38.256268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:38.263851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:38.264421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:38.265474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:38.266097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:38.451249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:38.459867 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-091f3bbb-960a-4d2c-86d0-58791b19285e tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.208572 Jul 19 20:39:38.460503 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3047/6195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:38 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:39.478445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:39.479100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:39.486840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:39.487326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:39.488120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:39.488554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:39.491723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=77 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:39.637471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:39.645687 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1fe12e04-65dc-4f9b-94d8-56084c062bee tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.171410 Jul 19 20:39:39.646292 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3149/6196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:39 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:40.665237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:40.665916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:40.674255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:40.674742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:40.675756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:40.676223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:40.843406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:40.853664 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-01599666-a81a-49d1-9338-43e7f8d573cb tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.192818 Jul 19 20:39:40.854293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3048/6197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:40 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:41.872723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:41.873420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:41.882161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:41.882644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:41.883493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:41.883939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:42.050951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:42.060011 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9cb583c4-8326-45f2-b740-63a3522dd8cf tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.191706 Jul 19 20:39:42.060635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3150/6198] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:41 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:43.078621 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:43.079396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:43.087671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:43.088185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:43.089025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:43.089519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:43.250109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:43.264531 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2e098cc7-9e9a-4d15-87e7-ad70a79ba058 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.189684 Jul 19 20:39:43.265585 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3049/6199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:43 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:44.283138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:44.283792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:44.287139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=30 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:44.293696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:44.294497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:44.295427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:44.295868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:44.453293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:44.461916 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bf19cc58-5e3a-4386-9841-eadf2f2f8e16 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.182682 Jul 19 20:39:44.462532 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3151/6200] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:44 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:45.483878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:45.484938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:45.489672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=32 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:45.499810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:45.500619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:45.502022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:45.502844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:45.512337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:45.702721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:45.716947 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6eadbf9c-6e24-4449-bd93-78e42b86a22d tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.240337 Jul 19 20:39:45.717990 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3050/6201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:45 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:46.742860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:46.743528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:46.751791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.752242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.753034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:46.753454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:46.938584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:46.948103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c85ba918-cb6d-4d89-87ff-d63567105bc8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.209286 Jul 19 20:39:46.948717 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3152/6202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:46 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:47.966058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:47.966879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:47.974962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:47.975451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:47.976253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:47.976703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:48.129909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:48.141215 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-778032c8-218e-4fb7-9052-e5cf599d8cb2 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.179361 Jul 19 20:39:48.141827 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3051/6203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:47 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:49.159640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:49.160309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:49.169020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:49.169509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:49.170320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:49.170761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:49.351300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:49.359895 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6a22db34-f364-4935-9234-fa4fe7fcbcb8 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1516 microversion: 2.1 time: 0.204218 Jul 19 20:39:49.360752 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3153/6204] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:49 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:50.382773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:50.384042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:50.396923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:50.397748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:50.399392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:50.400219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:50.885139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:50.894235 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0fa9f08-64f5-4ad2-945b-d97323409f5b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1515 microversion: 2.1 time: 0.519032 Jul 19 20:39:50.895499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3052/6205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:50 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:51.010840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "name": "network-vif-unplugged", "status": "completed", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:51.025693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:51.026521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:51.059918 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] Creating event network-vif-unplugged:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h2-843834-3 Jul 19 20:39:51.068966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] Instance 1c7224f5-f320-4415-a932-891112f7849d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:39:51.086223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-61e2176c-0143-4bc6-b21e-faf844843783 req-85fa08b8-b144-4c35-ad1d-753cdedff09a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079180 Jul 19 20:39:51.086955 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3154/6206] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:51.913693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:51.914780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:51.924075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:51.924857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:51.926291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:51.926890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:52.178351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:52.188705 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c574100a-6d0d-42b0-ba0a-2905f2aaba63 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1515 microversion: 2.1 time: 0.279527 Jul 19 20:39:52.189561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3053/6207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:51 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:53.106079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:53.115446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:53.115906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:53.131031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] Creating event network-changed:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h2-843834-3 Jul 19 20:39:53.138099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] Instance 1c7224f5-f320-4415-a932-891112f7849d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:39:53.152552 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8227f739-765e-4793-bd37-b8c8ebaa34b0 req-9587bbb2-073d-4838-84ff-a36c5db31494 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051155 Jul 19 20:39:53.153618 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3155/6208] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:53.210587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:53.211706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:53.219574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:53.220045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:53.220880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:53.221380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:53.673059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:53.685425 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98788b5a-25a1-4558-b9e2-369cc739a3cd tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1513 microversion: 2.1 time: 0.478912 Jul 19 20:39:53.686518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3054/6209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:53 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1513 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:54.715241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:54.716646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:54.728391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:54.729689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:54.731524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:54.732795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:55.005987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:55.016410 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7cdad5ad-9f18-48d8-b027-8a2e95652b6b tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1510 microversion: 2.1 time: 0.307534 Jul 19 20:39:55.017504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3156/6210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:54 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:55.034405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:55.035337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:55.046379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:55.047541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:55.048630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:55.049338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:55.090810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:39:55.185961 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Found an unconfirmed migration during delete, id: 16, status: finished Jul 19 20:39:57.193799 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f9a03795-8eec-408f-ae7e-7a660e9d52bc tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 204 len: 0 microversion: 2.1 time: 2.163039 Jul 19 20:39:57.197167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3055/6211] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:39:55 2022] DELETE /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 0 bytes in 2168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:39:57.207091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:57.207940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:57.215971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:57.216414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:57.217440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:57.217878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:57.366790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-798ee344-9e74-4428-9809-990a4241a3b9 req-7c8f968d-fb31-41a9-99eb-4486e2245995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "name": "network-vif-plugged", "status": "completed", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:57.384408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-798ee344-9e74-4428-9809-990a4241a3b9 req-7c8f968d-fb31-41a9-99eb-4486e2245995 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:57.384408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-798ee344-9e74-4428-9809-990a4241a3b9 req-7c8f968d-fb31-41a9-99eb-4486e2245995 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:57.405881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:57.410864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-798ee344-9e74-4428-9809-990a4241a3b9 req-7c8f968d-fb31-41a9-99eb-4486e2245995 service nova] Creating event network-vif-plugged:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h2-843834-3 Jul 19 20:39:57.417369 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-798ee344-9e74-4428-9809-990a4241a3b9 req-7c8f968d-fb31-41a9-99eb-4486e2245995 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059336 Jul 19 20:39:57.418012 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3056/6212] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:57.420569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-292c4d01-78a7-4dd5-b921-33528ded6a36 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1502 microversion: 2.1 time: 0.217199 Jul 19 20:39:57.421882 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3157/6213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:57 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:39:58.441386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:58.442308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:58.449833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:58.450317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:58.451153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:58.451636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:58.717908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287dbcc25a648d393211a8771515b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f23c95319e79424d8814941818bad5ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:39:58.727537 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-aa4e879b-b5b8-4a73-b9b4-3557a9842343 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 200 len: 1502 microversion: 2.1 time: 0.291714 Jul 19 20:39:58.728258 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3057/6214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:58 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:39:59.133263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4104f6cc-8bda-485a-85d4-2b67b85d6add req-23321113-401f-4473-ab2f-2e5068715049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7224f5-f320-4415-a932-891112f7849d", "name": "network-vif-deleted", "tag": "621630f3-43a0-49c4-b6b4-fccfe2472481"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:39:59.160108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4104f6cc-8bda-485a-85d4-2b67b85d6add req-23321113-401f-4473-ab2f-2e5068715049 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.161018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4104f6cc-8bda-485a-85d4-2b67b85d6add req-23321113-401f-4473-ab2f-2e5068715049 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.215281 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4104f6cc-8bda-485a-85d4-2b67b85d6add req-23321113-401f-4473-ab2f-2e5068715049 service nova] Creating event network-vif-deleted:621630f3-43a0-49c4-b6b4-fccfe2472481 for instance 1c7224f5-f320-4415-a932-891112f7849d on n-h2-843834-3 Jul 19 20:39:59.215281 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4104f6cc-8bda-485a-85d4-2b67b85d6add req-23321113-401f-4473-ab2f-2e5068715049 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065314 Jul 19 20:39:59.215281 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3158/6215] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:39:59.753678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:59.754469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:59.762582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.763178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.764082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.764583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.783904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] HTTP exception thrown: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Request method failure captured: Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d HTTP/1.1 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xZpLO-4T5rPrw3tBau0r4WrEQOvLieR_cmWTSKkUtdMhUDaqszLaFlgn1cW-8kZ95A4dKrDfoRy0QgVOlJoJt3GFAzMj6Q0zW93saI94vPLYwQbyYcH_8XquzkVSXHNS_9U5ms3jnfgLL_N3cnz5HUMBrz0mZrIIWH-DBOAzH3DJxc Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f23c95319e79424d8814941818bad5ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f23c95319e79424d8814941818bad5ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8287dbcc25a648d393211a8771515b72 Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1c7224f5-f320-4415-a932-891112f7849d'} Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.785680 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Returning 404 to user: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c51c0a6c-4f13-41a9-8d23-ac71dd6405b7 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 404 len: 111 microversion: 2.1 time: 0.037644 Jul 19 20:39:59.789755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3058/6216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:59 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:39:59.803259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:59.803788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:59.813207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.813661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.814457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.814889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.830885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] HTTP exception thrown: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Request method failure captured: Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d HTTP/1.1 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xZpLO-4T5rPrw3tBau0r4WrEQOvLieR_cmWTSKkUtdMhUDaqszLaFlgn1cW-8kZ95A4dKrDfoRy0QgVOlJoJt3GFAzMj6Q0zW93saI94vPLYwQbyYcH_8XquzkVSXHNS_9U5ms3jnfgLL_N3cnz5HUMBrz0mZrIIWH-DBOAzH3DJxc Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f23c95319e79424d8814941818bad5ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f23c95319e79424d8814941818bad5ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 8287dbcc25a648d393211a8771515b72 Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1c7224f5-f320-4415-a932-891112f7849d'} Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:39:59.832820 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Returning 404 to user: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d101ef65-877b-438b-a743-81bbd2c8faa5 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 404 len: 111 microversion: 2.1 time: 0.036546 Jul 19 20:39:59.839006 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3159/6217] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:39:59 2022] DELETE /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:39:59.850242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:59.850926 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] [instance: 1c7224f5-f320-4415-a932-891112f7849d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:39:59.858568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.859181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.860107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:59.860845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:59.877314 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] HTTP exception thrown: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Request method failure captured: Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d HTTP/1.1 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xZpLO-4T5rPrw3tBau0r4WrEQOvLieR_cmWTSKkUtdMhUDaqszLaFlgn1cW-8kZ95A4dKrDfoRy0QgVOlJoJt3GFAzMj6Q0zW93saI94vPLYwQbyYcH_8XquzkVSXHNS_9U5ms3jnfgLL_N3cnz5HUMBrz0mZrIIWH-DBOAzH3DJxc Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f23c95319e79424d8814941818bad5ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f23c95319e79424d8814941818bad5ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f23c95319e79424d8814941818bad5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: f23c95319e79424d8814941818bad5ba Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-DeleteServersTestJSON-1635947214 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 8287dbcc25a648d393211a8771515b72 Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-DeleteServersTestJSON-1635947214-project Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1c7224f5-f320-4415-a932-891112f7849d'} Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:39:59.878953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] Returning 404 to user: Instance 1c7224f5-f320-4415-a932-891112f7849d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b228d0bc-0dc9-40cc-9eb8-b31e1e34fd07 tempest-DeleteServersTestJSON-1635947214 tempest-DeleteServersTestJSON-1635947214-project] 10.222.0.23 "GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d" status: 404 len: 111 microversion: 2.1 time: 0.034882 Jul 19 20:39:59.884878 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3059/6218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:39:59 2022] GET /compute/v2.1/servers/1c7224f5-f320-4415-a932-891112f7849d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:40:10.839447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=17 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:10.840243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=53 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:10.983042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1132312210", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "af214cc2-bb74-4d8b-bb77-aa68bff59ef2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:11.048541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] validate_networks() for [('af214cc2-bb74-4d8b-bb77-aa68bff59ef2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:40:11.580593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:40:11.581762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:40:11.582602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:40:11.583576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:40:11.584377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:40:11.602109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:11.602902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:11.604428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:11.605204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:11.641792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for project 4d43aeee25e24ad284f79954d341a42b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:40:11.654804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for user 4e405ff5523c44619c108522c07e93e9 and project 4d43aeee25e24ad284f79954d341a42b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:40:11.681494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:40:11.686086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:40:11.748987 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-20a33bfb-7ef1-4888-aed9-3fdbbab97dff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916021 Jul 19 20:40:11.749761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3160/6219] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:40:11.762786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f07d528-40f7-4175-b111-8d7eba51a143 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:11.764040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f07d528-40f7-4175-b111-8d7eba51a143 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:11.767875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:11.768636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:11.852597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f07d528-40f7-4175-b111-8d7eba51a143 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:11.862355 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f07d528-40f7-4175-b111-8d7eba51a143 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1218 microversion: 2.1 time: 0.105258 Jul 19 20:40:11.863504 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3060/6220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:11 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:12.883512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:12.884383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:12.892030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:12.892567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:12.893452 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:12.893986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:12.970798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:12.979971 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b94e77e5-9679-4d4e-8b53-5e69822fdca6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1270 microversion: 2.1 time: 0.101685 Jul 19 20:40:12.980686 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3161/6221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:12 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:14.006806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:14.008146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:14.024040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:14.024988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:14.026876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:14.027868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:14.176984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:14.189130 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf1a57aa-677e-44dc-a4f5-b62aeb4050f0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1276 microversion: 2.1 time: 0.189063 Jul 19 20:40:14.190131 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3061/6222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:13 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:15.224390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:15.228484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:15.248597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:15.249570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:15.252411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:15.253544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:15.672897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:15.691361 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c1507025-a042-4ad6-861d-c51150645687 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.477797 Jul 19 20:40:15.693089 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3162/6223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:15 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:15.974642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-43c55a49-6de6-4ab3-8ed0-9f4e0a66bc05 req-ea21938a-5317-423b-a7e8-185531cfa1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:16.015601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-43c55a49-6de6-4ab3-8ed0-9f4e0a66bc05 req-ea21938a-5317-423b-a7e8-185531cfa1f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:16.016637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-43c55a49-6de6-4ab3-8ed0-9f4e0a66bc05 req-ea21938a-5317-423b-a7e8-185531cfa1f3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:16.047749 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-43c55a49-6de6-4ab3-8ed0-9f4e0a66bc05 req-ea21938a-5317-423b-a7e8-185531cfa1f3 service nova] Creating event network-changed:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h2-843834-3 Jul 19 20:40:16.069332 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-43c55a49-6de6-4ab3-8ed0-9f4e0a66bc05 req-ea21938a-5317-423b-a7e8-185531cfa1f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105561 Jul 19 20:40:16.071123 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3062/6224] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:40:16.714043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:16.715487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:16.728505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:16.729287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:16.730782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:16.731549 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:16.918046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:16.932606 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-85c5b1ce-e607-48d6-9724-ab16e71df28a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.225288 Jul 19 20:40:16.933609 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3163/6225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:16 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:17.960833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:17.961641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:17.968898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:17.969375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:17.970208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:17.970665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:18.133546 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:18.142191 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a2b0ad2-3fe7-4595-a751-beabec356aa6 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.187283 Jul 19 20:40:18.142864 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3063/6226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:17 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:19.160063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:19.160726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:19.168565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:19.169013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:19.169790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:19.170219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:19.336739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:19.350706 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4340265d-0886-4fa6-92c7-2d52a121e844 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.194220 Jul 19 20:40:19.351867 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3164/6227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:19 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:20.371753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:20.372548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:20.380473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:20.380913 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:20.381777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:20.382353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:20.543325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:20.553367 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-efc26b84-e871-40d0-8f51-4bb5d5567ad3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.185815 Jul 19 20:40:20.553999 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3064/6228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:20 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:21.435339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-327b40c5-864b-4972-b0bc-5edd2a11e912 req-9097a9e7-6c57-4bb3-8cb6-de10689b80c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "name": "network-vif-plugged", "status": "completed", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:21.448192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-327b40c5-864b-4972-b0bc-5edd2a11e912 req-9097a9e7-6c57-4bb3-8cb6-de10689b80c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:21.448962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-327b40c5-864b-4972-b0bc-5edd2a11e912 req-9097a9e7-6c57-4bb3-8cb6-de10689b80c3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:21.465484 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-327b40c5-864b-4972-b0bc-5edd2a11e912 req-9097a9e7-6c57-4bb3-8cb6-de10689b80c3 service nova] Creating event network-vif-plugged:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h2-843834-3 Jul 19 20:40:21.471628 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-327b40c5-864b-4972-b0bc-5edd2a11e912 req-9097a9e7-6c57-4bb3-8cb6-de10689b80c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040856 Jul 19 20:40:21.472471 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3165/6229] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:40:21.575050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:21.576158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:21.589746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:21.590603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:21.592368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:21.593700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:21.781259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:21.793401 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae12c3b2-226e-4fd0-b2fe-9736a94bd7a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1318 microversion: 2.1 time: 0.226173 Jul 19 20:40:21.795187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3065/6230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:21 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:22.816270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:22.817772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:22.827544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:22.828814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:22.842179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:22.843289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:22.844915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:22.846100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.067934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:23.079082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2365454-a115-4615-8452-2abdb02c0931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1508 microversion: 2.1 time: 0.264555 Jul 19 20:40:23.080005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3166/6231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:22 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:23.103578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:23.104183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:23.106372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:23.113691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.114183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.114975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.115450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.274817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:23.283612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16c2e163-4294-473e-bd92-96bcb3e1e13a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1508 microversion: 2.1 time: 0.184051 Jul 19 20:40:23.284195 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3066/6232] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:23 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:23.304520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:23.306736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:23.317253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.318092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.319447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.320245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.398016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f7227d5-a68b-4975-ad49-b55dffceb91b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "PUT /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1080 microversion: 2.1 time: 0.101079 Jul 19 20:40:23.398698 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3167/6233] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Jul 19 20:40:23 2022] PUT /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1080 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:23.413710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:23.414381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:23.422478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.422960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.423864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.424395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.582550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:23.592385 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f4fd813d-97d3-4a19-9b46-1a1b99f0530a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1506 microversion: 2.1 time: 0.182902 Jul 19 20:40:23.593018 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3067/6234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:23 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:23.609235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:23.609885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:23.616750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.617234 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.618047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.618474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.786816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:23.795450 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-241c7d0f-da9a-414c-b459-9c8b61c704e2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1506 microversion: 2.1 time: 0.190144 Jul 19 20:40:23.796052 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3168/6235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:23 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:23.816550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:23.818336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:23.829779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.830512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.832237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:23.833040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:23.888213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:23.900013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Old instance type m1.heat2, new instance type m1.heat {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:40:23.913321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:40:23.914122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:40:23.915045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:40:23.915837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:40:23.916587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:40:24.023336 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af37a4c3-3588-4e70-8030-6808a61e1a22 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985/action" status: 202 len: 0 microversion: 2.1 time: 0.213933 Jul 19 20:40:24.024325 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3068/6236] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:40:23 2022] POST /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:40:24.035856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:24.036847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:24.044215 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:24.045180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:24.046249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:24.046423 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:24.318277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:24.333443 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f9ed891-6e6a-47c8-a900-7fc31da87784 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1517 microversion: 2.1 time: 0.303021 Jul 19 20:40:24.334549 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3169/6237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:24 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:25.363729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:25.364634 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:25.371572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:25.372693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:25.374390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:25.375270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:25.585715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:25.600484 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ba1a69e2-4c41-49b9-8ba9-e92aff09834e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1517 microversion: 2.1 time: 0.243878 Jul 19 20:40:25.601582 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3069/6238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:25 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:26.620191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:26.621016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:26.628701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:26.629128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:26.629920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:26.630355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:26.786714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:26.795028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-db834eb1-798f-4e4b-b796-4a3a9349dca9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.179872 Jul 19 20:40:26.795636 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3170/6239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:26 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:27.813579 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:27.814360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:27.822662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:27.823180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:27.823992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:27.824451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:27.988373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:27.997171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92166152-33f8-442a-9cde-19d94821b5d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.187549 Jul 19 20:40:27.997818 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3070/6240] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:27 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:29.015762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:29.016484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:29.027159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:29.027937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:29.029320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:29.029886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:29.190217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:29.199129 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bf72888-47a7-4835-b132-4d153c692670 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.188387 Jul 19 20:40:29.199782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3171/6241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:29 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:30.217014 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:30.217680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:30.225865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:30.226445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:30.227541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:30.228137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:30.386159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:30.395388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1da2512c-229a-489b-b72d-8c8de5d73522 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.182233 Jul 19 20:40:30.396131 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3071/6242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:30 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:31.413761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:31.414510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:31.423324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:31.423874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:31.424756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:31.425264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:31.581391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:31.589978 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53537576-1d9b-4870-8874-666ae862b401 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.180533 Jul 19 20:40:31.590608 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3172/6243] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:31 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:32.612472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:32.613594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:32.625939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:32.626761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:32.628206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:32.629004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:32.778669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:32.787154 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3273ca73-810c-4a2a-a579-fca90287e754 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.182615 Jul 19 20:40:32.787734 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3072/6244] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:32 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:33.805077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:33.805657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:33.813938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:33.814513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:33.815432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:33.815949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:33.977727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:33.985224 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6420a7a0-e3ca-4957-954c-4ffe2db70e9b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.184237 Jul 19 20:40:33.986398 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3173/6245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:33 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:35.004385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:35.005575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:35.016078 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:35.016596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:35.017456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:35.017951 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:35.192098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:35.201630 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7039c17-d3f9-4453-803d-07d329e69ed7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.201992 Jul 19 20:40:35.202238 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3073/6246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:34 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:36.220125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:36.221032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:36.229310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:36.229766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:36.230576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:36.231064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:36.432195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:36.442029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-483177ce-b794-4673-bc26-63706688f1fd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.225769 Jul 19 20:40:36.442959 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3174/6247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:36 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:37.464146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:37.465121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:37.476656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:37.477457 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:37.478847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:37.479668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:37.631509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:37.640238 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cad8cc62-ff62-4fd5-8aeb-a4b72990079e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.182903 Jul 19 20:40:37.640859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3074/6248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:37 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:38.658867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:38.660207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:38.668587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:38.669048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:38.669898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:38.670349 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:39.116714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:39.125317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ce3ce8f4-859d-491b-9c37-a012eac1489a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.470989 Jul 19 20:40:39.125929 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3175/6249] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:38 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:40.148584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:40.149209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:40.157029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:40.157469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:40.158297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:40.158742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:40.310535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:40.319399 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e96d7351-37ab-43e9-a3af-9f3293561ce1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.174784 Jul 19 20:40:40.320012 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3075/6250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:40 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:41.339983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:41.340848 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:41.345036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:41.355804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:41.356572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:41.357937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:41.358737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:41.368367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:41.541863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:41.550335 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ba2c6fd3-1677-4729-aecb-968f08cbc792 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.216305 Jul 19 20:40:41.551006 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3176/6251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:41 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:42.569756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:42.570786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:42.574276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=39 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:42.580451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:42.580921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:42.581745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:42.582201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:42.585684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:42.738901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:42.747921 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de458806-1d65-435b-82fc-d8130846b00f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.182827 Jul 19 20:40:42.748526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3076/6252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:42 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:43.766089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:43.766705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:43.777764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:43.778563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:43.780212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:43.781196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:43.961675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:43.970482 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-16b4edaa-f757-4740-bec8-8e02d426b65b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.208754 Jul 19 20:40:43.971108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3177/6253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:43 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:44.993397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:44.994603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:45.007350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:45.008164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:45.009535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:45.010315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:45.201828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:45.211727 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-238209dd-0b0e-4354-b98b-d07e2ebf783a tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.226297 Jul 19 20:40:45.212470 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3077/6254] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:44 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:46.237522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:46.238660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:46.247321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:46.248106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:46.249133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:46.249632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:46.397692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:46.406720 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-373cf5b5-69ab-4e31-8aba-a634cb954a25 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.176152 Jul 19 20:40:46.407366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3178/6255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:46 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:47.425103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:47.425824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:47.434648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:47.435200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:47.436036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:47.436473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:47.613027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:47.621999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f7338dd-7259-48fb-991e-45a22ecf5906 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.200942 Jul 19 20:40:47.622638 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3078/6256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:47 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:48.644117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:48.645274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:48.658130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:48.658947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:48.660410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:48.661216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:48.822521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:48.831857 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b9304071-3aa1-4abf-bfe9-034c1aeee8b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.194835 Jul 19 20:40:48.832496 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3179/6257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:48 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:49.218060 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:40:49.218712 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:40:49.850790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:49.851436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:49.859082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:49.859699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:49.860666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:49.861259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:50.010123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:50.019275 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7db1e21e-2853-4b0b-8124-8b5706572049 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.172786 Jul 19 20:40:50.020184 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3079/6258] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:49 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:51.038844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:51.039810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:51.048974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:51.049435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:51.050244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:51.050692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:51.210747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:51.219192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98700995-03d2-4212-ab99-79afc9a5f96e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.184731 Jul 19 20:40:51.219754 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3180/6259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:51 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:52.239178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:52.240168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:52.251146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:52.251542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:52.252571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:52.253261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:52.477104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:52.486201 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d1dfab7-da56-48dd-b6e1-cf0b934143ab tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.253218 Jul 19 20:40:52.486884 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3080/6260] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:52 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:53.507992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:53.508784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:53.518440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:53.519425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:53.521636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:53.522325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:53.685672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:53.694996 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4380b62-49c9-471c-a84f-f38061696101 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1522 microversion: 2.1 time: 0.193896 Jul 19 20:40:53.695643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3181/6261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:53 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:54.552752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "name": "network-vif-unplugged", "status": "completed", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:54.563290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:54.563769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:54.584052 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] Creating event network-vif-unplugged:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h1-843834-3 Jul 19 20:40:54.590965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:40:54.607226 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-281e7f4d-3f15-47c1-b5b0-ac1ffe6e8c24 req-2be8318f-acfe-4f0e-84ed-6e41c775526a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058180 Jul 19 20:40:54.608105 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3081/6262] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:40:54.713442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:54.714334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:54.722367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:54.722899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:54.724526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:54.725217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:55.002995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:55.012833 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a349feef-3cd7-41dc-a8a9-38576ac01a21 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1521 microversion: 2.1 time: 0.303704 Jul 19 20:40:55.014059 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3182/6263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:54 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:56.041233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:56.042233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:56.053644 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:56.054771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:56.056189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:56.056992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:56.242721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:56.251329 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ca59b4e5-95fa-4c70-94e3-66e5701ec30d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1519 microversion: 2.1 time: 0.216048 Jul 19 20:40:56.251939 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3082/6264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:56 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:56.639315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:56.655244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:56.655933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:56.680109 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] Creating event network-changed:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h1-843834-3 Jul 19 20:40:56.690421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:40:56.711341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-535174f8-2e46-4403-b88b-b2673a3af7a5 req-ee826a6b-41bd-481b-8236-24abc12ec85b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078258 Jul 19 20:40:56.712249 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3183/6265] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:40:57.281193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:57.282159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:57.292837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:57.293492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:57.294521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:57.295356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:57.687100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:57.713345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-33f791e2-58b5-4a74-a502-d7141520035b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1519 microversion: 2.1 time: 0.437414 Jul 19 20:40:57.713972 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3083/6266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:57 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1519 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:40:58.731947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:58.732800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:58.740765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:58.741229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:58.742022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:58.742486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:58.929155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:58.937807 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b469489b-c4f9-4f88-97b6-4dcf78033184 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1516 microversion: 2.1 time: 0.210398 Jul 19 20:40:58.938421 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3184/6267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:58 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:40:58.955938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:40:58.956780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:58.965636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:58.966180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:58.967182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:58.967749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:59.041320 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d34b1d9-3e46-405e-82f4-2fc7eba35dfe tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985/action" status: 204 len: 0 microversion: 2.1 time: 0.089458 Jul 19 20:40:59.042053 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3084/6268] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:40:58 2022] POST /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:40:59.056646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:40:59.057895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:40:59.069352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:59.070389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:59.072051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:40:59.072616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:40:59.264442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:40:59.279491 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-593a3e1a-77d8-4ea3-b71c-404567855e3e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1516 microversion: 2.1 time: 0.231251 Jul 19 20:40:59.280545 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3185/6269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:40:59 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:00.271510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1b50d307-de97-4dce-94cc-7afb614890f1 req-7d80eb4b-40b3-4a9c-9527-f8eb10d2f145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "name": "network-vif-plugged", "status": "completed", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:00.307522 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b50d307-de97-4dce-94cc-7afb614890f1 req-7d80eb4b-40b3-4a9c-9527-f8eb10d2f145 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:00.309044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b50d307-de97-4dce-94cc-7afb614890f1 req-7d80eb4b-40b3-4a9c-9527-f8eb10d2f145 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:00.309217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:00.309999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:00.322603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:00.323523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:00.326521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:00.327407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:00.348019 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1b50d307-de97-4dce-94cc-7afb614890f1 req-7d80eb4b-40b3-4a9c-9527-f8eb10d2f145 service nova] Creating event network-vif-plugged:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h1-843834-3 Jul 19 20:41:00.358330 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1b50d307-de97-4dce-94cc-7afb614890f1 req-7d80eb4b-40b3-4a9c-9527-f8eb10d2f145 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098259 Jul 19 20:41:00.360931 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3085/6270] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:00.510220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:00.523717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d79a6fff-8bdb-4ce5-8834-453395bfe6e9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1516 microversion: 2.1 time: 0.222003 Jul 19 20:41:00.526411 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3186/6271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:00 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:01.554704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:01.555697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:01.564038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:01.564612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:01.565687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:01.566205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:01.722731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:01.731268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fadacbf9-435f-419a-a045-449f524cef59 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1508 microversion: 2.1 time: 0.181044 Jul 19 20:41:01.731904 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3086/6272] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:01 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:01.748492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:01.749220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:01.756965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:01.757415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:01.758217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:01.758652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:01.936640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:01.945837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ac8fd81-116a-4f64-a226-bad219cf1b46 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1508 microversion: 2.1 time: 0.201370 Jul 19 20:41:01.946885 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3187/6273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:01 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:01.966988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7a96e0d-4675-46be-9a36-aab8148f6b9f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'create', calling method: .version_select at 0x7f23ef406dc0>, body: {"keypair": {"name": "tempest-keypair-981641309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpQFi7WH8ZT9T8yN02jLrukrLG1ZAN5EPRomgYo6152qgjaE69KNHz+qNV7/dtEzneKNJC+t2nhev64seds0qtYz77/IAyc1Jcu92F7fML3wJSQ7bGFp7JEI1fjoN6iVA=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:01.984155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e7a96e0d-4675-46be-9a36-aab8148f6b9f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for project 4d43aeee25e24ad284f79954d341a42b. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:41:01.991639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e7a96e0d-4675-46be-9a36-aab8148f6b9f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for user 4e405ff5523c44619c108522c07e93e9 and project 4d43aeee25e24ad284f79954d341a42b. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:41:02.029564 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7a96e0d-4675-46be-9a36-aab8148f6b9f tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066656 Jul 19 20:41:02.030249 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3087/6274] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:41:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:04.049267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:04.049895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:04.057558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:04.058024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:04.058829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:04.059313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:04.209238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:04.217970 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9a6c3e1-0607-4713-a6d4-16a19be4d5db tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 200 len: 1508 microversion: 2.1 time: 0.172693 Jul 19 20:41:04.218820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3188/6275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:04 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:04.237226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:04.238103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:04.246126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:04.246696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:04.247717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:04.248140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:04.286203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:41:04.422712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d94c3d9-76c4-4fae-beaf-fc5713f5fcdd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 204 len: 0 microversion: 2.1 time: 0.190438 Jul 19 20:41:04.423467 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3088/6276] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:41:04 2022] DELETE /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:41:04.496583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-689940552", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "af214cc2-bb74-4d8b-bb77-aa68bff59ef2"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:04.564227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] validate_networks() for [('af214cc2-bb74-4d8b-bb77-aa68bff59ef2', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:41:05.456821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:41:05.457547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:41:05.457954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:41:05.458504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:41:05.459044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:41:05.475970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:05.476779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:05.478279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:05.479121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:05.513079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for project 4d43aeee25e24ad284f79954d341a42b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:41:05.524799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Getting quotas for user 4e405ff5523c44619c108522c07e93e9 and project 4d43aeee25e24ad284f79954d341a42b. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:41:05.547337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:41:05.549865 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:41:05.603192 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-318bae69-e99c-4543-b065-2e4a0cc7ab47 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110500 Jul 19 20:41:05.604133 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3189/6277] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:41:05.615829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a45fc42-e98e-43d5-be3a-cf3ba7135e78 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:05.616977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a45fc42-e98e-43d5-be3a-cf3ba7135e78 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:05.695170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a45fc42-e98e-43d5-be3a-cf3ba7135e78 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:05.706007 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a45fc42-e98e-43d5-be3a-cf3ba7135e78 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1217 microversion: 2.1 time: 0.094919 Jul 19 20:41:05.706807 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3089/6278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:05 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:06.727479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:06.728325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:06.737034 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:06.737759 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:06.738998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:06.739531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:06.848140 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:06.863258 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ce42fc9-c21e-4425-8aaa-c97dd60b1bc1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1269 microversion: 2.1 time: 0.141509 Jul 19 20:41:06.864236 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3190/6279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:06 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:07.293919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-beafc28b-1771-4a2f-a7ae-c3d8c37128ba req-7eb81333-2757-4904-beff-f1fc48e91c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985", "name": "network-vif-deleted", "tag": "c60603b4-caee-4303-8b9e-abdbdb7f12ec"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:07.311525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-beafc28b-1771-4a2f-a7ae-c3d8c37128ba req-7eb81333-2757-4904-beff-f1fc48e91c20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:07.312157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-beafc28b-1771-4a2f-a7ae-c3d8c37128ba req-7eb81333-2757-4904-beff-f1fc48e91c20 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:07.328703 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-beafc28b-1771-4a2f-a7ae-c3d8c37128ba req-7eb81333-2757-4904-beff-f1fc48e91c20 service nova] Creating event network-vif-deleted:c60603b4-caee-4303-8b9e-abdbdb7f12ec for instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 on n-h1-843834-3 Jul 19 20:41:07.337264 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-beafc28b-1771-4a2f-a7ae-c3d8c37128ba req-7eb81333-2757-4904-beff-f1fc48e91c20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050223 Jul 19 20:41:07.338750 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3090/6280] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:07.881151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:07.881847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:07.889599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:07.890063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:07.890867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:07.891428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:08.130110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:08.143913 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d768f1d1-7ecc-4dbd-a30f-a11aa90d36a9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.267216 Jul 19 20:41:08.144677 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3191/6281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:07 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:09.167205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:09.168578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:09.182034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:09.182846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:09.184418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:09.185209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:09.368887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d96b2840-ac52-4d15-9b86-f6a386fc5e81 req-28095aab-ff2c-493f-bfd3-46c78ff639cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:09.380795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d96b2840-ac52-4d15-9b86-f6a386fc5e81 req-28095aab-ff2c-493f-bfd3-46c78ff639cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:09.381490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d96b2840-ac52-4d15-9b86-f6a386fc5e81 req-28095aab-ff2c-493f-bfd3-46c78ff639cb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:09.396882 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d96b2840-ac52-4d15-9b86-f6a386fc5e81 req-28095aab-ff2c-493f-bfd3-46c78ff639cb service nova] Creating event network-changed:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h1-843834-3 Jul 19 20:41:09.404219 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d96b2840-ac52-4d15-9b86-f6a386fc5e81 req-28095aab-ff2c-493f-bfd3-46c78ff639cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040737 Jul 19 20:41:09.405562 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3192/6282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:09.460624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:09.473481 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-495d5896-6a5a-4344-85c8-d3ac1039d8c0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.314151 Jul 19 20:41:09.474368 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3091/6283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:09 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:10.494243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:10.495377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:10.503952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:10.504407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:10.505217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:10.505661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:10.766862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:10.775484 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8a80e13-e93b-4aed-b225-c11514590c70 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.288834 Jul 19 20:41:10.776145 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3193/6284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:10 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:11.794698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:11.795372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:11.805289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:11.805758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:11.806553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:11.807041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:11.965165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:11.974388 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-615f1005-9f6a-4571-a148-a3eeb8c0495d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.183639 Jul 19 20:41:11.975028 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3092/6285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:11 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:12.997494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:12.998610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:13.003539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:13.013922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:13.014552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:13.015546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:13.016201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:13.025914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:13.220162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:13.229742 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0dd9fdb3-5ef5-422a-942e-4c137030d544 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.239734 Jul 19 20:41:13.230526 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3194/6286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:12 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:14.252746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:14.253880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:14.259183 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:14.269225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:14.270018 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:14.271506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:14.272387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:14.282098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:14.294991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-05302241-686b-496f-8686-6f1e6893d633 req-fce5f2a7-91e3-46a2-9fb8-fadfd01e1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "name": "network-vif-plugged", "status": "completed", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:14.304868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-05302241-686b-496f-8686-6f1e6893d633 req-fce5f2a7-91e3-46a2-9fb8-fadfd01e1d39 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:14.305316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-05302241-686b-496f-8686-6f1e6893d633 req-fce5f2a7-91e3-46a2-9fb8-fadfd01e1d39 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:14.320137 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-05302241-686b-496f-8686-6f1e6893d633 req-fce5f2a7-91e3-46a2-9fb8-fadfd01e1d39 service nova] Creating event network-vif-plugged:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h1-843834-3 Jul 19 20:41:14.326944 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-05302241-686b-496f-8686-6f1e6893d633 req-fce5f2a7-91e3-46a2-9fb8-fadfd01e1d39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035430 Jul 19 20:41:14.327714 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3195/6287] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:41:14.588154 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:14.597430 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3407b7cf-b078-4cfe-a699-ae6c4feb18fb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.352131 Jul 19 20:41:14.598149 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3093/6288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:14 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:15.616616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:15.617806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:15.623102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:15.623914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:15.631946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:15.632394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:15.633205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:15.633641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:15.818453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:15.831762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dc2e3444-c764-410b-83f9-825c63b22fff tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1317 microversion: 2.1 time: 0.217144 Jul 19 20:41:15.832893 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3196/6289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:15 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:16.850532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:16.851264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:16.854146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:16.861662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:16.862212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:16.863205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:16.863748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.025133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:17.034818 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e88f10b4-6bff-49a3-b18b-26ae2fb57931 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1506 microversion: 2.1 time: 0.188462 Jul 19 20:41:17.035550 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3094/6290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:16 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:17.052902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:17.053520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:17.061112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.061568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.062374 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.062807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.217273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:17.225989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-25008289-98c4-42a1-9c08-b26b6dff21bb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1506 microversion: 2.1 time: 0.177267 Jul 19 20:41:17.226601 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3197/6291] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:17 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:17.243498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:17.244965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:17.252569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.253101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.253959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.254477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.287327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:17.294945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Old instance type m1.heat2, new instance type m1.heat {{(pid=131230) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:41:17.303484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:41:17.303969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:41:17.304497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:41:17.304959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:41:17.305428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:41:17.378741 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b35a2d1-20aa-400a-99df-21e859c3f905 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d/action" status: 202 len: 0 microversion: 2.1 time: 0.139465 Jul 19 20:41:17.379471 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3095/6292] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:41:17 2022] POST /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:41:17.389645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:17.390509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:17.398138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.398598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.399449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:17.399896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:17.604196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:17.613807 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-22233924-17ed-402f-8d53-5a0ab6f5e472 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1513 microversion: 2.1 time: 0.229339 Jul 19 20:41:17.614423 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3198/6293] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:17 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:18.637080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:18.638168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:18.649599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:18.650611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:18.652056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:18.652844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:18.858845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:18.868181 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-222408f0-08a4-47d4-91fe-3fef52259dbd tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1513 microversion: 2.1 time: 0.240572 Jul 19 20:41:18.868854 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3096/6294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:18 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:19.886320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:19.887124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:19.895100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:19.895566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:19.896380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:19.896832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:20.054691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:20.063732 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-789c4c20-84d6-4947-ad0d-edd7f1c20d61 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.181135 Jul 19 20:41:20.064504 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3199/6295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:19 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:21.082241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:21.082999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:21.090668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:21.091255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:21.092091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:21.092572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:21.258707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:21.268014 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3cd87010-5e52-4231-ad2d-9769fe308849 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.189957 Jul 19 20:41:21.268705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3097/6296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:21 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:22.285402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:22.286021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:22.294448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:22.294953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:22.295836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:22.296323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:22.448698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:22.457185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6cf1f96a-90b7-4d78-b5e0-58dd6af150d8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.175679 Jul 19 20:41:22.457792 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3200/6297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:22 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:23.474986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:23.475916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:23.484882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:23.485480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:23.486440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:23.487031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:23.649689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:23.658240 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c35f876-d922-4b5a-a935-ffd945e647d0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.187989 Jul 19 20:41:23.659039 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3098/6298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:23 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:24.679025 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:24.680029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:24.687951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:24.688415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:24.689291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:24.689810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:24.878042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:24.887048 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14c89766-8f4f-4834-888c-9e56ccbf7fc0 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.212282 Jul 19 20:41:24.887679 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3201/6299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:24 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:25.905087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:25.905754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:25.915003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:25.915857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:25.917295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:25.918162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:26.081371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:26.090484 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b37d44ff-ed15-47ba-b7ae-0278d3d9315d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.189422 Jul 19 20:41:26.091300 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3099/6300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:25 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:27.108416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:27.109182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:27.117290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:27.117751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:27.118569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:27.119048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:27.277869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:27.291427 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd9b945f-5c29-4e89-83e3-648db1f4acb7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.186730 Jul 19 20:41:27.292493 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3202/6301] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:27 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:28.310180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:28.310841 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:28.320519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:28.322028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:28.322991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:28.323568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:28.508414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:28.516785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac0979b9-a281-4b88-843e-795ee53dfb37 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.210672 Jul 19 20:41:28.517370 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3100/6302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:28 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:29.535725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:29.536959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:29.549498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:29.550285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:29.551714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:29.552512 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:29.716557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:29.724711 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e74128ba-2362-4e0d-b610-782b87e6b9eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.194762 Jul 19 20:41:29.725328 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3203/6303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:29 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:30.742440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:30.743123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:30.751635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:30.752120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:30.752949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:30.753409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:30.907928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:30.917134 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-13e0d2d8-4a9d-41d6-9e03-ec086380a339 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.178855 Jul 19 20:41:30.917744 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3101/6304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:30 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:31.935028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:31.935711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:31.944592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:31.947459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:31.947459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:31.947459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:32.105628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:32.114431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a1b3a88-38e1-4dfc-ab0a-c24d0d31ea13 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.183662 Jul 19 20:41:32.115327 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3204/6305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:31 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:33.135964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:33.136701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:33.144814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:33.145286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:33.146128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:33.146643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:33.306863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:33.321694 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dbe23d1a-68d7-4af5-a533-35967d63b026 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.189069 Jul 19 20:41:33.322746 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3102/6306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:33 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:34.342366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:34.343122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:34.351897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:34.352383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:34.353178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:34.353615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:34.506678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:34.515580 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-80a921a9-aef0-4635-b574-51d6dc5e43c5 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.176973 Jul 19 20:41:34.516334 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3205/6307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:34 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:35.534363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:35.535171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:35.542943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:35.543440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:35.544237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:35.544708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:35.697671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:35.707973 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a457bcf-8eaa-4508-91a5-68caf303fd1e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.177746 Jul 19 20:41:35.710236 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3103/6308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:35 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:36.729220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:36.729891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:36.738436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.739039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.740233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:36.740870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:36.910882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:36.921141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fb36e216-fc0a-4eb1-8bdb-84c94f38608e tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.196603 Jul 19 20:41:36.921770 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3206/6309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:36 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:37.939660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:37.940372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:37.948953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:37.949427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:37.950247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:37.950704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:38.110765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:38.125604 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8ae68a96-0082-4a15-86a5-1e1a4060911c tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.189668 Jul 19 20:41:38.126862 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3104/6310] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:37 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:39.153868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:39.154495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:39.163628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:39.164183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:39.165060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:39.165683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:39.339669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:39.348428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-173a3500-b9c0-4c9a-a00a-dba1d8e1f619 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.198645 Jul 19 20:41:39.349148 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3207/6311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:39 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:40.368698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:40.369430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:40.378296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:40.378702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:40.379572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:40.380020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:40.533519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:40.546238 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc98c0ab-d5c7-4102-a278-7e0270fa9082 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.181468 Jul 19 20:41:40.547492 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3105/6312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:40 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:41.565457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:41.566085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:41.574496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:41.574984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:41.575793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:41.576230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:41.730681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:41.738989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4951b11c-47f7-4332-a9d4-d4d536fbcb31 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.177714 Jul 19 20:41:41.739719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3208/6313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:41 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:42.757076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:42.757688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:42.765544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:42.766013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:42.766847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:42.767339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:42.917360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:42.926031 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e8dbd47b-1a1a-4f53-966f-5fc3b7998cd9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.172993 Jul 19 20:41:42.926654 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3106/6314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:42 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:43.943668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:43.944692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:43.948557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=30 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:43.955269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:43.955818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:43.956667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:43.957166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:43.960815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=86 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:44.143208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:44.152344 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8b881796-9ba0-4e7b-8402-862f5047f49b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.212801 Jul 19 20:41:44.153016 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3209/6315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:43 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:45.178354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:45.179117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:45.182080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=32 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:45.188502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:45.188990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:45.189849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:45.190313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:45.194724 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:45.352904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:45.367277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d979b54f-8e0e-4276-ba96-8ee96f3d8dd8 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.192559 Jul 19 20:41:45.368377 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3107/6316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:45 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:46.389618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:46.390278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:46.398301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:46.398753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:46.399920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:46.400373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:46.558213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:46.568151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-10857f8c-a270-495a-8180-714bdcf27e04 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.182522 Jul 19 20:41:46.568782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3210/6317] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:46 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:47.586826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:47.587768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:47.595606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:47.596069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:47.600102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:47.600102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:47.741384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:47.749725 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-694e46ad-3ca9-4f5c-ba86-017cfe5b02eb tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.166854 Jul 19 20:41:47.750333 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3108/6318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:47 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:48.768351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:48.769072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:48.777586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:48.778051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:48.778882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:48.779369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:48.944648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:48.954089 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7a4aeeb-af58-4094-8833-a302f6f44af3 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.190534 Jul 19 20:41:48.954797 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3211/6319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:48 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:49.973325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:49.974120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:49.982475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:49.983034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:49.984025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:49.984570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:50.143769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:50.154359 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-21fe747a-e4fa-4b6b-81c7-089b81b3dec9 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.185723 Jul 19 20:41:50.155055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3109/6320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:49 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:51.172687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:51.173516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:51.181031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:51.181489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:51.182287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:51.182728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:51.349986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:51.360368 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8c160ca-a2ce-4a4b-8308-e4a208eac4b2 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1518 microversion: 2.1 time: 0.191578 Jul 19 20:41:51.360977 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3212/6321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:51 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:52.382846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:52.383899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:52.396236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:52.396811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:52.398124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:52.398870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:52.578759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:52.604802 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-297facf3-3c3c-422f-8f4d-d82cf4341066 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1517 microversion: 2.1 time: 0.229050 Jul 19 20:41:52.606101 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3110/6322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:52 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:52.606330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "name": "network-vif-unplugged", "status": "completed", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:52.625806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:52.626607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:52.650614 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] Creating event network-vif-unplugged:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h2-843834-3 Jul 19 20:41:52.663197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:41:52.688327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-e1307d18-2b80-4b06-b6d9-ae0eed7d9f3a req-c027532d-dc02-4ba8-bafe-512312538a97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092365 Jul 19 20:41:52.689459 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3213/6323] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:53.623943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:53.624787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:53.632701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:53.633175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:53.633993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:53.634458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:53.827629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:53.837408 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-37e1243c-84cb-439e-8a56-bf642f09dc96 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1517 microversion: 2.1 time: 0.217410 Jul 19 20:41:53.838137 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3111/6324] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:53 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:54.711201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:54.720664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:54.721117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:54.738141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] Creating event network-changed:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h2-843834-3 Jul 19 20:41:54.746536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:41:54.758537 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-eedbf2cf-8bba-48fb-97f0-2e8d7b43cb85 req-3b2e129a-59e9-4887-b07d-5c46e2af72ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053246 Jul 19 20:41:54.759221 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3214/6325] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:54.864924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:54.865798 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:54.874748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:54.875445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:54.876550 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:54.877016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:55.543931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:55.562457 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad892345-0c30-4216-b0df-c5ee9432e1ac tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1515 microversion: 2.1 time: 0.701703 Jul 19 20:41:55.564399 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3112/6326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:54 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1515 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:56.582680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:56.583402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:56.591292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.591748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.592566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.593130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.766269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:56.774781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b488d55-3fba-46ca-83c7-ffa1e37bc80b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1512 microversion: 2.1 time: 0.196436 Jul 19 20:41:56.775466 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3215/6327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:56 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:56.801496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:56.802349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:56.813946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.814633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.816144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.816949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.891597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a8b0218-1e94-4473-af6c-34959de9cac4 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "POST /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d/action" status: 204 len: 0 microversion: 2.1 time: 0.094647 Jul 19 20:41:56.892259 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3113/6328] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:41:56 2022] POST /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d/action => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:41:56.902269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:56.903288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:56.910551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.911050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:56.911885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:56.912294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:57.166301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:57.180630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa22a897-9c5d-4e7d-bb31-d6da635be27d tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1512 microversion: 2.1 time: 0.283068 Jul 19 20:41:57.181321 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3216/6329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:56 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:57.933181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "name": "network-vif-plugged", "status": "completed", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:57.950233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:57.950793 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:57.965407 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] Creating event network-vif-plugged:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h2-843834-3 Jul 19 20:41:57.972344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:41:57.985856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-dcbfa350-35d5-4cfe-90be-01f5fb8d3b08 req-e465ab1c-3d80-4e16-b47e-cfcae40905b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057050 Jul 19 20:41:57.986170 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3114/6330] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:58.200855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:58.201752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:58.210283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:58.210955 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:58.212180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:58.212864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:58.387119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:58.400461 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bb35f6f9-112b-40ad-9051-46b12e146a74 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1512 microversion: 2.1 time: 0.204187 Jul 19 20:41:58.401465 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3217/6331] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:58 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:59.423085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:59.424333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:59.432861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.433326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.434143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.434698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.600747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:59.611345 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e870486f-72cb-4955-b5ad-022de95056da tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1504 microversion: 2.1 time: 0.194988 Jul 19 20:41:59.612419 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3115/6332] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:59 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:59.630445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:59.631109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:59.639271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.639636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.640464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.640892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.831974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:41:59.841237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c81bd35-5f61-4d1b-b109-a5f542f06dcc tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1504 microversion: 2.1 time: 0.215692 Jul 19 20:41:59.841892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3218/6333] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:59 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:59.863909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:59.865133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:41:59.874797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.875397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:41:59.876270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:41:59.876784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.051185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:00.066511 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b149ee3-f4cd-4a00-b9c2-cd2a9134cf03 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1504 microversion: 2.1 time: 0.209610 Jul 19 20:42:00.067661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3116/6334] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:41:59 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:00.084720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:00.085267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:00.092341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.092812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.093623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.094072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.123513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:42:00.227183 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c8ebf57b-700d-47af-bc6a-f0041a3ca3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 204 len: 0 microversion: 2.1 time: 0.145954 Jul 19 20:42:00.228178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3219/6335] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:42:00 2022] DELETE /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:42:00.251789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:00.252554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:00.260081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.260601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.261493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.261987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.293982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:42:00.348895 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.compute.api [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Instance is already in deleting state, ignoring this request Jul 19 20:42:00.349767 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d8d726aa-24f7-4f1f-8913-2b41e801014b tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 204 len: 0 microversion: 2.1 time: 0.104095 Jul 19 20:42:00.350364 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3117/6336] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:42:00 2022] DELETE /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:42:00.364040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:00.365297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:00.376511 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.378649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.378888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:00.379593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:00.537348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:00.550319 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51645008-6e6b-4f90-972c-1d28cf596cbf tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1510 microversion: 2.1 time: 0.194136 Jul 19 20:42:00.551339 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3220/6337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:00 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:01.572319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:01.573427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:01.584591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:01.585416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:01.586846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:01.587687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:01.778136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e405ff5523c44619c108522c07e93e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d43aeee25e24ad284f79954d341a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:01.787840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56205a7c-3c18-43b7-a239-40971f880ed1 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 200 len: 1510 microversion: 2.1 time: 0.222903 Jul 19 20:42:01.788606 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3118/6338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:01 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:02.207967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-80eeb6c0-c4f7-480f-bea1-8c29c3c762d5 req-59846463-76f9-41d7-84aa-786c803afef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeef6ed-9ac1-4c64-933c-cc5a460ae25d", "name": "network-vif-deleted", "tag": "59a301d0-016a-4754-914d-cc4c6a5767ad"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:02.223949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-80eeb6c0-c4f7-480f-bea1-8c29c3c762d5 req-59846463-76f9-41d7-84aa-786c803afef8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:02.224725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-80eeb6c0-c4f7-480f-bea1-8c29c3c762d5 req-59846463-76f9-41d7-84aa-786c803afef8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:02.242362 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-80eeb6c0-c4f7-480f-bea1-8c29c3c762d5 req-59846463-76f9-41d7-84aa-786c803afef8 service nova] Creating event network-vif-deleted:59a301d0-016a-4754-914d-cc4c6a5767ad for instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d on n-h2-843834-3 Jul 19 20:42:02.250523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-80eeb6c0-c4f7-480f-bea1-8c29c3c762d5 req-59846463-76f9-41d7-84aa-786c803afef8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048208 Jul 19 20:42:02.251689 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3221/6339] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:42:02.814273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:02.814903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: cbeef6ed-9ac1-4c64-933c-cc5a460ae25d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:02.823089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:02.823558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:02.824368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:02.824820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:02.840547 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] HTTP exception thrown: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Request method failure captured: Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d HTTP/1.1 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xaqAaZ8eUiLa_SMUt6LxVgMbrGyJisSTY0-G06nZcZV9f_gd_xAG3OmakMnljpeD_mO6Wn4VEA9HPI2qknefEM0dIqvI8gkevLK__9CCpQhHCnoWRJ2KRS3SRuWn5QvxbeOcIODajSa2VGPYn5bAmg77276hppUa0eNLR08RloTfwU Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4e405ff5523c44619c108522c07e93e9 Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'cbeef6ed-9ac1-4c64-933c-cc5a460ae25d'} Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:02.842475 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Returning 404 to user: Instance cbeef6ed-9ac1-4c64-933c-cc5a460ae25d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de0861a6-9ac1-45fc-bb8a-1b3f923ba3c7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d" status: 404 len: 111 microversion: 2.1 time: 0.034182 Jul 19 20:42:02.849645 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3119/6340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:02 2022] GET /compute/v2.1/servers/cbeef6ed-9ac1-4c64-933c-cc5a460ae25d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:42:02.856375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-100e59d4-5ed3-4338-8cbf-fe1089088772 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '.version_select at 0x7f23ee1e33a0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:02.884124 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-100e59d4-5ed3-4338-8cbf-fe1089088772 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981641309" status: 202 len: 0 microversion: 2.1 time: 0.032111 Jul 19 20:42:02.884761 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3222/6341] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981641309 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:42:03.646128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:03.646652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:03.653936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.654403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.655246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.655853 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.672651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] HTTP exception thrown: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Request method failure captured: Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 HTTP/1.1 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xaqAaZ8eUiLa_SMUt6LxVgMbrGyJisSTY0-G06nZcZV9f_gd_xAG3OmakMnljpeD_mO6Wn4VEA9HPI2qknefEM0dIqvI8gkevLK__9CCpQhHCnoWRJ2KRS3SRuWn5QvxbeOcIODajSa2VGPYn5bAmg77276hppUa0eNLR08RloTfwU Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 4e405ff5523c44619c108522c07e93e9 Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985'} Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:42:03.674331 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Returning 404 to user: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7abf7dfb-b43f-4f34-bb3a-67a707fba2b7 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 404 len: 111 microversion: 2.1 time: 0.034723 Jul 19 20:42:03.680248 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3120/6342] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:42:03 2022] DELETE /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:42:03.688138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:03.689018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] [instance: df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:03.697299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.697818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.698716 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:03.699255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:03.715237 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] HTTP exception thrown: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Request method failure captured: Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 HTTP/1.1 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xaqAaZ8eUiLa_SMUt6LxVgMbrGyJisSTY0-G06nZcZV9f_gd_xAG3OmakMnljpeD_mO6Wn4VEA9HPI2qknefEM0dIqvI8gkevLK__9CCpQhHCnoWRJ2KRS3SRuWn5QvxbeOcIODajSa2VGPYn5bAmg77276hppUa0eNLR08RloTfwU Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d43aeee25e24ad284f79954d341a42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 4d43aeee25e24ad284f79954d341a42b Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442228083 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 4e405ff5523c44619c108522c07e93e9 Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442228083-project Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985'} Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:03.716968 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] Returning 404 to user: Instance df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0946311-e81c-4227-bae9-3f60e7f09736 tempest-ServerDiskConfigTestJSON-1442228083 tempest-ServerDiskConfigTestJSON-1442228083-project] 10.222.0.23 "GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985" status: 404 len: 111 microversion: 2.1 time: 0.035592 Jul 19 20:42:03.724289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3223/6343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:03 2022] GET /compute/v2.1/servers/df8fc4cc-20ce-4c7e-82d8-cd0e9ca0e985 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:42:14.360116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:14.362299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:14.540792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-375b3487-4660-4eec-9bae-c03a00d86a73 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: .version_select at 0x7f2400a591f0>, body: {"keypair": {"name": "tempest-keypair-994093621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsB09ulv4phXftatdqGQ1MHMCZwqhAq1txxPd/tbzpMRDxl6VN7rspNrfnsBvCGzWTP781E1xt9qslIMxzyVA1UwaTl5sJo6ur83z/AlUtk9hhTsoM8TFDZLVKc0y3FbA=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:14.563776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-375b3487-4660-4eec-9bae-c03a00d86a73 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:42:14.573231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-375b3487-4660-4eec-9bae-c03a00d86a73 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:42:14.608098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-375b3487-4660-4eec-9bae-c03a00d86a73 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256178 Jul 19 20:42:14.609076 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3121/6344] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:42:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:16.846287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1144238012", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46755e2f-5c01-439a-a230-931b1405f1c8"}], "security_groups": [{"name": "tempest-securitygroup--1328016688"}], "key_name": "tempest-keypair-994093621", "user_data": "}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:16.862690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:16.864366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:17.057114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] validate_networks() for [('46755e2f-5c01-439a-a230-931b1405f1c8', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:42:17.611744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:42:17.612558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:42:17.613381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:42:17.613905 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:42:17.614380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:42:17.630181 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:17.631112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:17.632734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:17.633591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:17.667038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:42:17.678171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:42:17.704148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:42:17.708894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:42:17.798520 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-01ac68c0-57e7-4522-bcfc-b4489abcd9dc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.960141 Jul 19 20:42:17.799710 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3224/6345] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:42:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:42:17.816498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d371449-43fd-418e-b8d0-32edfa98f84d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.818764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d371449-43fd-418e-b8d0-32edfa98f84d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:18.029896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d371449-43fd-418e-b8d0-32edfa98f84d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:18.041066 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d371449-43fd-418e-b8d0-32edfa98f84d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1238 microversion: 2.1 time: 0.233740 Jul 19 20:42:18.042162 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3122/6346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1238 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:19.076205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:19.077877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:19.092897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:19.094751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:19.096907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:19.098572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:19.244416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:19.272766 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e8d31df-9588-4cc7-814f-8d1b1e9eab3f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1290 microversion: 2.1 time: 0.208645 Jul 19 20:42:19.280025 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3225/6347] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:19 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1290 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:20.309453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:20.311117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:20.323008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:20.324178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:20.325721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:20.326788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:20.654476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:20.673880 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-050e6778-3208-43e3-9f0d-e4e9702471b9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.371716 Jul 19 20:42:20.675443 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3123/6348] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:20 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:21.310369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-917ec82c-3cdb-434f-b8b6-49d35a1d3145 req-4dc8d705-7cf9-4e4b-b935-82f2d889f0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:21.345278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-917ec82c-3cdb-434f-b8b6-49d35a1d3145 req-4dc8d705-7cf9-4e4b-b935-82f2d889f0f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:21.347557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-917ec82c-3cdb-434f-b8b6-49d35a1d3145 req-4dc8d705-7cf9-4e4b-b935-82f2d889f0f2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:21.367946 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-917ec82c-3cdb-434f-b8b6-49d35a1d3145 req-4dc8d705-7cf9-4e4b-b935-82f2d889f0f2 service nova] Creating event network-changed:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h1-843834-3 Jul 19 20:42:21.375939 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-917ec82c-3cdb-434f-b8b6-49d35a1d3145 req-4dc8d705-7cf9-4e4b-b935-82f2d889f0f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075726 Jul 19 20:42:21.377091 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3226/6349] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:21.696585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:21.697742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:21.708342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:21.709839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:21.711589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:21.712323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:21.927055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:21.937658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e739948b-8609-49d9-9d7b-9886b2ca19bb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.246862 Jul 19 20:42:21.938273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3124/6350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:21 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:22.958656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:22.959564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:22.967461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:22.968424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:22.969357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:22.969887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:23.311434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:23.320708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78884c6c-c22a-44f1-8450-d4a862ba9979 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.367996 Jul 19 20:42:23.321661 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3227/6351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:22 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:42:24.341132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:24.342132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:24.350483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:24.351068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:24.351903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:24.352409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:24.547175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:24.561128 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ac034d4a-2e1e-4a70-b520-06477afb4dfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.224000 Jul 19 20:42:24.562423 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3125/6352] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:24 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:25.580453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:25.581064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:25.588320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:25.588777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:25.589614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:25.590032 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:25.764012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:25.773176 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8bba92eb-6827-4ad1-b780-de46273124a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.196959 Jul 19 20:42:25.773966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3228/6353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:25 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:26.661779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8b1d7fd8-143e-4a0b-885a-560be2827276 req-e351534f-d055-4538-9fa7-676e068a8a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "name": "network-vif-plugged", "status": "completed", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:26.675989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8b1d7fd8-143e-4a0b-885a-560be2827276 req-e351534f-d055-4538-9fa7-676e068a8a75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:26.676599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8b1d7fd8-143e-4a0b-885a-560be2827276 req-e351534f-d055-4538-9fa7-676e068a8a75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:26.699488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8b1d7fd8-143e-4a0b-885a-560be2827276 req-e351534f-d055-4538-9fa7-676e068a8a75 service nova] Creating event network-vif-plugged:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h1-843834-3 Jul 19 20:42:26.709998 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8b1d7fd8-143e-4a0b-885a-560be2827276 req-e351534f-d055-4538-9fa7-676e068a8a75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051620 Jul 19 20:42:26.711458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3126/6354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:26.796038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:26.797154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:26.810242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:26.811138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:26.812387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:26.813141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:27.035613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:27.049203 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2bca1edb-7243-4fc2-ba5f-29134f91bccd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.260431 Jul 19 20:42:27.049895 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3229/6355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:26 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:28.068324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:28.069412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:28.073194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:28.080195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:28.080773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:28.081710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:28.082249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:28.292856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:28.301758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49ef6f84-d5c2-42c6-9922-ddd26915f41b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1364 microversion: 2.1 time: 0.237930 Jul 19 20:42:28.302364 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3127/6356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:28 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:29.320566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:29.321795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:29.324123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:29.324948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:29.335390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:29.335924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:29.336789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:29.337290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:29.543363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:42:29.552634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3aae875d-63d2-463a-8619-c896ce589dc1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1551 microversion: 2.1 time: 0.236862 Jul 19 20:42:29.553319 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3230/6357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:42:29 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1551 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:42:29.574647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:29.575700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:42:29.589105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:29.589864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:29.591440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:29.592247 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:29.717499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d2bc0222-4265-41ec-8021-0c3274d11167 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150631 Jul 19 20:42:29.718449 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3128/6358] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:42:29 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:31.124616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-7d26e27f-55e4-42d5-8e23-0caa5e976030 req-5897fa55-ad31-41ec-bd9c-03085b53a9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:31.140564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7d26e27f-55e4-42d5-8e23-0caa5e976030 req-5897fa55-ad31-41ec-bd9c-03085b53a9a0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:42:31.141030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-7d26e27f-55e4-42d5-8e23-0caa5e976030 req-5897fa55-ad31-41ec-bd9c-03085b53a9a0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:42:31.155630 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-7d26e27f-55e4-42d5-8e23-0caa5e976030 req-5897fa55-ad31-41ec-bd9c-03085b53a9a0 service nova] Creating event network-changed:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h1-843834-3 Jul 19 20:42:31.162268 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-7d26e27f-55e4-42d5-8e23-0caa5e976030 req-5897fa55-ad31-41ec-bd9c-03085b53a9a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050759 Jul 19 20:42:31.163189 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3231/6359] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:06.876647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:06.877948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=30 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:06.885312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:06.886452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:06.900203 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:06.900935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:06.902432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:06.903317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.097629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:07.106236 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-516cb8ff-60fe-4c83-9003-7271533a48c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.233515 Jul 19 20:43:07.106854 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3129/6360] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:06 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:07.121950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:07.122765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:07.127833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:07.128614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:07.137131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.137627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.138548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.139084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.300167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:07.309611 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-838b099c-973b-4e6b-989f-175ea19ad913 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.189980 Jul 19 20:43:07.310227 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3232/6361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:07 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:07.327453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:07.328400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:07.338258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.338757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.339642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.340097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.490832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:07.499882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b1281888-994e-46b6-9f01-f156fa084c49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.176215 Jul 19 20:43:07.500526 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3130/6362] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:07 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:07.521521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:07.523310 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:07.533319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.534000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.535381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.536047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.573109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:07.581004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:43:07.589379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:43:07.589805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:43:07.590291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:43:07.590709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:43:07.591236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:43:07.665876 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9e1092d-397d-4981-af64-72d7e6ea8d99 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/action" status: 202 len: 0 microversion: 2.1 time: 0.152264 Jul 19 20:43:07.666587 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3233/6363] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:43:07 2022] POST /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:43:07.680875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:07.682017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:07.693308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.694098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.695571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:07.696622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:07.894481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:07.903585 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-086e124d-fa19-4e35-8548-de68ab8eccc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1679 microversion: 2.1 time: 0.230345 Jul 19 20:43:07.904212 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3131/6364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:07 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:08.924936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:08.925533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:08.935682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:08.936427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:08.938166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:08.938748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:09.121239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:09.134713 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-166a260e-47e7-41f4-b510-591a0f1e72f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1679 microversion: 2.1 time: 0.216214 Jul 19 20:43:09.135557 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3234/6365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:08 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:10.157820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:10.158849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:10.171700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:10.172372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:10.173609 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:10.174348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:10.377665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:10.386691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6883b990-6539-4b5b-ad3c-ad1f6d6435c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.236669 Jul 19 20:43:10.387355 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3132/6366] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:10 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:11.413165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:11.413786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:11.422341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:11.422802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:11.423700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:11.424144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:11.581172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:11.589627 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f7a7ad9-b825-48bc-b39a-e9836d47da3b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.181387 Jul 19 20:43:11.590250 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3235/6367] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:11 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:12.615530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:12.616473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:12.624858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:12.625324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:12.626165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:12.626618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:12.783896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:12.792467 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2bf77ea-73e3-4862-b3d6-d3a2b0436dda tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.181391 Jul 19 20:43:12.793083 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3133/6368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:12 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:13.811820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:13.812471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:13.821527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:13.822164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:13.823166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:13.823731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:13.977206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:13.986725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c35fab0-9547-4ef2-b85b-39ceaab804d1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.179567 Jul 19 20:43:13.987855 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3236/6369] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:13 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:15.007324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:15.010242 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:15.017174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:15.017631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:15.018461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:15.018960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:15.200712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:15.209471 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc1fcb86-c924-4cac-a3cc-8d565feeaa34 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.208798 Jul 19 20:43:15.210055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3134/6370] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:14 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:16.231933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:16.233426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:16.247332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:16.248125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:16.249547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:16.250333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:16.428112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:16.436844 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5f67336-127b-42c9-83c2-22c4872c0a7f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.212180 Jul 19 20:43:16.437477 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3237/6371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:16 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:17.456095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:17.456679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:17.465336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:17.465922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:17.466730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:17.467302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:17.644114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:17.653640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e38620ab-84c5-4100-a0da-6babcf845e06 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.201920 Jul 19 20:43:17.654240 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3135/6372] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:17 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:18.674211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:18.674937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:18.686260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:18.687046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:18.688117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:18.688758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:18.851329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:18.860576 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98518c19-105a-4003-83d1-f597f9b0a982 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.191281 Jul 19 20:43:18.861295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3238/6373] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:18 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:19.879622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:19.880350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:19.888109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:19.888647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:19.889494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:19.890008 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:20.076538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:20.085476 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43cfc85c-ca70-4e43-b33e-061c0a722b2e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.210166 Jul 19 20:43:20.086098 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3136/6374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:19 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:21.109947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:21.110650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:21.118872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:21.119488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:21.120527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:21.121039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:21.272159 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:21.286297 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-232a5c8e-5a7e-4e0c-9e6b-b3dbf01aa574 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1684 microversion: 2.1 time: 0.180503 Jul 19 20:43:21.287363 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3239/6375] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:21 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:22.312325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:22.312945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:22.321353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:22.322098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:22.323391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:22.324034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:22.493772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:22.502804 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-28253ac1-c058-43e2-a5e2-b14a5fb4c404 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1683 microversion: 2.1 time: 0.194250 Jul 19 20:43:22.503582 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3137/6376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:22 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:23.257909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "name": "network-vif-unplugged", "status": "completed", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:23.274170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:23.275260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:23.301700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] Creating event network-vif-unplugged:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h2-843834-3 Jul 19 20:43:23.315470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:43:23.343163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-31a71e12-2808-4dea-88a3-1c97f03bec5a req-d0fd4844-0cd3-4778-a4c5-80f842c56276 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198931 Jul 19 20:43:23.344353 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3240/6377] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:23.525440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:23.526633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:23.540184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:23.541024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:23.542870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:23.543765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:23.757737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:23.776438 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-409fb060-f6e0-4926-bea6-904425fb5ac9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1683 microversion: 2.1 time: 0.254684 Jul 19 20:43:23.777115 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3138/6378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:23 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:24.802411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.803453 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:24.810784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:24.811407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:24.812384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:24.812984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:24.965439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:24.974387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6f550920-56c6-4ff2-8c14-bc7d141efd5c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1681 microversion: 2.1 time: 0.177970 Jul 19 20:43:24.975038 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3241/6379] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:24 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:25.372837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:25.390620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:25.391478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:25.415053 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] Creating event network-changed:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h2-843834-3 Jul 19 20:43:25.425842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:43:25.448136 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ab89986a-a6ee-4129-af2b-699cd7abf48d req-00899bae-c585-4b92-b286-3d2c027c0273 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082543 Jul 19 20:43:25.449248 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3139/6380] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:26.009482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:26.013054 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:26.029147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.030599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:26.033150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.035642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:26.360640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:26.384588 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e378d2ab-437f-4230-b10f-ec1435b6010b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1678 microversion: 2.1 time: 0.389535 Jul 19 20:43:26.385668 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3242/6381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:25 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:26.418181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:26.420771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:26.440321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.441578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:26.449528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.450603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:26.565850 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dcd00e48-e36d-4c89-bd82-3ec1020c93e0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/action" status: 204 len: 0 microversion: 2.1 time: 0.156653 Jul 19 20:43:26.567061 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3140/6382] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:43:26 2022] POST /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f/action => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:43:26.583428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:26.584107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:26.611579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.612183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:26.613013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:26.613459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:27.022257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:27.036338 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6988e65-5df8-496c-912f-59ec7d85218c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1678 microversion: 2.1 time: 0.463359 Jul 19 20:43:27.036968 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3243/6383] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:26 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:28.056554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:28.057353 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:28.065276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:28.065828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:28.067058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:28.067586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:28.285495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:28.295331 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c6a98c8b-8e5d-4343-9f1b-57659b9b8324 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1678 microversion: 2.1 time: 0.244722 Jul 19 20:43:28.296266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3141/6384] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:28 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:28.455384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-5415b29d-fa54-4b3d-b87a-6ba568e4807f req-daf45b42-af50-45a5-b661-536b3acac5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "name": "network-vif-plugged", "status": "completed", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:28.474560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5415b29d-fa54-4b3d-b87a-6ba568e4807f req-daf45b42-af50-45a5-b661-536b3acac5d3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:28.475354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-5415b29d-fa54-4b3d-b87a-6ba568e4807f req-daf45b42-af50-45a5-b661-536b3acac5d3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:28.498812 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-5415b29d-fa54-4b3d-b87a-6ba568e4807f req-daf45b42-af50-45a5-b661-536b3acac5d3 service nova] Creating event network-vif-plugged:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h2-843834-3 Jul 19 20:43:28.508092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-5415b29d-fa54-4b3d-b87a-6ba568e4807f req-daf45b42-af50-45a5-b661-536b3acac5d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163511 Jul 19 20:43:28.509194 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3244/6385] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:29.313570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:29.314243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:29.322860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.323365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.324194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.324625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.488529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:29.497441 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-11a1884a-895a-4318-b9f1-99915ede2124 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.187820 Jul 19 20:43:29.498064 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3142/6386] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:29 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:29.517109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:29.517947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:29.525783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.526267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.527165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.527638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.721711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:29.735655 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ebddf23-1b97-4ce6-9c68-2ce171f30b57 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.223898 Jul 19 20:43:29.736705 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3245/6387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:29 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:29.753103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:29.753742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:29.760958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.761488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.762360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.762836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.939466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:29.949712 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6a6ba4f-3d5f-4c47-90f7-7aac2842aa13 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1670 microversion: 2.1 time: 0.200534 Jul 19 20:43:29.950301 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3143/6388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:29 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:29.975386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:29.976036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:29.983754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.984464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:29.985500 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:29.986460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:30.017798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:43:30.072587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:30.117228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18c1d2a8-6390-46b3-80c8-3d864e9d160d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 204 len: 0 microversion: 2.1 time: 0.145521 Jul 19 20:43:30.123938 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3246/6389] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:43:29 2022] DELETE /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:43:30.129332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:30.129980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:30.136804 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:30.137276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:30.138084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:30.138539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:30.316837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:30.322625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:30.335976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-390a398d-eb33-4852-9d8f-83c85abdb984 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1676 microversion: 2.1 time: 0.210156 Jul 19 20:43:30.336985 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3144/6390] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:30 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:31.363105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:31.363836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:31.372086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:31.372531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:31.373421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:31.373870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:31.532574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:31.544793 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68cbe4b2-48af-4d85-aa44-95ca67b0590a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1676 microversion: 2.1 time: 0.186017 Jul 19 20:43:31.545862 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3247/6391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:31 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:32.545857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-3c394416-0b1c-4b14-8076-dc0122ea2043 req-f92c6e63-9335-452e-a56a-78baff231f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f96e02-5a4c-4f82-8bac-dad1fc62299f", "name": "network-vif-deleted", "tag": "fe50e533-c1bb-4d02-a784-0fcec0e532c4"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:32.563832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3c394416-0b1c-4b14-8076-dc0122ea2043 req-f92c6e63-9335-452e-a56a-78baff231f3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:32.564711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-3c394416-0b1c-4b14-8076-dc0122ea2043 req-f92c6e63-9335-452e-a56a-78baff231f3e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:32.565611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:32.566622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:32.576439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:32.577370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:32.578776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:32.579448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:32.590513 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-3c394416-0b1c-4b14-8076-dc0122ea2043 req-f92c6e63-9335-452e-a56a-78baff231f3e service nova] Creating event network-vif-deleted:fe50e533-c1bb-4d02-a784-0fcec0e532c4 for instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f on n-h2-843834-3 Jul 19 20:43:32.607660 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-3c394416-0b1c-4b14-8076-dc0122ea2043 req-f92c6e63-9335-452e-a56a-78baff231f3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069761 Jul 19 20:43:32.608705 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3145/6392] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:32.664811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:32.686566 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-13289bf3-5637-41cb-8abc-d9058d3059ac tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 200 len: 1323 microversion: 2.1 time: 0.126613 Jul 19 20:43:32.687239 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3248/6393] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:32 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 1323 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:33.713901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:33.715241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:33.726688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.727219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:33.728180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.728737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:33.750482 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f HTTP/1.1 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c6f96e02-5a4c-4f82-8bac-dad1fc62299f'} Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:43:33.752324 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:43:33.757185 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-50d05155-5f8d-4c63-bbef-902e4f0e4e56 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 404 len: 111 microversion: 2.1 time: 0.049617 Jul 19 20:43:33.758068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3146/6394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:33 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:43:33.772813 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:33.774294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:33.787663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.788327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:33.789802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:33.790566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:33.817960 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f HTTP/1.1 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c6f96e02-5a4c-4f82-8bac-dad1fc62299f'} Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:43:33.821838 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ef36b87-90c8-4a08-9cba-3cd85bcf6924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 404 len: 111 microversion: 2.1 time: 0.055521 Jul 19 20:43:33.827921 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3249/6395] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:33 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:43:33.886379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-765525640", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "46755e2f-5c01-439a-a230-931b1405f1c8"}], "security_groups": [{"name": "tempest-securitygroup--1328016688"}], "key_name": "tempest-keypair-994093621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:34.020302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] validate_networks() for [('46755e2f-5c01-439a-a230-931b1405f1c8', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:43:34.533524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:43:34.534042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:43:34.534530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:43:34.534988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:43:34.535415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:43:34.545017 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:34.545485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:34.546324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:34.546762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:34.565104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:43:34.571255 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:43:34.585958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:43:34.588402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:43:34.636686 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7bb943e-0782-4b96-9f9a-32afe4ec07b1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754655 Jul 19 20:43:34.637356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3147/6396] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:43:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:43:34.651938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-15f26a71-8c76-4c55-a752-0194d4a98607 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:34.652811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-15f26a71-8c76-4c55-a752-0194d4a98607 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:34.726710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-15f26a71-8c76-4c55-a752-0194d4a98607 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:34.734991 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15f26a71-8c76-4c55-a752-0194d4a98607 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1237 microversion: 2.1 time: 0.090834 Jul 19 20:43:34.735612 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3250/6397] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:34 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:35.762276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:35.763502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:35.777090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:35.777839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:35.778782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:35.779415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:35.880357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:35.891220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3d0e1ffd-178b-4292-aa20-759713f69bc2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1307 microversion: 2.1 time: 0.136101 Jul 19 20:43:35.892122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3148/6398] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:35 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:36.911204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:36.912137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:36.921957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:36.922421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:36.923298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:36.923746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:37.155985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:37.170900 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-464bb69e-de79-48a4-948e-c3128347cfd9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.264672 Jul 19 20:43:37.171878 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3251/6399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:36 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:37.514838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-17926035-7aa6-44da-b748-3ef1de078570 req-f8264dc5-d0e8-4ec5-9185-48868bcfdc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:37.530637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:37.546132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17926035-7aa6-44da-b748-3ef1de078570 req-f8264dc5-d0e8-4ec5-9185-48868bcfdc8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:37.546954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-17926035-7aa6-44da-b748-3ef1de078570 req-f8264dc5-d0e8-4ec5-9185-48868bcfdc8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:37.565132 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-17926035-7aa6-44da-b748-3ef1de078570 req-f8264dc5-d0e8-4ec5-9185-48868bcfdc8d service nova] Creating event network-changed:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h2-843834-3 Jul 19 20:43:37.576960 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-17926035-7aa6-44da-b748-3ef1de078570 req-f8264dc5-d0e8-4ec5-9185-48868bcfdc8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076177 Jul 19 20:43:37.578079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3149/6400] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:38.189775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:38.190426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:38.193609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:38.200258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:38.200766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:38.201611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:38.202098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:38.381244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:38.395651 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-97d802d5-7e47-4c53-9d61-9ef4743a93a0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.209492 Jul 19 20:43:38.396748 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3252/6401] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:38 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:39.417050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:39.418276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:39.427115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:39.427717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:39.428694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:39.429356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:39.646460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:39.655707 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd1c07cb-2376-46ae-bbfb-18887f9f226b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.244966 Jul 19 20:43:39.656792 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3150/6402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:39 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:40.679901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:40.681259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:40.695414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:40.696539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:40.698035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:40.699174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:40.885829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:40.895053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7407009a-17c2-4780-8608-b6e0ebfc4266 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.224646 Jul 19 20:43:40.895706 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3253/6403] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:40 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:41.914937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:41.915816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:41.924009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.924503 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:41.925307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:41.925758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:42.073883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:42.081894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1437e82e-2d79-428b-9748-ce0907c90924 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.171672 Jul 19 20:43:42.082498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3151/6404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:41 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:42.387078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8d3808a3-a21a-42ba-9194-527402f25593 req-e78d9a8d-6729-4f8c-9b36-87e762989529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "name": "network-vif-plugged", "status": "completed", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:42.400773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8d3808a3-a21a-42ba-9194-527402f25593 req-e78d9a8d-6729-4f8c-9b36-87e762989529 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:42.401459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8d3808a3-a21a-42ba-9194-527402f25593 req-e78d9a8d-6729-4f8c-9b36-87e762989529 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:42.416455 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8d3808a3-a21a-42ba-9194-527402f25593 req-e78d9a8d-6729-4f8c-9b36-87e762989529 service nova] Creating event network-vif-plugged:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h2-843834-3 Jul 19 20:43:42.421940 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8d3808a3-a21a-42ba-9194-527402f25593 req-e78d9a8d-6729-4f8c-9b36-87e762989529 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039401 Jul 19 20:43:42.422650 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3254/6405] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:43.100628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:43.101475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:43.109835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:43.110307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:43.111207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:43.111819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:43.300774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:43.309533 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fc85b39-d14e-4ecb-bc8b-18cccfbf905b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1363 microversion: 2.1 time: 0.213331 Jul 19 20:43:43.310180 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3152/6406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:43 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:44.329719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:44.330421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:44.337881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:44.338458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:44.339544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:44.340053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:44.492121 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:43:44.501141 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7878f730-7c13-4c9d-844e-f7245bc74ff0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1550 microversion: 2.1 time: 0.176957 Jul 19 20:43:44.501776 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3255/6407] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:43:44 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:44.527929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:44.528769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:43:44.538165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:44.538768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:44.539867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:44.540441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:44.559292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:44.578930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:44.640285 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef6be7f4-a4b2-45f5-801b-a2af9da873ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117035 Jul 19 20:43:44.641413 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3153/6408] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:43:44 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:45.809461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:45.880783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-abfca4bf-293e-4121-aa8d-b90b093ac163 req-e63b2077-ebfc-4928-8616-273ac89ca4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:43:45.894356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-abfca4bf-293e-4121-aa8d-b90b093ac163 req-e63b2077-ebfc-4928-8616-273ac89ca4ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:43:45.894891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-abfca4bf-293e-4121-aa8d-b90b093ac163 req-e63b2077-ebfc-4928-8616-273ac89ca4ea service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:43:45.915202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-abfca4bf-293e-4121-aa8d-b90b093ac163 req-e63b2077-ebfc-4928-8616-273ac89ca4ea service nova] Creating event network-changed:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h2-843834-3 Jul 19 20:43:45.922298 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-abfca4bf-293e-4121-aa8d-b90b093ac163 req-e63b2077-ebfc-4928-8616-273ac89ca4ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119886 Jul 19 20:43:45.923417 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3256/6409] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:44:09.393975 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:44:09.394777 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:44:22.917874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=9 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:22.919556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=37 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:22.929118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-de5e616a-1d96-45c3-b8c7-43bffe39d7e4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:22.939762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de5e616a-1d96-45c3-b8c7-43bffe39d7e4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:22.940337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-de5e616a-1d96-45c3-b8c7-43bffe39d7e4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:22.977073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-de5e616a-1d96-45c3-b8c7-43bffe39d7e4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:44:23.033460 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-de5e616a-1d96-45c3-b8c7-43bffe39d7e4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action" status: 202 len: 0 microversion: 2.1 time: 0.117788 Jul 19 20:44:23.034597 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3154/6410] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:44:22 2022] POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:44:23.044481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=9 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:23.045325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:23.050367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:23.051242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:23.063007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:23.063493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:23.064451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:23.064893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:23.230096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:23.238878 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8ca94e5-f03b-435d-90eb-7599641e2ff7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.197290 Jul 19 20:44:23.239517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3257/6411] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:23 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:24.261678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:24.262531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:24.270351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:24.270857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:24.271820 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:24.272436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:24.457042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:24.465732 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-74a74772-463b-43f8-b4cd-17887ad5f47f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.209634 Jul 19 20:44:24.466341 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3155/6412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:24 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:25.483645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:25.484350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:25.491757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:25.492252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:25.493130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:25.493611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:25.642830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:25.651621 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-578667a6-ee85-4d1d-a679-d670547b850d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.172210 Jul 19 20:44:25.652228 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3258/6413] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:25 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:26.668927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:26.669685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:26.678016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:26.678624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:26.679652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:26.680291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:26.840738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:26.849440 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5740d6f4-6e9d-4254-89c2-dd9fbff42f46 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.184482 Jul 19 20:44:26.850073 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3156/6414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:26 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:27.868621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:27.869315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:27.877246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:27.877709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:27.878533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:27.879089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:28.061872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:28.072011 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-34964164-1387-4ca1-bfdf-40d3dafc1211 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.207941 Jul 19 20:44:28.072792 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3259/6415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:27 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:29.090768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:29.091561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:29.099371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:29.099838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:29.100641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:29.101089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:29.255679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:29.264677 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb06048b-3144-42ad-b260-65de05b47ae7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.178261 Jul 19 20:44:29.265293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3157/6416] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:29 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:30.291210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:30.291807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:30.299954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:30.300419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:30.301228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:30.301670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:30.459596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:30.468379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3fe721f9-c5ca-4cb1-b42a-e23123f3a04a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.181349 Jul 19 20:44:30.468988 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3260/6417] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:30 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:31.487876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:31.488596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:31.496756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:31.497201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:31.498045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:31.498498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:31.653772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:31.662219 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8561f54c-de0f-4be7-be58-1f74de6a7034 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.178567 Jul 19 20:44:31.663061 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3158/6418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:31 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:32.689639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:32.690303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:32.698397 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:32.698885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:32.699942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:32.700391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:32.853218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:32.862320 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-748b3530-30ec-4e3d-94d5-176e07d9e1e5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.176938 Jul 19 20:44:32.863000 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3261/6419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:32 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:33.881598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:33.882226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:33.889860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:33.890331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:33.891166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:33.891711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:34.060655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:34.075283 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8372f3b1-b8e8-4c15-a846-b4c6370c0da2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.197222 Jul 19 20:44:34.076331 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3159/6420] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:33 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:35.101091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:35.101884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:35.109367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:35.109810 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:35.110608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:35.111093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:35.273014 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:35.286550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc324bb6-cd0e-4a28-b694-61e86ffc1b4d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.189345 Jul 19 20:44:35.287541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3262/6421] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:35 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:36.307466 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:36.308101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:36.316075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:36.316452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:36.317286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:36.317743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:36.526940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:36.535554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2b1955b-7811-46e4-bd11-480c6aff3179 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.233070 Jul 19 20:44:36.536171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3160/6422] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:36 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:37.553239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:37.553842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:37.562267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:37.562832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:37.563856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:37.564421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:37.719118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:37.727761 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2923529b-7d27-4f2a-8062-4a71abb656ec tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.178511 Jul 19 20:44:37.728389 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3263/6423] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:37 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:38.747498 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:38.748506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:38.756705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:38.757229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:38.758146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:38.758641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:38.912404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:38.921246 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f7a2ac26-dd32-4d92-91e6-a6c0e14d4f0a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1656 microversion: 2.1 time: 0.178120 Jul 19 20:44:38.921843 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3161/6424] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:38 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1656 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:44:38.938961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:38.940309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:38.948568 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:38.948932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:38.949733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:38.950173 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:38.983881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:38.991625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:44:38.999829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:44:39.000250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:44:39.000933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:44:39.001469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:44:39.001886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:44:39.076387 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92267bbb-f638-42d6-b31f-d90dba5e9671 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action" status: 202 len: 0 microversion: 2.1 time: 0.141570 Jul 19 20:44:39.077276 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3264/6425] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:44:38 2022] POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:44:39.087691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:39.088525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:39.096671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:39.097122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:39.098128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:39.098640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:39.306689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:39.315550 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-adeb65c0-e9c3-4353-93e2-20f44663dd63 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.232245 Jul 19 20:44:39.316171 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3162/6426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:39 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:40.336063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:40.337141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:40.346621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:40.347221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:40.348143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:40.348636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:40.528776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:40.537247 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ed6418d-9646-484b-8ac5-d357dc7c3678 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1679 microversion: 2.1 time: 0.205453 Jul 19 20:44:40.537897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3265/6427] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:40 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:41.565906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:41.566507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:41.574744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:41.575264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:41.576136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:41.576606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:41.739327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:41.748364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1581b2cf-e066-4426-b023-38f42a3d7265 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1684 microversion: 2.1 time: 0.187011 Jul 19 20:44:41.748988 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3163/6428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:41 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:42.767280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:42.767930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:42.775820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:42.776278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:42.777072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:42.777508 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:42.947834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:42.956180 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-034d9fce-a1f3-4b13-87d4-8ead8d8d954e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1684 microversion: 2.1 time: 0.193124 Jul 19 20:44:42.956798 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3266/6429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:42 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1684 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:43.839767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "name": "network-vif-unplugged", "status": "completed", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:43.850942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:43.851405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:43.865822 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] Creating event network-vif-unplugged:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h1-843834-3 Jul 19 20:44:43.872441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] Instance 97f84894-3fbc-4610-b30f-662153c01336 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:44:43.895999 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-7b0e08ea-10a0-41e5-b328-91172bf39379 req-64e43028-7f23-4141-a664-6f245f9cf3e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058313 Jul 19 20:44:43.896654 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3164/6430] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:43.974859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:43.976590 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:43.983884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:43.984395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:43.986515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:43.986515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:44.756030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:44.779448 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c5e316f4-cac8-49cc-95ae-4b4c6031dad8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1683 microversion: 2.1 time: 0.809604 Jul 19 20:44:44.780707 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3267/6431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:43 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1683 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:45.808746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:45.809839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:45.819572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:45.820200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:45.822067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:45.823034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:45.927631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:45.937829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:45.938309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:45.955151 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] Creating event network-changed:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h1-843834-3 Jul 19 20:44:45.962020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] Instance 97f84894-3fbc-4610-b30f-662153c01336 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:44:45.975143 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f6b8555b-8ff4-4279-ad25-d005ef632e8c req-9d5b5c99-5b78-43a7-823f-33e024a48a52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051052 Jul 19 20:44:45.976116 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3268/6432] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:44:45.994754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:46.008283 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-32810942-cfeb-4ef8-a9c9-c4757b0ad145 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1681 microversion: 2.1 time: 0.206164 Jul 19 20:44:46.009269 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3165/6433] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:45 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:47.040858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:47.042088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:47.055343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.056687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.058489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.059556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.435681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:47.445190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9f6166f6-4e13-4fb4-b673-4ddc968d5501 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1677 microversion: 2.1 time: 0.414084 Jul 19 20:44:47.446311 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3269/6434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:47 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1677 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:47.462945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:47.463499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:47.473920 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.474739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.476184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.477034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.582375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3cd41453-60f1-4e1a-8e25-917f6540cf7a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action" status: 204 len: 0 microversion: 2.1 time: 0.123321 Jul 19 20:44:47.583542 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3166/6435] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:44:47 2022] POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:44:47.594856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:47.596578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:47.603571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.604711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.606191 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:47.606959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:47.882464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:47.893014 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a5ee7fa-9fe9-4061-b1ce-3b06fdf41329 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1677 microversion: 2.1 time: 0.303412 Jul 19 20:44:47.893820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3270/6436] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:47 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1677 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:48.920782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:48.922102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:48.933974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:48.934532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:48.935468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:48.935987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:49.162767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:49.177239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-467fd9fb-3c73-4e21-b65e-012edca7fb92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1677 microversion: 2.1 time: 0.261715 Jul 19 20:44:49.188042 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3167/6437] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:48 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:49.403870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a1e968a5-52d6-491e-8d4b-fa0799ec8020 req-12bbe504-6809-44c6-b51b-4fc705c6bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "name": "network-vif-plugged", "status": "completed", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:49.414465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a1e968a5-52d6-491e-8d4b-fa0799ec8020 req-12bbe504-6809-44c6-b51b-4fc705c6bb48 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:49.414969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a1e968a5-52d6-491e-8d4b-fa0799ec8020 req-12bbe504-6809-44c6-b51b-4fc705c6bb48 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:49.430593 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a1e968a5-52d6-491e-8d4b-fa0799ec8020 req-12bbe504-6809-44c6-b51b-4fc705c6bb48 service nova] Creating event network-vif-plugged:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h1-843834-3 Jul 19 20:44:49.436828 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a1e968a5-52d6-491e-8d4b-fa0799ec8020 req-12bbe504-6809-44c6-b51b-4fc705c6bb48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037621 Jul 19 20:44:49.437725 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3271/6438] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:50.196802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:50.197470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:50.205215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.205693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.206508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.206992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.366028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:50.368101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:50.376976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f3039ce0-fd9d-483d-a91c-2593973d3625 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1656 microversion: 2.1 time: 0.184649 Jul 19 20:44:50.377716 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3168/6439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:50 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1656 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:50.395321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:50.396020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:50.404128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.404871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.405588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.406040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.573027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:50.582411 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2bf7f761-49d4-450f-98c4-7749c47f2f01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1656 microversion: 2.1 time: 0.191676 Jul 19 20:44:50.583060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3272/6440] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:50 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1656 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:50.600786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4c8688b0-d94f-4e2d-8c66-c3f67e9658f3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:50.610020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c8688b0-d94f-4e2d-8c66-c3f67e9658f3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.610390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4c8688b0-d94f-4e2d-8c66-c3f67e9658f3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.637325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4c8688b0-d94f-4e2d-8c66-c3f67e9658f3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:44:50.688212 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4c8688b0-d94f-4e2d-8c66-c3f67e9658f3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action" status: 202 len: 0 microversion: 2.1 time: 0.091550 Jul 19 20:44:50.689071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3169/6441] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:44:50 2022] POST /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:44:50.703906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:50.705044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:50.714582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.715075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.716069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:50.716318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:50.721768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:50.942254 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:50.951386 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6fc7e992-e899-4417-9b0d-d3be66d0555f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1665 microversion: 2.1 time: 0.256610 Jul 19 20:44:50.951909 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3273/6442] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:50 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1665 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:51.971376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:51.972240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:51.979057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:51.979816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:51.980647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:51.981108 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:52.175460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:52.189892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d7d006e4-6cbd-4f4f-92bd-a3d8c69f9098 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1669 microversion: 2.1 time: 0.223798 Jul 19 20:44:52.191055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3170/6443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:51 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:52.217883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:52.218564 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:52.227496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:52.227844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:52.228659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:52.229120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:52.261498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:44:52.382142 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a39270c5-240d-4586-821e-dff0e2b893d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 204 len: 0 microversion: 2.1 time: 0.168664 Jul 19 20:44:52.382782 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3274/6444] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:44:52 2022] DELETE /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:44:52.397270 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:52.398395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:52.409421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:52.410104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:52.411588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:52.412406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:52.587004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:52.596112 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfbf57a4-ecb8-49e0-95a4-a35dda4cd8ea tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1675 microversion: 2.1 time: 0.206417 Jul 19 20:44:52.596741 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3171/6445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:52 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:53.615250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:53.616134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:53.618701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:53.624921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:53.625381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:53.626187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:53.626628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:53.801285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:53.810269 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8912db12-e105-47c7-a06a-465ec6bb20c0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1675 microversion: 2.1 time: 0.199733 Jul 19 20:44:53.810895 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3275/6446] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:53 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:54.844358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:54.845530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:54.864860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=37 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:54.873079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:54.873934 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:54.875517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:54.876300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:54.913398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6886e341-4029-42c2-b1c3-39ca64442388 req-8636310b-3879-4b3d-8698-d25366810ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f84894-3fbc-4610-b30f-662153c01336", "name": "network-vif-deleted", "tag": "d25b5cc9-b497-4328-befc-5e2642592201"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:54.933276 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6886e341-4029-42c2-b1c3-39ca64442388 req-8636310b-3879-4b3d-8698-d25366810ef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:54.934737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6886e341-4029-42c2-b1c3-39ca64442388 req-8636310b-3879-4b3d-8698-d25366810ef1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:54.952623 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6886e341-4029-42c2-b1c3-39ca64442388 req-8636310b-3879-4b3d-8698-d25366810ef1 service nova] Creating event network-vif-deleted:d25b5cc9-b497-4328-befc-5e2642592201 for instance 97f84894-3fbc-4610-b30f-662153c01336 on n-h1-843834-3 Jul 19 20:44:54.960792 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6886e341-4029-42c2-b1c3-39ca64442388 req-8636310b-3879-4b3d-8698-d25366810ef1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053182 Jul 19 20:44:54.961820 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3276/6447] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:44:55.023019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:55.040538 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2da46688-6ffd-4687-b586-9ee85cff30bd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 200 len: 1607 microversion: 2.1 time: 0.213860 Jul 19 20:44:55.051535 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3172/6448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:54 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 1607 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:56.062537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:56.063679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:56.072586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.073393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:56.074378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.074899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:56.105552 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 HTTP/1.1 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '97f84894-3fbc-4610-b30f-662153c01336'} Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:56.109026 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:44:56.115987 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c6b41b04-15d1-4f71-bae5-e74119533eba tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 404 len: 111 microversion: 2.1 time: 0.057281 Jul 19 20:44:56.137885 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:56.139603 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3277/6449] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:56 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:44:56.140416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:56.151131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.152473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:56.154460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.155218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:56.177853 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 HTTP/1.1 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '97f84894-3fbc-4610-b30f-662153c01336'} Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:44:56.179827 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:44:56.188471 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2d4cbdf8-706a-4171-b2f4-b34bd9278686 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 404 len: 111 microversion: 2.1 time: 0.051300 Jul 19 20:44:56.191732 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3173/6450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:56 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:44:56.254708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1981686938", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "46755e2f-5c01-439a-a230-931b1405f1c8"}], "security_groups": [{"name": "tempest-securitygroup--1328016688"}], "key_name": "tempest-keypair-994093621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:44:56.419285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] validate_networks() for [('46755e2f-5c01-439a-a230-931b1405f1c8', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:44:56.968744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:44:56.969375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:44:56.969878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:44:56.970290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:44:56.970782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:44:56.980829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.981296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:56.982123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:56.982572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:57.002850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:44:57.009809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:44:57.025355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:44:57.027915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:44:57.085802 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e040a4e4-95b3-467e-9b6a-47cda799418e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.840404 Jul 19 20:44:57.087028 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3278/6451] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:44:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:44:57.100081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4714f7c9-2918-4fbe-89b3-8c85a9cbdf4c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:57.100952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4714f7c9-2918-4fbe-89b3-8c85a9cbdf4c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:57.168848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4714f7c9-2918-4fbe-89b3-8c85a9cbdf4c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:57.181462 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4714f7c9-2918-4fbe-89b3-8c85a9cbdf4c tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1238 microversion: 2.1 time: 0.086367 Jul 19 20:44:57.182088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3174/6452] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:57 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:58.210297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:58.211022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:58.219403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:58.219870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:58.220719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:58.221170 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:58.312109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:58.321860 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ed1509af-a7fe-45c5-b0e2-165b649c223e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1290 microversion: 2.1 time: 0.117563 Jul 19 20:44:58.322895 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3279/6453] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:58 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:44:59.345706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:44:59.347076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:44:59.359233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:59.359989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:59.361132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:44:59.362016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:44:59.551253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:44:59.563252 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-af8a5680-23b5-45c9-86a7-2e6992aed153 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.224917 Jul 19 20:44:59.564121 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3175/6454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:44:59 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:00.189944 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-02f6337e-1ce6-4a58-88d5-9f4a555d91c0 req-495c8c3f-8226-48a8-8fcf-4e0e4bdcdd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:00.211313 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-02f6337e-1ce6-4a58-88d5-9f4a555d91c0 req-495c8c3f-8226-48a8-8fcf-4e0e4bdcdd5a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:00.212185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-02f6337e-1ce6-4a58-88d5-9f4a555d91c0 req-495c8c3f-8226-48a8-8fcf-4e0e4bdcdd5a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:00.241792 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-02f6337e-1ce6-4a58-88d5-9f4a555d91c0 req-495c8c3f-8226-48a8-8fcf-4e0e4bdcdd5a service nova] Creating event network-changed:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:45:00.247987 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-02f6337e-1ce6-4a58-88d5-9f4a555d91c0 req-495c8c3f-8226-48a8-8fcf-4e0e4bdcdd5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069850 Jul 19 20:45:00.248876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3280/6455] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:00.593657 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:00.595807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:00.607679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:00.608157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:00.609012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:00.609477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:00.814767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:00.823436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30f224f3-b63a-46e0-aa84-dddb7b8a5839 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.242432 Jul 19 20:45:00.824052 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3176/6456] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:00 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:45:01.845094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:01.846138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:01.857768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:01.858381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:01.859605 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:01.860331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:02.090413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:02.100105 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a257147f-29c9-4d35-9e63-f910925c7032 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.261516 Jul 19 20:45:02.101022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3281/6457] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:01 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:03.128700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:03.129704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:03.140296 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:03.140984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:03.141966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:03.142564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:03.314952 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:03.323904 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5c0b9a3f-cb48-4a67-bff9-92652d6fee01 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.201715 Jul 19 20:45:03.324518 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3177/6458] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:03 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:04.343175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:04.344051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:04.352646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:04.353323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:04.354203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:04.354864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:04.512757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:04.521633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-322973f7-9dd9-421f-bfbf-af82a98d56e2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.182701 Jul 19 20:45:04.522233 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3282/6459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:04 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:04.845736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4bb5df72-c469-44e4-896e-a8f86b7f0a11 req-81cb867f-9d86-4eb0-8aa8-25ff014511cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:04.862124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4bb5df72-c469-44e4-896e-a8f86b7f0a11 req-81cb867f-9d86-4eb0-8aa8-25ff014511cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:04.862991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4bb5df72-c469-44e4-896e-a8f86b7f0a11 req-81cb867f-9d86-4eb0-8aa8-25ff014511cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:04.885104 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4bb5df72-c469-44e4-896e-a8f86b7f0a11 req-81cb867f-9d86-4eb0-8aa8-25ff014511cf service nova] Creating event network-vif-plugged:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:45:04.894454 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4bb5df72-c469-44e4-896e-a8f86b7f0a11 req-81cb867f-9d86-4eb0-8aa8-25ff014511cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055257 Jul 19 20:45:04.895820 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3178/6460] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:05.541030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:05.541935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:05.550272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:05.550769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:05.551625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:05.552069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:05.721519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:05.736391 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3065967-6848-4ec8-bc78-99179c1ccfbd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1364 microversion: 2.1 time: 0.199351 Jul 19 20:45:05.737473 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3283/6461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:05 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:06.763919 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:06.764745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:06.771649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:06.772138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:06.772954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:06.773411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:06.924874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:06.933294 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66a56ae9-5df9-4323-bf71-6cb4bee1b7b7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1551 microversion: 2.1 time: 0.174819 Jul 19 20:45:06.933923 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3179/6462] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:06 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:06.955602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:06.956466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:06.970504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:06.971193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:06.972827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:06.973731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:07.003264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:07.019149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:07.098379 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-240c8740-4b54-4948-a631-ad4f65ebaa65 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149614 Jul 19 20:45:07.099603 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3284/6463] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:45:06 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:08.591912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1e820f71-c6e3-4914-ad10-dfb8043b5d1e req-f716af4e-6188-411f-ab4e-7da53545786b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:08.598536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:08.610779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1e820f71-c6e3-4914-ad10-dfb8043b5d1e req-f716af4e-6188-411f-ab4e-7da53545786b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:08.611613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1e820f71-c6e3-4914-ad10-dfb8043b5d1e req-f716af4e-6188-411f-ab4e-7da53545786b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:08.631986 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1e820f71-c6e3-4914-ad10-dfb8043b5d1e req-f716af4e-6188-411f-ab4e-7da53545786b service nova] Creating event network-changed:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:45:08.640898 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1e820f71-c6e3-4914-ad10-dfb8043b5d1e req-f716af4e-6188-411f-ab4e-7da53545786b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055584 Jul 19 20:45:08.641566 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3180/6464] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:45:42.500137 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.500970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.505867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:45:42.507199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:42.519153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.519629 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.520528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.520981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.555833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:42.563569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:45:42.572041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:45:42.572476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:45:42.572980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:45:42.573404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:45:42.573829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:45:42.649565 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c02fd37b-5f04-4d6e-ae90-aaee26f6569a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/action" status: 202 len: 0 microversion: 2.1 time: 0.151647 Jul 19 20:45:42.650487 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3285/6465] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:45:42 2022] POST /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:45:42.659783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=19 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.661186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:42.667277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:42.668197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:42.677268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.677829 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.678755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:42.679236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:42.876029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:42.887340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9188a6b4-b5cd-46ca-8a98-e9d226b1c541 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1679 microversion: 2.1 time: 0.231076 Jul 19 20:45:42.888273 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3181/6466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:42 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:43.911388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:43.912206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:43.919806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:43.920359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:43.921428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:43.921963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:44.081676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:44.092183 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d53a5f07-708e-4ca6-a3b8-90e5337967d4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1679 microversion: 2.1 time: 0.186314 Jul 19 20:45:44.092928 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3286/6467] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:43 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:45.111778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:45.112486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:45.122128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:45.122584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:45.123922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:45.123922 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:45.278729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:45.293220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-761dd661-5f3b-47bc-b5af-3862473067c7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.185431 Jul 19 20:45:45.294282 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3182/6468] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:45 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:46.321105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:46.321723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:46.329704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:46.330224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:46.331220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:46.331704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:46.487569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:46.497466 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f1c0dc3-32d9-4e3c-ba99-a802eba97126 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.181489 Jul 19 20:45:46.498202 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3287/6469] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:46 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:47.516286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:47.516985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:47.525484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:47.526026 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:47.526875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:47.527421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:47.678643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:47.687688 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f7dd959-c106-410d-9394-b154d7d5b46a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.175510 Jul 19 20:45:47.688414 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3183/6470] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:47 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:48.706194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:48.706859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:48.714748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:48.715238 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:48.716040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:48.716468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:48.874309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:48.882624 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8fc93d29-88eb-46b5-a066-9f83950ec112 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.180536 Jul 19 20:45:48.883391 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3288/6471] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:48 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:49.907601 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:49.908267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:49.915726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:49.916213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:49.917029 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:49.917479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:50.069352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:50.079103 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-614dcaa7-917d-46e8-85ca-ada765409718 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.175777 Jul 19 20:45:50.079719 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3184/6472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:49 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:51.105517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:51.106265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:51.114141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:51.114580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:51.115460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:51.115907 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:51.332223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:51.341375 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-77773aa8-1937-440b-b15a-88282309e581 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.240157 Jul 19 20:45:51.342136 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3289/6473] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:51 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:52.363963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:52.365158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:52.377940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.378629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.380085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:52.380865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:52.541964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:52.550962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-012b89c7-5c2a-4b3c-ae50-7b63457c30d8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.194325 Jul 19 20:45:52.551634 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3185/6474] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:52 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:53.572628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:53.573618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:53.584044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:53.584591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:53.585437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:53.586038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:53.744820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:53.753943 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5cd2fe76-0186-4144-a9a7-e7f4ddba56b2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.187805 Jul 19 20:45:53.754669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3290/6475] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:53 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:54.775504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:54.776204 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:54.784531 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:54.785094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:54.786012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:54.786527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:54.952227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:54.961579 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8f048e32-4701-485a-82f2-e96b4b600544 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.191482 Jul 19 20:45:54.962204 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3186/6476] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:54 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:55.979798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:55.980639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:55.988371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:55.988856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:55.989781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:55.990291 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:56.151752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:56.160633 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04f3e82c-c27b-4be9-96f1-6a84b85c9efe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.185172 Jul 19 20:45:56.161312 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3291/6477] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:55 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:57.185213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:57.186420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:57.199903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:57.200714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:57.202260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:57.203091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:57.447485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:57.455994 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-843843cd-8a52-4018-8315-9fff6c001e2b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.278330 Jul 19 20:45:57.456595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3187/6478] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:57 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:58.474604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:58.475323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:58.483331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:58.483584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:58.484381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:58.484815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:58.633068 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:58.642028 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3231e2a-0910-459f-b1d2-78d9d166e9e8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.171635 Jul 19 20:45:58.642648 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3292/6479] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:58 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:45:59.660321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:59.661048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:45:59.669054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:59.669521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:59.670320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:59.670750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:59.830364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:45:59.840849 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-67704b31-754d-4ac2-b31a-dde198a92db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.184595 Jul 19 20:45:59.841480 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3188/6480] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:45:59 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:00.860352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:00.860956 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:00.869711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:00.870255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:00.871179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:00.871664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:01.042157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:01.051053 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cc6b3198-99d4-48f5-a95d-136914d9ca9e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1684 microversion: 2.1 time: 0.194932 Jul 19 20:46:01.051690 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3293/6481] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:00 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:02.071711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:02.072583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:02.082125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:02.082695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:02.083734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:02.084450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:02.328068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:02.337268 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-207ea561-90e3-49ac-a774-8cdd2c6bd31a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1683 microversion: 2.1 time: 0.270539 Jul 19 20:46:02.338323 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3189/6482] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:02 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1683 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:02.399685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:02.411460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:02.412024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:02.430185 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] Creating event network-vif-unplugged:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h1-843834-3 Jul 19 20:46:02.437465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] Instance 3d275c8d-e7c7-478d-8757-f221a55f803c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:46:02.453824 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-53811bb4-78b6-44f9-b0db-0ee32e4f721d req-23ec436d-cc20-41fe-ba92-d4b5bf66ed67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058864 Jul 19 20:46:02.454768 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3294/6483] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:03.357271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:03.358070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:03.366486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:03.367086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:03.367995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:03.368478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:03.631327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:03.649427 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4fe23172-4fdd-4998-85c1-469d76196877 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1683 microversion: 2.1 time: 0.296657 Jul 19 20:46:03.661643 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3190/6484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:03 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:04.472421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:04.481961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:04.482424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:04.497023 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] Creating event network-changed:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h1-843834-3 Jul 19 20:46:04.503885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] Instance 3d275c8d-e7c7-478d-8757-f221a55f803c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:46:04.516468 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ee656c2f-19f0-4927-a63c-03ac3ba92744 req-6a33ab85-6360-4fcd-9758-5d76146f1d85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049346 Jul 19 20:46:04.517108 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3295/6485] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:04.677288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:04.678334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:04.686313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:04.686791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:04.688290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:04.688290 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:04.909481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:04.919423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a7f9bb50-8412-47fc-bfcc-29ca104ecd92 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1681 microversion: 2.1 time: 0.247071 Jul 19 20:46:04.920363 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3191/6486] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:04 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:05.947582 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:05.948459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:05.955467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.955921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:05.956726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:05.957165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.122545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:06.131326 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9512d4f-c304-43ea-9a4d-8699cb7cab71 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1678 microversion: 2.1 time: 0.189505 Jul 19 20:46:06.132050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3296/6487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:05 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:06.159245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:06.160392 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:06.170086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.170818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.172131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.172811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.224719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.225416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.226586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.227319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.257155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:06.264912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:06.383876 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17d653ad-f779-4598-9464-8c0b1d18d36d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/action" status: 202 len: 0 microversion: 2.1 time: 0.230196 Jul 19 20:46:06.384494 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3192/6488] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:46:06 2022] POST /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:46:06.393745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:06.394363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:06.401114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.401567 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.402371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:06.402805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:06.769847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:06.778409 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a59d1370-4df6-457b-ae09-cf857096a078 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.388739 Jul 19 20:46:06.779348 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3297/6489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:06 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:07.613871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:07.630515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:07.631044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:07.644759 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] Creating event network-vif-plugged:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h1-843834-3 Jul 19 20:46:07.651906 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] Instance 3d275c8d-e7c7-478d-8757-f221a55f803c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:46:07.664559 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5171d369-e6cc-4bc8-bb0c-e3882e976e0e req-0d2668b3-cf43-4a81-a8ef-f3a98e00d896 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054851 Jul 19 20:46:07.665294 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3193/6490] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:07.796751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:07.797431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:07.805577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:07.806149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:07.807132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:07.807596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:07.961854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:07.973725 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3df0acb2-c1ae-40c6-a1b7-b73ebf05bb88 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.180893 Jul 19 20:46:07.974732 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3298/6491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:07 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:09.001482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:09.002135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:09.009268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.009732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.010536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:09.011023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:09.166038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:09.172797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:09.181519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e5c32377-815c-4f6a-8765-ebfa396d0102 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.185776 Jul 19 20:46:09.182140 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3194/6492] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:08 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:10.152920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:10.163594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:10.164172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:10.179695 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] Creating event network-vif-unplugged:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:46:10.187473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] Instance 3d275c8d-e7c7-478d-8757-f221a55f803c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:46:10.201138 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-a603251e-b2f7-4a66-ad7b-4b5a5d1b95f0 req-8e5096c9-c5b6-4f71-90bd-e556b5a0a095 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052588 Jul 19 20:46:10.202252 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3299/6493] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:10.205144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:10.206220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:10.238739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:10.240265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:10.241377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:10.241840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:10.479398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:10.488567 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-418f6ef1-5ed7-4987-89b4-a4578828c4c2 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.291592 Jul 19 20:46:10.489294 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3195/6494] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:10 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:11.516683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:11.518009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:11.531997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:11.532781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:11.534186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:11.535006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:11.715241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:11.724060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d4590fee-bdff-4d8a-a74d-8125e2c18d49 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.215718 Jul 19 20:46:11.724811 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3300/6495] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:11 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:12.218947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:12.229021 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.229485 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.243247 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] Creating event network-changed:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:46:12.250044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] Instance 3d275c8d-e7c7-478d-8757-f221a55f803c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:46:12.262506 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2852d43f-2479-4c10-9366-33cb47531945 req-f61f55f9-913b-4ca7-84c0-54da862efddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047467 Jul 19 20:46:12.263183 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3196/6496] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:12.758550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:12.759830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:12.773575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=37 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:12.777146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.778882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.781012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:12.782146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:12.792208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:13.044305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:13.064000 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-388c3add-8cbe-4740-9810-d2d55342bb20 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1677 microversion: 2.1 time: 0.324458 Jul 19 20:46:13.066042 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3301/6497] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:12 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1677 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:14.088933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:14.089719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:14.092514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:14.103218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.106080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.106080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.106080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.294544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:14.306836 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bc449322-d18c-40d0-86aa-52506bcf03e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1670 microversion: 2.1 time: 0.227031 Jul 19 20:46:14.307920 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3197/6498] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:14 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:14.325513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:14.326246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:14.334879 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.335560 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.336611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.337151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.488281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:14.497041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2f3452da-b7db-457e-9ba6-c25229248584 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1670 microversion: 2.1 time: 0.175643 Jul 19 20:46:14.497634 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3302/6499] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:14 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:14.526109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:14.527363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:14.538698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.539464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.540855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.541647 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.700168 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:14.712691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f67bd681-3074-48fd-9b53-d83819c6cc62 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1670 microversion: 2.1 time: 0.193473 Jul 19 20:46:14.713823 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3198/6500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:14 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:14.738900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:14.739611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:14.749465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.750228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.751666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.752470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.806997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:46:14.925152 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bead8d24-8f10-4829-b168-88a8d13fcc27 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 204 len: 0 microversion: 2.1 time: 0.189823 Jul 19 20:46:14.926558 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3303/6501] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:46:14 2022] DELETE /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:46:14.936969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:14.937598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:14.944553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.945040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:14.946186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:14.946881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:15.139389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:15.149789 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e0caf16e-9e4e-4452-9402-6d4d069ab9d5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1676 microversion: 2.1 time: 0.218088 Jul 19 20:46:15.150591 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3199/6502] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:14 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:15.256287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-407c66fc-0d9f-4028-8c12-e022119639be req-ed3674c5-2851-47e3-8394-906228aee599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:15.267331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-407c66fc-0d9f-4028-8c12-e022119639be req-ed3674c5-2851-47e3-8394-906228aee599 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:15.268762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-407c66fc-0d9f-4028-8c12-e022119639be req-ed3674c5-2851-47e3-8394-906228aee599 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:15.286317 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-407c66fc-0d9f-4028-8c12-e022119639be req-ed3674c5-2851-47e3-8394-906228aee599 service nova] Creating event network-vif-plugged:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:46:15.291911 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-407c66fc-0d9f-4028-8c12-e022119639be req-ed3674c5-2851-47e3-8394-906228aee599 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040654 Jul 19 20:46:15.292624 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3304/6503] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:16.175539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:16.176358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:16.184328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:16.184806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:16.185718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:16.186180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:16.241851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:16.350735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:16.362097 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8bbf15fb-f7c5-4362-9b9a-6a3db0b19d67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1676 microversion: 2.1 time: 0.190654 Jul 19 20:46:16.362880 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3200/6504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:16 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:17.384864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:17.386110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:17.396245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:17.396962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:17.399318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:17.399318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:17.497701 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:17.511211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cccf70b1-9432-47a2-a8ea-0cec79a7f28b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 200 len: 1608 microversion: 2.1 time: 0.133652 Jul 19 20:46:17.512541 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3305/6505] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:17 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 1608 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:17.671418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-634ce729-0c72-4c85-a159-2b0495f289a7 req-7d29e921-39f6-45ca-bbcc-39f9536e4ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d275c8d-e7c7-478d-8757-f221a55f803c", "name": "network-vif-deleted", "tag": "dc7cc63e-d269-4780-8c66-575a6ebf8bb9"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:17.681697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-634ce729-0c72-4c85-a159-2b0495f289a7 req-7d29e921-39f6-45ca-bbcc-39f9536e4ee3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:17.682248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-634ce729-0c72-4c85-a159-2b0495f289a7 req-7d29e921-39f6-45ca-bbcc-39f9536e4ee3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:17.699260 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-634ce729-0c72-4c85-a159-2b0495f289a7 req-7d29e921-39f6-45ca-bbcc-39f9536e4ee3 service nova] Creating event network-vif-deleted:dc7cc63e-d269-4780-8c66-575a6ebf8bb9 for instance 3d275c8d-e7c7-478d-8757-f221a55f803c on n-h2-843834-3 Jul 19 20:46:17.705453 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-634ce729-0c72-4c85-a159-2b0495f289a7 req-7d29e921-39f6-45ca-bbcc-39f9536e4ee3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037758 Jul 19 20:46:17.706135 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3201/6506] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:18.536889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:18.537648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:18.546495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:18.547169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:18.548316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:18.548882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:18.570013 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c HTTP/1.1 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '3d275c8d-e7c7-478d-8757-f221a55f803c'} Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:18.573646 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cf733747-bd1c-4fb4-a7b3-04e14deeec64 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 404 len: 111 microversion: 2.1 time: 0.044040 Jul 19 20:46:18.579103 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3306/6507] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:18 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:46:18.597068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:18.598400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:18.607298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:18.608179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:18.609308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:18.609999 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:18.629800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c HTTP/1.1 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '3d275c8d-e7c7-478d-8757-f221a55f803c'} Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:46:18.631774 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61adfcf8-2254-4988-998a-243601ff93de tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 404 len: 111 microversion: 2.1 time: 0.042889 Jul 19 20:46:18.637248 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3202/6508] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:18 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:46:18.707884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-245613875", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "46755e2f-5c01-439a-a230-931b1405f1c8"}], "security_groups": [{"name": "tempest-securitygroup--1328016688"}], "key_name": "tempest-keypair-994093621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:18.840190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] validate_networks() for [('46755e2f-5c01-439a-a230-931b1405f1c8', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:46:19.286780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:46:19.287251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:46:19.287739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:46:19.288133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:46:19.288577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:46:19.300698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:19.301196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:19.302136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:19.302616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:19.323295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:46:19.330989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:46:19.346874 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:46:19.349339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:46:19.403315 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57b25893-1825-45cf-b217-d63a31fbfef1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702473 Jul 19 20:46:19.404271 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3307/6509] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:46:19.420568 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5711893e-8cb6-4802-bdb6-9cec6e76be1f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:19.422020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5711893e-8cb6-4802-bdb6-9cec6e76be1f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:19.509799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5711893e-8cb6-4802-bdb6-9cec6e76be1f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:19.519213 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5711893e-8cb6-4802-bdb6-9cec6e76be1f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1237 microversion: 2.1 time: 0.106979 Jul 19 20:46:19.519795 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3203/6510] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:19 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:20.543487 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:20.545961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:20.564593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:20.565807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:20.569056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:20.570057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:20.687896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:20.698202 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dafc5859-8dfc-43d3-a592-9ef8e91571a8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1307 microversion: 2.1 time: 0.163462 Jul 19 20:46:20.699084 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3308/6511] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:20 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:21.719379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:21.721390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:21.734512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:21.735256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:21.736539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:21.737317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:22.007704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:22.017324 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-521d1ca0-1c26-4564-b5a2-974293fa5296 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.303464 Jul 19 20:46:22.017942 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3204/6512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:21 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:22.415154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-4ace3af8-650b-4731-95d3-bf710106cb4c req-29dcf92c-e9b3-490f-8e0f-ec63bdace5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:22.435459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ace3af8-650b-4731-95d3-bf710106cb4c req-29dcf92c-e9b3-490f-8e0f-ec63bdace5ff service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:22.436281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-4ace3af8-650b-4731-95d3-bf710106cb4c req-29dcf92c-e9b3-490f-8e0f-ec63bdace5ff service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:22.456158 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-4ace3af8-650b-4731-95d3-bf710106cb4c req-29dcf92c-e9b3-490f-8e0f-ec63bdace5ff service nova] Creating event network-changed:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:46:22.462558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-4ace3af8-650b-4731-95d3-bf710106cb4c req-29dcf92c-e9b3-490f-8e0f-ec63bdace5ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055334 Jul 19 20:46:22.464124 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3309/6513] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:23.041115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:23.042618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:23.056398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:23.057228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:23.058698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:23.059559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:23.399959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:23.410484 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a2d748c-e858-46c2-90a6-dc24405a3587 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.376861 Jul 19 20:46:23.411579 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3205/6514] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:23 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:24.432266 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:24.433010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:24.440194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:24.440785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:24.441679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:24.442226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:24.601011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:24.611042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-711236ce-c4c6-4830-87e0-6bbdaed47571 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.184599 Jul 19 20:46:24.611934 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3310/6515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:24 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:25.639330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:25.640217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:25.649483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:25.650286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:25.651367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:25.651975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:25.858211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:25.866612 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-875648eb-c689-451f-8ebc-6852ed3a3baf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.232347 Jul 19 20:46:25.867454 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3206/6516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:25 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:26.886157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:26.886806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:26.894969 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:26.895445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:26.896258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:26.896809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:27.051668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:27.060608 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-657a02c8-b2e5-40c9-84b4-038ba3120d21 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.178926 Jul 19 20:46:27.061225 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3311/6517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:26 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:27.666180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-df75b0de-712e-4be2-b93f-f1c9680b05f5 req-7d04c051-2ce3-44b5-9888-1ca0ed123558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-plugged", "status": "completed", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:27.682435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-df75b0de-712e-4be2-b93f-f1c9680b05f5 req-7d04c051-2ce3-44b5-9888-1ca0ed123558 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:27.683480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-df75b0de-712e-4be2-b93f-f1c9680b05f5 req-7d04c051-2ce3-44b5-9888-1ca0ed123558 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:27.706800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-df75b0de-712e-4be2-b93f-f1c9680b05f5 req-7d04c051-2ce3-44b5-9888-1ca0ed123558 service nova] Creating event network-vif-plugged:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:46:27.716752 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-df75b0de-712e-4be2-b93f-f1c9680b05f5 req-7d04c051-2ce3-44b5-9888-1ca0ed123558 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056835 Jul 19 20:46:27.718122 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3207/6518] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:28.078972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:28.079729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:28.088058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:28.088526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:28.089396 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:28.089830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:28.251631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:28.265622 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9467c24f-b285-4a50-bffc-9988327d5e93 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1363 microversion: 2.1 time: 0.190496 Jul 19 20:46:28.267022 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3312/6519] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:28 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:29.299824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:29.301111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:29.312730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:29.313548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:29.314942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:29.315700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:29.488201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:46:29.501956 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a43c981-17fc-4cf3-a141-c16f2773e626 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1551 microversion: 2.1 time: 0.211237 Jul 19 20:46:29.503062 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3208/6520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:46:29 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1551 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:29.533563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:29.534442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:46:29.538948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:29.540040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:29.550850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:29.551671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:29.553089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:29.553930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:29.687434 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7465f04f-d249-4f32-b4db-61ba81a856c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161436 Jul 19 20:46:29.688138 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3313/6521] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 19 20:46:29 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:30.786987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-783b826c-18dc-4471-a396-abd8ee2d5abe req-45b66862-f95f-4291-9911-b5a389b73d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:30.790815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:30.802091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-783b826c-18dc-4471-a396-abd8ee2d5abe req-45b66862-f95f-4291-9911-b5a389b73d8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:30.802956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-783b826c-18dc-4471-a396-abd8ee2d5abe req-45b66862-f95f-4291-9911-b5a389b73d8d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:30.820778 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-783b826c-18dc-4471-a396-abd8ee2d5abe req-45b66862-f95f-4291-9911-b5a389b73d8d service nova] Creating event network-changed:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:46:30.827354 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-783b826c-18dc-4471-a396-abd8ee2d5abe req-45b66862-f95f-4291-9911-b5a389b73d8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043832 Jul 19 20:46:30.828071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3209/6522] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:47:07.240611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.241741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.246891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:07.247603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:07.255896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.256381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.257237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.257574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.418808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:07.433259 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f2a4262-434c-40e5-ae12-dd6c3fce82c8 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1670 microversion: 2.1 time: 0.194439 Jul 19 20:47:07.434280 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3314/6523] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:07 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1670 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:07.460504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.462442 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=66 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.471299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6903aad3-6108-4451-a0ac-614fef98459d"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:07.473486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:07.487007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.487790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.489205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.490007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.787832 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d37fd50e-439b-481e-82b5-e2d430a17caf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331014 Jul 19 20:47:07.788766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3210/6524] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:47:07 2022] POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:20.098719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:20.099841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:20.103340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:20.104090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:20.111688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.112158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.112964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.113414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.152868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:20.160967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 20:47:20.169489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:47:20.169910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:47:20.170387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:47:20.170799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:47:20.171249 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:47:20.246789 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-42b69322-9d1a-4153-a247-8511f6f6d339 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/action" status: 202 len: 0 microversion: 2.1 time: 0.153043 Jul 19 20:47:20.250563 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3315/6525] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:47:20 2022] POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:47:20.257778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:20.259732 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:20.267757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:20.268814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:20.282840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.283765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.285089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:20.285859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:20.845495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:20.854497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-db1a6694-8573-4303-ac13-0b760d340747 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1725 microversion: 2.1 time: 0.600376 Jul 19 20:47:20.855146 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3211/6526] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:20 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1725 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:21.875196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:21.876045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:21.883521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:21.883982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:21.884819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:21.885268 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:22.302037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:22.313399 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8043a7f-633c-4d5f-9bc2-f5f403a5ab0d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1725 microversion: 2.1 time: 0.443760 Jul 19 20:47:22.314009 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3316/6527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:21 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1725 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:23.336669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:23.337721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:23.350781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:23.351613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:23.353009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:23.353828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:23.543462 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:23.553253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b905551-0e87-448e-ad51-2e5427555adc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.224207 Jul 19 20:47:23.553875 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3212/6528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:23 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:24.573016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.573763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:24.581938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:24.582407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:24.583350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:24.583827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:24.762212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:24.771394 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ff2bc6a1-2042-4e29-ae29-bd5fb2beb8e9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.203168 Jul 19 20:47:24.772014 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3317/6529] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:24 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:25.791057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:25.792136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:25.800345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:25.800815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:25.801640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:25.802086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:25.966276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:25.975808 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2876dbd2-7275-49a1-be68-720581fd55aa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.189955 Jul 19 20:47:25.976465 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3213/6530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:25 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:26.996125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.997721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:27.007131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:27.007739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:27.008664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:27.009305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:27.192134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:27.202343 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4ff22a09-c37f-4a2b-b090-ee3bccb6a192 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.210973 Jul 19 20:47:27.202979 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3318/6531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:26 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:28.221186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:28.222336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:28.232156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:28.232693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:28.233639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:28.234136 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:28.392707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:28.403044 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d2611afa-3b54-4c98-b4e5-2613a8cd85c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.186460 Jul 19 20:47:28.403683 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3214/6532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:28 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:29.231958 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:47:29.232678 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:47:29.404350 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:47:29.405171 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:47:29.421876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:29.422523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:29.431152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:29.431636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:29.432450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:29.432893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:29.597970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:29.607177 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a48029a-2aa9-43de-8558-c2ed5681847d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.189516 Jul 19 20:47:29.607795 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3319/6533] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:29 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:30.626537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:30.627216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:30.635659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:30.636123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:30.637246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:30.637738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:30.793573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:30.806774 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55a8b508-5c2f-4d6e-881b-23c6f867f7c9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.184634 Jul 19 20:47:30.807595 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3215/6534] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:30 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:31.825852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:31.826585 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:31.835203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:31.835795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:31.836632 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:31.837133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:32.020042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:32.029848 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0b625b3d-c9b4-45c3-8bc3-27cb375b739b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.208269 Jul 19 20:47:32.030472 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3320/6535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:31 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:33.048882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:33.049473 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:33.058412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:33.058730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:33.059694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:33.060175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:33.233306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:33.243300 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6fc3aab-c22a-4b03-85e4-83e96a74614f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.198432 Jul 19 20:47:33.243925 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3216/6536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:33 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:34.262463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:34.263232 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:34.271894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:34.272390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:34.273222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:34.273672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:34.433570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:34.443157 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8ee209e8-f72f-457c-824a-7235cc829d72 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.185014 Jul 19 20:47:34.443802 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3321/6537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:34 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:35.462009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:35.463050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:35.472723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:35.473327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:35.474339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:35.474884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:35.650093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:35.659677 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b59f5077-08c4-4f68-81e2-e7ec6ea18567 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.201887 Jul 19 20:47:35.660335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3217/6538] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:35 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:36.685072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:36.686182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:36.700538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:36.701800 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:36.703309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:36.704116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:36.908561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:36.919816 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f789b0b6-626a-4744-b1dd-ffb183981baa tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1730 microversion: 2.1 time: 0.242451 Jul 19 20:47:36.920565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3322/6539] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:36 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:37.419932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-unplugged", "status": "completed", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:37.438383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.439233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:37.463494 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] Creating event network-vif-unplugged:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h2-843834-3 Jul 19 20:47:37.475617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:37.494114 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-94c90dad-f15c-41b4-9b8d-4e389ae3fce2 req-4700e4b9-e794-4617-a69b-d3bbf07016c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081519 Jul 19 20:47:37.495055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3218/6540] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:37.942328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:37.943269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:37.952752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.953221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:37.954069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:37.954515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:38.144617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:38.154169 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b98abd0-ef14-412c-bea7-b2153fbd4763 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1729 microversion: 2.1 time: 0.216585 Jul 19 20:47:38.155159 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3323/6541] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:37 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:39.186694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:39.187956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:39.199268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:39.200033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:39.201131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:39.201633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:39.412576 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:39.427432 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b29e60d-984b-4034-bd2c-b5437e43af97 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.249653 Jul 19 20:47:39.428309 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3219/6542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:39 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:39.512509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:39.525088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:39.525623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:39.542006 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] Creating event network-changed:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h2-843834-3 Jul 19 20:47:39.549696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:39.564798 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2674a794-9301-4288-80c6-43bc05e8f8dc req-310d8d24-520e-4ba9-a1a6-c8279545ce8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056783 Jul 19 20:47:39.565676 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3324/6543] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:40.451340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:40.452571 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:40.465864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:40.466718 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.468306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:40.469122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:40.643615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:40.659214 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-083dd675-e26e-4629-b581-320e2f4a9136 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.215967 Jul 19 20:47:40.660260 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3220/6544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:40 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:41.680245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:41.681104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:41.689037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:41.689433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:41.690563 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:41.691133 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:41.855253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:41.865438 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8dc8e619-f148-4205-b0b5-79a1a79e3aaf tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.191002 Jul 19 20:47:41.866245 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3325/6545] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:41 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:42.888390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:42.890477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:42.903774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:42.904496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:42.905840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:42.906585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:43.097527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:43.107408 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0d8a84e1-f588-42ad-995b-e59ab7fd028f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.226450 Jul 19 20:47:43.108049 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3221/6546] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:42 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:44.128919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:44.129783 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:44.139163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.139630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.140456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:44.141178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:44.353084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:44.361927 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ccf20f6e-59f8-467c-b6be-fb1b2a5f90b3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.238598 Jul 19 20:47:44.362568 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3326/6547] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:44 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:45.389514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:45.390671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:45.399317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.399783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.400600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:45.401051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:45.599152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:45.608942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-23bcdd92-444a-4f09-87c1-06f1c70fb413 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.224024 Jul 19 20:47:45.609717 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3222/6548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:45 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:46.629541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:46.630198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:46.638937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:46.639391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:46.640193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:46.640635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:46.804088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:46.814281 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ecbb65c3-dcde-43ce-9f60-4b62587e46ad tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.188721 Jul 19 20:47:46.815397 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3327/6549] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:46 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:47.834509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:47.835257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:47.843028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:47.843511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:47.844329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:47.844786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:48.022366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:48.032704 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e24bae52-eaab-45f0-810b-8de2ee02465e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.202293 Jul 19 20:47:48.033397 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3223/6550] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:47 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:49.051467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:49.052522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:49.061525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:49.061943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:49.063101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:49.063708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:49.252037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:49.260917 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fa5968b8-f21f-4752-ab6e-f8ffd4ef125f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.213597 Jul 19 20:47:49.261803 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3328/6551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:49 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:50.280004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:50.280748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:50.283652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:50.290149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:50.290310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:50.291188 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:50.291949 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:50.297054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=78 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:50.444543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:50.453882 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-696cf5c8-34f7-4798-821e-413ef4e4e7a1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.178291 Jul 19 20:47:50.454600 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3224/6552] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:50 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:51.472475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:51.473091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:51.476383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=33 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:51.483151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:51.483751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:51.484650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:51.485302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:51.488888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:51.688286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:51.704094 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03ecc802-bfdc-4b09-a0f7-78900bc457c3 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1727 microversion: 2.1 time: 0.235042 Jul 19 20:47:51.705667 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3329/6553] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:51 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:52.723299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:52.723987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:52.732945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:52.734201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:52.735172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:52.735932 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:52.902733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:52.912892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-65bc8ceb-51fd-449a-8dd5-85a254c5afbc tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1724 microversion: 2.1 time: 0.193890 Jul 19 20:47:52.913793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3225/6554] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:52 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:52.936200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:52.937117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:52.948489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:52.948942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:52.949775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:52.950225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:52.999175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:52.999532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:53.000327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:53.000781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:53.024157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for project 1412ab5ced1547888e42b4265c317b76. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:47:53.030236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Getting quotas for user 22d45b53dc814bc6ae7232366d367cc6 and project 1412ab5ced1547888e42b4265c317b76. Resources: {'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:47:53.157066 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-188ab37b-620c-41d0-8885-3c757e458ed4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/action" status: 202 len: 0 microversion: 2.1 time: 0.229350 Jul 19 20:47:53.157968 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3330/6555] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:47:52 2022] POST /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:47:53.169357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:53.170320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:53.179839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:53.180463 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:53.181748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:53.182416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:53.389487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:53.399190 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b93ca158-ed65-49f1-b002-3f1eeafc208b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.235950 Jul 19 20:47:53.400008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3226/6556] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:53 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:53.851711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-plugged", "status": "completed", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:53.866434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:53.867172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:53.884480 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] Creating event network-vif-plugged:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h2-843834-3 Jul 19 20:47:53.891545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:53.906430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1b1961b7-c7d9-4e2d-90e0-ef357c0c9088 req-df9c83b7-5d1b-4512-8666-88b41d8b048d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063112 Jul 19 20:47:53.908019 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3331/6557] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:54.419053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:54.419665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:54.428232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:54.428686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:54.429525 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:54.429983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:54.597102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:54.606664 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9dd59c7f-be5a-4249-974c-e74763fd95f5 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.192517 Jul 19 20:47:54.607332 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3227/6558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:54 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:55.629163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:55.630013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:55.639046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:55.639682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:55.640621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:55.641165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:55.809007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:55.818314 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f750e26-d70b-4ad3-8111-cd8cdd7372c4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.196138 Jul 19 20:47:55.818939 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3332/6559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:55 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:47:56.838447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:56.839643 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:56.847946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:56.848410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:56.849253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:56.849761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:57.073053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:57.090554 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4befbd41-d460-4f6e-b5c3-55f4bb9f2166 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.256571 Jul 19 20:47:57.091721 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3228/6560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:56 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:58.119136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:58.119136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:58.132847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:58.133669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:58.135392 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:58.136196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:58.320724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:58.329781 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18dafa3b-7318-4304-9ea9-9ebee55091f7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.217768 Jul 19 20:47:58.330394 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3333/6561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:58 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:59.350721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:59.351857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:47:59.363691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:59.364404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:59.365736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:59.366501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:59.721408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:47:59.735946 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5137fc13-5189-43e9-920f-d6b11c73bcfe tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.390424 Jul 19 20:47:59.737440 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3229/6562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:47:59 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:59.770187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-unplugged", "status": "completed", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:59.788279 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:59.789294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:59.811888 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] Creating event network-vif-unplugged:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:47:59.823729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:47:59.846179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ca2cc7b2-b880-4899-86ef-4bffdffd19b9 req-4c6d3e67-a4b0-4ee4-9b93-7a7b6c58e4cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080235 Jul 19 20:47:59.849750 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3334/6563] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:00.762700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:00.763454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:00.771412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:00.771879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:00.772695 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:00.773144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:01.086150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:01.097177 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fde04b3a-062d-4afe-8397-6b578b7ae369 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.338810 Jul 19 20:48:01.097970 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3230/6564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:00 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:01.903420 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:01.913065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:01.913523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:01.935757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] Creating event network-changed:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:48:01.947750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 20:48:01.971238 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-eb704da3-c46d-4486-9840-26c3b7ad41ae req-92ff291f-442f-49f8-a1a4-cea86546f7cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072901 Jul 19 20:48:01.972656 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3335/6565] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:02.117308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:02.118712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:02.127241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:02.128201 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:02.129289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:02.129982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:02.720666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:02.741790 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6651ec4-1c37-43f3-901b-b8ae5b99981e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.628233 Jul 19 20:48:02.743482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3231/6566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:02 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:03.766732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:03.767666 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:03.771888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:03.785470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:03.786293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:03.788529 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:03.789260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:04.047242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:04.057763 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4d28217-f5b9-4088-afa4-1f90adeeb5b4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.298616 Jul 19 20:48:04.058578 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3336/6567] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:03 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:05.087873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:05.088548 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:05.099818 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.100650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.102030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:05.102514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:05.351015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:05.362676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43fa0e38-2c1c-4849-bba4-275c753f94c1 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.280735 Jul 19 20:48:05.363948 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3232/6568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:05 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:06.391073 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:06.391996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:06.402041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.402639 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.403775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:06.404340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:06.615203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:06.626036 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f78545ed-10be-4616-9766-3096f50db648 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.239435 Jul 19 20:48:06.626793 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3337/6569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:06 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:07.645870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:07.646482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:07.655618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:07.656152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:07.657037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:07.657762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:07.830761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:07.843123 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ec01dba-92d5-4170-b12b-d220bf157d5f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.201531 Jul 19 20:48:07.844201 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3233/6570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:07 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:08.862973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:08.863672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:08.872091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:08.872603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:08.873447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:08.873932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:09.051052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:09.062790 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4911844b-f3e8-494a-a981-685136a547f9 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.203874 Jul 19 20:48:09.064184 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3338/6571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:08 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:10.082624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:10.083397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:10.094187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:10.094800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:10.095843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:10.096510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:10.308212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:10.318237 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9df40ae-8fc9-4a96-a08a-97a34888e56d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.239747 Jul 19 20:48:10.318965 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3234/6572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:10 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:11.339348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:11.340363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:11.349086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.349709 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.350644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.351251 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.509769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:11.518448 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9a543e6-babe-4489-9f3c-d7a4594f3a6a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.185498 Jul 19 20:48:11.519113 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3339/6573] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:11 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:12.538109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:12.538835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:12.547736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:12.548195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:12.549041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:12.549488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:12.711985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:12.726718 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3222c975-c536-4f07-9443-dfdcdf08d28f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.193556 Jul 19 20:48:12.727814 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3235/6574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:12 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:13.746383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:13.747107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:13.755042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:13.755827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:13.756858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:13.757399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:13.926021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:13.935721 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b5eab49-dcc0-4a33-9dba-a871d295ed80 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1723 microversion: 2.1 time: 0.193765 Jul 19 20:48:13.936445 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3340/6575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:13 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:14.955149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:14.955923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:14.964633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:14.965175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:14.966117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:14.966631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.142574 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:15.152091 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2a978be1-4a4f-49f2-b172-92d4d0385a67 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1716 microversion: 2.1 time: 0.201184 Jul 19 20:48:15.152723 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3236/6576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:14 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1716 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:15.173044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:15.173780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:15.182776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.183475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.184326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.184788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.336408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:15.345791 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-39451ae7-e593-43d7-80d7-c6f4d253a973 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1716 microversion: 2.1 time: 0.177250 Jul 19 20:48:15.346413 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3341/6577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:15 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:15.362728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:15.363411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:15.371260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.372080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.372842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.373390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.535334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:15.545528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1904c09e-bf6e-41a1-9666-61535c193d83 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1716 microversion: 2.1 time: 0.186697 Jul 19 20:48:15.546144 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3237/6578] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:15 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1716 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:15.562488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:15.563098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:15.570493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.570973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.571812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.572259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.601257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:48:15.643303 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.724995 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fc5a04b5-493c-4cfd-b880-c0f566a1000b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 204 len: 0 microversion: 2.1 time: 0.166288 Jul 19 20:48:15.725730 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3342/6579] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:15 2022] DELETE /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:48:15.734659 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:15.735324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:15.742161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.742635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.743509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:15.743965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:15.911031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:15.920593 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c95bad4b-2030-41d8-8bc7-c210582dad55 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1722 microversion: 2.1 time: 0.189924 Jul 19 20:48:15.921214 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3238/6580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:15 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:16.233171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d2c2533a-2ba3-4e72-874b-a49af15fa4eb req-7f6142e1-1bc8-4a6f-b6c2-742019f14d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-plugged", "status": "completed", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:16.251875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d2c2533a-2ba3-4e72-874b-a49af15fa4eb req-7f6142e1-1bc8-4a6f-b6c2-742019f14d2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:16.252715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d2c2533a-2ba3-4e72-874b-a49af15fa4eb req-7f6142e1-1bc8-4a6f-b6c2-742019f14d2d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:16.275912 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d2c2533a-2ba3-4e72-874b-a49af15fa4eb req-7f6142e1-1bc8-4a6f-b6c2-742019f14d2d service nova] Creating event network-vif-plugged:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:48:16.285641 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d2c2533a-2ba3-4e72-874b-a49af15fa4eb req-7f6142e1-1bc8-4a6f-b6c2-742019f14d2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059476 Jul 19 20:48:16.287229 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3343/6581] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:16.940469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:16.941504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:16.950480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:16.951007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:16.951925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:16.952422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:17.122358 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:17.132113 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d4752d76-b347-4e46-a460-80223b2cbfd0 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1722 microversion: 2.1 time: 0.195706 Jul 19 20:48:17.132934 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3239/6582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:16 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:18.153642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:18.154650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:18.164290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:18.165037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:18.166147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:18.166801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:18.288436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:18.305324 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc6d5ee9-cf42-436c-b6bb-b56e4fcb27f4 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1654 microversion: 2.1 time: 0.157532 Jul 19 20:48:18.318949 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3344/6583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:18 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:18.591846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2663d4f7-05d5-48dc-a5ed-0e9d8bd7b872 req-fb333b87-b9ac-462f-b194-fa31eafd7239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c", "name": "network-vif-deleted", "tag": "31c5258b-6434-4ac8-9a6c-1a1d4033712c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:18.609801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2663d4f7-05d5-48dc-a5ed-0e9d8bd7b872 req-fb333b87-b9ac-462f-b194-fa31eafd7239 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:18.610545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2663d4f7-05d5-48dc-a5ed-0e9d8bd7b872 req-fb333b87-b9ac-462f-b194-fa31eafd7239 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:18.626238 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2663d4f7-05d5-48dc-a5ed-0e9d8bd7b872 req-fb333b87-b9ac-462f-b194-fa31eafd7239 service nova] Creating event network-vif-deleted:31c5258b-6434-4ac8-9a6c-1a1d4033712c for instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c on n-h1-843834-3 Jul 19 20:48:18.634269 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2663d4f7-05d5-48dc-a5ed-0e9d8bd7b872 req-fb333b87-b9ac-462f-b194-fa31eafd7239 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051652 Jul 19 20:48:18.635054 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3240/6584] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:19.338906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:19.339954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:19.352721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:19.353927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:19.355422 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:19.356478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:19.477179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:19.493341 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4f3f3a89-e835-456b-a464-998b1b176236 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1368 microversion: 2.1 time: 0.163969 Jul 19 20:48:19.494005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3345/6585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:19 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:20.524970 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:20.526351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:20.530037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:20.538684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:20.539322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:20.540172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:20.540630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:20.544435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=97 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:20.640717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:20.654900 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-453201fc-2471-473e-9b5a-f0216e0a47cd tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1368 microversion: 2.1 time: 0.135569 Jul 19 20:48:20.656161 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3241/6586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:20 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:21.677357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:21.678642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:21.682900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:21.692060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:21.692677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:21.693809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:21.694434 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:21.778692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:21.788621 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8eea582f-9a0f-4c9a-b7aa-f77dc381cda6 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1368 microversion: 2.1 time: 0.115904 Jul 19 20:48:21.790005 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3346/6587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:21 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:22.815246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:22.816304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:22.825845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:22.826435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:22.827399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:22.827948 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:22.932207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:22.946738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61641e3a-9041-4d74-8fbe-1a5c8d0af227 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1368 microversion: 2.1 time: 0.136190 Jul 19 20:48:22.951878 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3242/6588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:22 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:23.974640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:23.975616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:23.988294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:23.989116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:23.990616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:23.991406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:24.054847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:24.055816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:24.056576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lazy-loading 'fault' on Instance uuid 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:48:24.112885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d45b53dc814bc6ae7232366d367cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412ab5ced1547888e42b4265c317b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:24.128242 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53dd69aa-5883-4a0a-bcc6-3f633bef6db7 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 200 len: 1373 microversion: 2.1 time: 0.159882 Jul 19 20:48:24.129318 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3347/6589] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:23 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:25.150500 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:25.151352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:25.159409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.159883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.160708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.161169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.176858 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c HTTP/1.1 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c'} Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:25.178626 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5f2f1140-c782-4005-8b1b-8e2234d58e30 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 404 len: 111 microversion: 2.1 time: 0.034170 Jul 19 20:48:25.186068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3243/6590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:25 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:25.256106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:25.257109 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:25.264888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.265348 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.266153 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:25.266602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:25.281261 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-volume_attachments HTTP/1.1 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c'} Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:25.283124 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a3feea1d-00c6-4f0a-aba0-ec8ecdf41096 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033194 Jul 19 20:48:25.290071 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3348/6591] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:48:25 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.689968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.690591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.699339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.699928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.700773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.701220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.718377 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c HTTP/1.1 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c'} Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.720323 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35e44703-b99f-417f-b803-7c4f0fb880cb tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 404 len: 111 microversion: 2.1 time: 0.036171 Jul 19 20:48:28.728986 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3244/6592] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:28 2022] DELETE /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.733517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.734536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.744343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.744847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.745692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.746142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.766240 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c HTTP/1.1 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c'} Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.768293 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-561f6a42-9ec2-47c1-9eda-e6f234cd9597 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c" status: 404 len: 111 microversion: 2.1 time: 0.040847 Jul 19 20:48:28.776366 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3349/6593] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:28 2022] GET /compute/v2.1/servers/1ce3f4cc-dd97-4d8b-9edf-f3ff8b445c4c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:48:28.783128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.783646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.790676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.791226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.792381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.792946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.809057 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c HTTP/1.1 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '3d275c8d-e7c7-478d-8757-f221a55f803c'} Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.810711 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a573434b-82d2-441f-a771-7b880f1f651e tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 404 len: 111 microversion: 2.1 time: 0.033592 Jul 19 20:48:28.816274 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3245/6594] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:28 2022] DELETE /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.823700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.824353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 3d275c8d-e7c7-478d-8757-f221a55f803c] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.831168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.831617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.832413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.832892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.852025 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c HTTP/1.1 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '3d275c8d-e7c7-478d-8757-f221a55f803c'} Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.853622 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 3d275c8d-e7c7-478d-8757-f221a55f803c could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68f195f6-3f12-4e16-b688-c45dff245a5d tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c" status: 404 len: 111 microversion: 2.1 time: 0.036902 Jul 19 20:48:28.858565 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3350/6595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:28 2022] GET /compute/v2.1/servers/3d275c8d-e7c7-478d-8757-f221a55f803c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.865274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.865801 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.873705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.874200 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.875103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.875558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.892114 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 HTTP/1.1 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '97f84894-3fbc-4610-b30f-662153c01336'} Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.893935 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c1ef53f3-80e4-477d-89b0-c60090bb8776 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 404 len: 111 microversion: 2.1 time: 0.034657 Jul 19 20:48:28.898395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3246/6596] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:28 2022] DELETE /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:48:28.906815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.907488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: 97f84894-3fbc-4610-b30f-662153c01336] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.915212 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.915685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.916534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.917127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.935383 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 HTTP/1.1 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '97f84894-3fbc-4610-b30f-662153c01336'} Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.937012 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance 97f84894-3fbc-4610-b30f-662153c01336 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a21cd101-727c-4761-aa7e-167cb1ff503a tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336" status: 404 len: 111 microversion: 2.1 time: 0.036864 Jul 19 20:48:28.941863 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3351/6597] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:28 2022] GET /compute/v2.1/servers/97f84894-3fbc-4610-b30f-662153c01336 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.949726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.950316 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:28.957404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.957867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.958699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:28.959371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:28.976232 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f HTTP/1.1 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c6f96e02-5a4c-4f82-8bac-dad1fc62299f'} Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:28.977989 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f524e962-379f-47eb-aa13-a61b78cf076b tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 404 len: 111 microversion: 2.1 time: 0.035012 Jul 19 20:48:28.984199 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3247/6598] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:48:28 2022] DELETE /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:28.994033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:28.994807 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] [instance: c6f96e02-5a4c-4f82-8bac-dad1fc62299f] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:29.002575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:29.003106 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:29.003994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:29.004460 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:29.021864 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] HTTP exception thrown: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Request method failure captured: Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f HTTP/1.1 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xcmmR6VOGk-nBv03Z3LBXzTHOE4wxZcTKuuyTv-barUtWzLOqNGd1P2yourliIQxazVRaV5_Op3sPVnMS4ALcXDLXL273WqTVoR_x208vBTSYudXc-M6u3o8fLOQB0ebvUBromD-58gmdok-sk6O2d8Glhot78-12F6iHnAl1qsHyE Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1412ab5ced1547888e42b4265c317b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1412ab5ced1547888e42b4265c317b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 1412ab5ced1547888e42b4265c317b76 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1231236827 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 22d45b53dc814bc6ae7232366d367cc6 Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServerActionsTestJSON-1231236827-project Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'c6f96e02-5a4c-4f82-8bac-dad1fc62299f'} Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:48:29.023387 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Returning 404 to user: Instance c6f96e02-5a4c-4f82-8bac-dad1fc62299f could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8bf77048-134c-4edc-bf90-14ed8f05006f tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f" status: 404 len: 111 microversion: 2.1 time: 0.036368 Jul 19 20:48:29.027868 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3352/6599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:28 2022] GET /compute/v2.1/servers/c6f96e02-5a4c-4f82-8bac-dad1fc62299f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:29.034513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-31c6c469-cc9a-4b9b-add1-edbd521fcd96 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] Calling method '.version_select at 0x7f24008bde50>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:29.062427 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-31c6c469-cc9a-4b9b-add1-edbd521fcd96 tempest-ServerActionsTestJSON-1231236827 tempest-ServerActionsTestJSON-1231236827-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994093621" status: 202 len: 0 microversion: 2.1 time: 0.031564 Jul 19 20:48:29.063337 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3248/6600] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 19 20:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994093621 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:48:41.416959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=15 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:41.418263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:41.594501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2128717963", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "ba70bc80-d366-482d-aa1e-e70ec1413308"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:41.672326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] validate_networks() for [('ba70bc80-d366-482d-aa1e-e70ec1413308', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:48:42.219623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:48:42.220308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:48:42.221316 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:48:42.222020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:48:42.222691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:48:42.234692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.235619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.236726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:42.237378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:42.259599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Getting quotas for project 59a87a1dac5142649c23cdaafcb18b97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:48:42.266015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Getting quotas for user 6af5ff46355b401383f79d7e78ef5184 and project 59a87a1dac5142649c23cdaafcb18b97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:48:42.280646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:48:42.283043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:48:42.334665 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ab7745d4-54d8-4ba9-8167-e71e4f8c12c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927450 Jul 19 20:48:42.335836 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3353/6601] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:48:42.347046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=21 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:42.348410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:42.353205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0700e676-f03e-40a2-bb60-ea2d997cfe77 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:42.354038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0700e676-f03e-40a2-bb60-ea2d997cfe77 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:42.453340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0700e676-f03e-40a2-bb60-ea2d997cfe77 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:42.465394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0700e676-f03e-40a2-bb60-ea2d997cfe77 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1217 microversion: 2.1 time: 0.119773 Jul 19 20:48:42.467153 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3249/6602] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:42 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:43.497712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29f62b02-7d96-4ff6-91fb-d20f6bf8e06d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:43.500377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29f62b02-7d96-4ff6-91fb-d20f6bf8e06d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:43.635494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29f62b02-7d96-4ff6-91fb-d20f6bf8e06d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:43.651569 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29f62b02-7d96-4ff6-91fb-d20f6bf8e06d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1217 microversion: 2.1 time: 0.163778 Jul 19 20:48:43.652605 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3354/6603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:43 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:48:44.681705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a4956313-4a04-4fe1-bdd5-e70dc4639e6e tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:44.683368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a4956313-4a04-4fe1-bdd5-e70dc4639e6e tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:44.772214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a4956313-4a04-4fe1-bdd5-e70dc4639e6e tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:44.780343 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a4956313-4a04-4fe1-bdd5-e70dc4639e6e tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1217 microversion: 2.1 time: 0.105462 Jul 19 20:48:44.780951 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3250/6604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:44 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:45.802182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:45.803335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:45.816347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:45.817424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:45.818951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:45.820145 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:45.956071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:45.974016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-855b3977-8033-48bb-ae65-111bf4b191c8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1277 microversion: 2.1 time: 0.179092 Jul 19 20:48:45.975289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3355/6605] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:45 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:47.004619 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:47.007213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:47.022543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.023405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.024938 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.026282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.319384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:47.329223 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1d6afd3c-f189-4e73-8ce3-7547498c8a27 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.332513 Jul 19 20:48:47.329847 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3251/6606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:46 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:47.854484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-12aa6658-9553-45c7-af5e-d3542deedcd0 req-f716eb4a-d51c-45c6-9d22-2cead17b5c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4d0ae6-2da0-4343-9006-0f34c17bb8d1", "tag": "10f15cfa-8acd-4697-89b5-1ab4c14ed98e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:47.872425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-12aa6658-9553-45c7-af5e-d3542deedcd0 req-f716eb4a-d51c-45c6-9d22-2cead17b5c49 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:47.873445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-12aa6658-9553-45c7-af5e-d3542deedcd0 req-f716eb4a-d51c-45c6-9d22-2cead17b5c49 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:47.905372 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-12aa6658-9553-45c7-af5e-d3542deedcd0 req-f716eb4a-d51c-45c6-9d22-2cead17b5c49 service nova] Creating event network-changed:10f15cfa-8acd-4697-89b5-1ab4c14ed98e for instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 on n-h1-843834-3 Jul 19 20:48:47.916943 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-12aa6658-9553-45c7-af5e-d3542deedcd0 req-f716eb4a-d51c-45c6-9d22-2cead17b5c49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180258 Jul 19 20:48:47.917616 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3356/6607] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:48.347386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:48.348061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:48.357994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:48.358451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:48.359300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:48.359743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:48.519946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:48.528721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-92abf459-fddc-4b84-844a-2a081ad1db88 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.185320 Jul 19 20:48:48.529338 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3252/6608] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:48 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:49.548634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:49.549371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:49.556645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:49.557126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:49.557940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:49.558378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:49.886859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:49.899055 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb3156c0-8509-49d6-82a4-b8d35b5514ed tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.355667 Jul 19 20:48:49.900774 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3357/6609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:49 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:50.920113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:50.920973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:50.928971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:50.929505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:50.930365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:50.930860 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:51.112178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:51.123727 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-755025e3-f43e-4145-a691-1f2145a15b31 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.208459 Jul 19 20:48:51.124604 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3253/6610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:50 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:52.144733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:52.145440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:52.154166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:52.154630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:52.155571 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:52.156024 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:52.247603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:52.378009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:52.387068 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-82e874c6-d2ce-4fd8-addb-5ad715fc7a8b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.246433 Jul 19 20:48:52.387721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3358/6611] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:52 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:52.521003 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d92fbf23-21bf-4d70-b4ad-e380ab057b81 req-7b03f7e5-01d6-4c7b-b771-cd329e833841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4d0ae6-2da0-4343-9006-0f34c17bb8d1", "name": "network-vif-plugged", "status": "completed", "tag": "10f15cfa-8acd-4697-89b5-1ab4c14ed98e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:52.537769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d92fbf23-21bf-4d70-b4ad-e380ab057b81 req-7b03f7e5-01d6-4c7b-b771-cd329e833841 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:52.538223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d92fbf23-21bf-4d70-b4ad-e380ab057b81 req-7b03f7e5-01d6-4c7b-b771-cd329e833841 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:52.551242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d92fbf23-21bf-4d70-b4ad-e380ab057b81 req-7b03f7e5-01d6-4c7b-b771-cd329e833841 service nova] Creating event network-vif-plugged:10f15cfa-8acd-4697-89b5-1ab4c14ed98e for instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 on n-h1-843834-3 Jul 19 20:48:52.556972 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d92fbf23-21bf-4d70-b4ad-e380ab057b81 req-7b03f7e5-01d6-4c7b-b771-cd329e833841 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132685 Jul 19 20:48:52.557614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3254/6612] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:53.411975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:53.412823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:53.420949 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:53.421413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:53.422252 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:53.422691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:53.585188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:53.594041 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a067d784-cd3e-43eb-9401-bbcca88915e4 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1317 microversion: 2.1 time: 0.186208 Jul 19 20:48:53.594639 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3359/6613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:53 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:54.614955 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:54.615737 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:54.623736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:54.624345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:54.625298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:54.625800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:54.777514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.794892 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:54.804273 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a4f8db2-30cb-4487-a1f1-eb193260c252 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.195669 Jul 19 20:48:54.804886 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3255/6614] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:54 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:54.870583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339301880", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "ba70bc80-d366-482d-aa1e-e70ec1413308"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:54.883581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.955255 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] validate_networks() for [('ba70bc80-d366-482d-aa1e-e70ec1413308', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:48:55.425146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:48:55.425536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:48:55.426454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:48:55.426964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:48:55.427400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:48:55.438116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:55.438721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:55.439682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:55.440228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:55.462368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Getting quotas for project 59a87a1dac5142649c23cdaafcb18b97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:48:55.469125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Getting quotas for user 6af5ff46355b401383f79d7e78ef5184 and project 59a87a1dac5142649c23cdaafcb18b97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:48:55.484836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:48:55.487387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:48:55.538484 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a286d64-e072-4572-baae-978eff1ca033 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673548 Jul 19 20:48:55.539622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3360/6615] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:48:55.553578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dd936a2b-f52f-4abb-bf60-8378774663df tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:55.554668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dd936a2b-f52f-4abb-bf60-8378774663df tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:55.639332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dd936a2b-f52f-4abb-bf60-8378774663df tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:55.650887 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dd936a2b-f52f-4abb-bf60-8378774663df tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1217 microversion: 2.1 time: 0.104243 Jul 19 20:48:55.651861 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3256/6616] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:55 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:56.680403 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:56.681138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:56.689432 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:56.690022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:56.691179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:56.691970 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:56.776613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:56.791297 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-af325898-b781-4803-bc44-2446f8c912e3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1269 microversion: 2.1 time: 0.117040 Jul 19 20:48:56.803201 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3361/6617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:56 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:57.823603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:57.826491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:57.841374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:57.842540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:57.844165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:57.845817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:58.057661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:58.069118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2950721e-c402-4c65-8e23-82a5b57320eb tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.253788 Jul 19 20:48:58.071209 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3257/6618] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:57 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:58.990591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c6f36a68-21ce-4a42-9d8c-0c614156942f req-1ae4ba8f-0148-410d-8eda-ff2c320ba26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6c3a03-2d7f-4e9e-a7c7-0280303066fd", "tag": "d0e1a026-082d-4fec-a129-041a1deb6cf7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:59.001237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6f36a68-21ce-4a42-9d8c-0c614156942f req-1ae4ba8f-0148-410d-8eda-ff2c320ba26b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:59.002017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6f36a68-21ce-4a42-9d8c-0c614156942f req-1ae4ba8f-0148-410d-8eda-ff2c320ba26b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:59.019307 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c6f36a68-21ce-4a42-9d8c-0c614156942f req-1ae4ba8f-0148-410d-8eda-ff2c320ba26b service nova] Creating event network-changed:d0e1a026-082d-4fec-a129-041a1deb6cf7 for instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd on n-h2-843834-3 Jul 19 20:48:59.027510 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c6f36a68-21ce-4a42-9d8c-0c614156942f req-1ae4ba8f-0148-410d-8eda-ff2c320ba26b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147176 Jul 19 20:48:59.028721 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3362/6619] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:59.097635 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:59.098738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:48:59.109480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:59.110151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:59.111218 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:59.111756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:59.316986 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:48:59.331054 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-98ea1cbb-e8cf-4a57-af25-73ff42e00026 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.239562 Jul 19 20:48:59.332033 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3258/6620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:48:59 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:00.353654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.354555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:00.361558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:00.362017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:00.362838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:00.363321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:00.523062 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:00.532059 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0ed7865-53b4-47de-a918-4ad1c89d4d98 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.184105 Jul 19 20:49:00.532764 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3363/6621] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:01.550638 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.551495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:01.560131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:01.560614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:01.561439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:01.561918 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:01.721578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:01.730351 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e7874e11-b5f1-4924-8a2b-f088c34d5e8d tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.183908 Jul 19 20:49:01.731110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3259/6622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:01 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:02.749393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:02.750000 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:02.758418 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:02.758952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:02.759933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:02.760383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:02.919766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:02.929145 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-130f6d5f-47da-4350-8f32-a4b21743d3bf tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.184299 Jul 19 20:49:02.929887 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3364/6623] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:02 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:03.946690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:03.947437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:03.955031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:03.955509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:03.956325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:03.956809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:04.137783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:04.149170 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb1f4cca-c377-4f2c-a9c8-9d7f108f4152 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.206862 Jul 19 20:49:04.149783 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3260/6624] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:03 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:04.260765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-9739e849-e728-412c-bec4-54cb7be76aaa req-607dc003-e8ef-423b-b095-c00e3ddc5b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6c3a03-2d7f-4e9e-a7c7-0280303066fd", "name": "network-vif-plugged", "status": "completed", "tag": "d0e1a026-082d-4fec-a129-041a1deb6cf7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:04.272161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9739e849-e728-412c-bec4-54cb7be76aaa req-607dc003-e8ef-423b-b095-c00e3ddc5b25 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:04.272628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-9739e849-e728-412c-bec4-54cb7be76aaa req-607dc003-e8ef-423b-b095-c00e3ddc5b25 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:04.286719 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-9739e849-e728-412c-bec4-54cb7be76aaa req-607dc003-e8ef-423b-b095-c00e3ddc5b25 service nova] Creating event network-vif-plugged:d0e1a026-082d-4fec-a129-041a1deb6cf7 for instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd on n-h2-843834-3 Jul 19 20:49:04.294431 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-9739e849-e728-412c-bec4-54cb7be76aaa req-607dc003-e8ef-423b-b095-c00e3ddc5b25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037523 Jul 19 20:49:04.295899 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3365/6625] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:05.166942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:05.167612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:05.175068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:05.175533 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:05.176342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:05.176790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:05.335295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:05.344346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-212b278a-f061-4bf2-b64a-9b35797260c5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1317 microversion: 2.1 time: 0.182008 Jul 19 20:49:05.345071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3261/6626] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:05 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:06.360656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.361822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.367205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:06.368046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:06.377117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.377577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.378393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.378840 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.879833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:06.890049 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f373f4e-60c5-4ed7-89a5-ad9bfd993941 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1506 microversion: 2.1 time: 0.531157 Jul 19 20:49:06.890865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3366/6627] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:06 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:06.908424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:06.909167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:06.911329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.918542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.919065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.919889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:06.920339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:06.950668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:49:07.049962 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2f235a0-5d6f-4112-9364-03fcbe51f8ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 204 len: 0 microversion: 2.1 time: 0.145192 Jul 19 20:49:07.050803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3262/6628] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:06 2022] DELETE /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:49:07.060844 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:07.061578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:07.069283 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:07.070096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:07.071007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:07.071501 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:07.243679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:07.257634 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3737d7b-8edc-4b78-8c40-c210e44705a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1512 microversion: 2.1 time: 0.201328 Jul 19 20:49:07.258702 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3367/6629] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:07 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:08.283810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.284929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:08.294093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.294809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.295983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.296536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.480444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:08.494203 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1c80d454-dc7d-410b-b0aa-a3b34b4b7422 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1512 microversion: 2.1 time: 0.215271 Jul 19 20:49:08.495293 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3263/6630] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:08 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:09.042470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3bd77535-a1dc-473e-982d-10dea916665d req-11437778-2b3b-488e-982f-68d3662295b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6c3a03-2d7f-4e9e-a7c7-0280303066fd", "name": "network-vif-deleted", "tag": "d0e1a026-082d-4fec-a129-041a1deb6cf7"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:09.061910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bd77535-a1dc-473e-982d-10dea916665d req-11437778-2b3b-488e-982f-68d3662295b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.063057 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3bd77535-a1dc-473e-982d-10dea916665d req-11437778-2b3b-488e-982f-68d3662295b5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.097243 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3bd77535-a1dc-473e-982d-10dea916665d req-11437778-2b3b-488e-982f-68d3662295b5 service nova] Creating event network-vif-deleted:d0e1a026-082d-4fec-a129-041a1deb6cf7 for instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd on n-h2-843834-3 Jul 19 20:49:09.108934 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3bd77535-a1dc-473e-982d-10dea916665d req-11437778-2b3b-488e-982f-68d3662295b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075198 Jul 19 20:49:09.115120 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3368/6631] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:09.271863 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:49:09.272141 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:49:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:49:09.525771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:09.526857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:09.539446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.540288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.542379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.543286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.588099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:09.588577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:09.589015 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lazy-loading 'fault' on Instance uuid 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:49:09.653863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:09.667418 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e784a6ca-43e0-4b38-8fe3-0d44b5550ed6 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 200 len: 1307 microversion: 2.1 time: 0.148813 Jul 19 20:49:09.668117 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3264/6632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:09 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:10.687624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.688623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.696831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.697340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.698278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.698941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.715417 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd HTTP/1.1 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '2e6c3a03-2d7f-4e9e-a7c7-0280303066fd'} Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:10.717193 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 404 to user: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c13bef57-2e4e-428f-9773-f39c0f3c21d5 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 404 len: 111 microversion: 2.1 time: 0.037043 Jul 19 20:49:10.724494 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3369/6633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:10 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:10.730125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.730840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.740299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.740840 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.741911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.742402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.897761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:10.906842 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-35ce1d14-334a-4f08-8ffc-36ed48d14b22 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.181484 Jul 19 20:49:10.907617 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3265/6634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:10 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:10.924890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:10.925996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: ccc872cd-625f-4254-87a7-676201bab23d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.932661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/ccc872cd-625f-4254-87a7-676201bab23d/action HTTP/1.1 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 32 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: {"resize": {"flavorRef": "452"}} Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': 'ccc872cd-625f-4254-87a7-676201bab23d', 'body': {'resize': {'flavorRef': '452'}}} Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:10.934341 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 404 to user: Instance ccc872cd-625f-4254-87a7-676201bab23d could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-653af505-a75f-4ca0-b7ba-13911dd7e58b tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "POST /compute/v2.1/servers/ccc872cd-625f-4254-87a7-676201bab23d/action" status: 404 len: 111 microversion: 2.1 time: 0.015561 Jul 19 20:49:10.941544 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3370/6635] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:49:10 2022] POST /compute/v2.1/servers/ccc872cd-625f-4254-87a7-676201bab23d/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:10.949691 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.950813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.961846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.962660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:10.963850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:10.964660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.150831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.160656 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1fa7cf4b-f491-4cea-a477-a969766e6100 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.218892 Jul 19 20:49:11.161312 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3266/6636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:10 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:11.179053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.179681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.187777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.188235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.189043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.189481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.341728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.351256 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5405430-4cbe-45a1-bbc8-a7b87a021542 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.176162 Jul 19 20:49:11.352003 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3371/6637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:11.370716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d0bc200d-fc3f-4a6e-bdac-9aaa8304f360"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:11.372693 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.383709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.384515 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.385890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.386692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.395081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.499625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.506463 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: request: POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action HTTP/1.1 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 65 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: {"resize": {"flavorRef": "d0bc200d-fc3f-4a6e-bdac-9aaa8304f360"}} Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: exception: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '8a4d0ae6-2da0-4343-9006-0f34c17bb8d1', 'body': {'resize': {'flavorRef': 'd0bc200d-fc3f-4a6e-bdac-9aaa8304f360'}}} Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:49:11.526739 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 400 to user: Flavor d0bc200d-fc3f-4a6e-bdac-9aaa8304f360 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c0618c23-1497-4774-b66b-029cb727e9ba tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action" status: 400 len: 107 microversion: 2.1 time: 0.164596 Jul 19 20:49:11.534046 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3267/6638] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:49:11 2022] POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action => generated 107 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:49:11.541914 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.542647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.546462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.552877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.553479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.554358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.554851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.559635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=75 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.721570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.730299 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6736f7de-df99-447b-afff-8b0991f710b8 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.192984 Jul 19 20:49:11.731024 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3372/6639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:11.761633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.762640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.774717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.775661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.777073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.777887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.936689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.946183 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-02db6725-b26c-42ad-831a-694297b8bdda tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.191931 Jul 19 20:49:11.946946 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3268/6640] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:11.964461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06199706-c483-4a3b-980c-309dad6bf23a tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06199706-c483-4a3b-980c-309dad6bf23a tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: request: POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action HTTP/1.1 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 29 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: {"resize": {"flavorRef": ""}} Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8a4d0ae6-2da0-4343-9006-0f34c17bb8d1', 'body': {'resize': {'flavorRef': ''}}} Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi '' Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.967097 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06199706-c483-4a3b-980c-309dad6bf23a tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06199706-c483-4a3b-980c-309dad6bf23a tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action" status: 400 len: 113 microversion: 2.1 time: 0.008570 Jul 19 20:49:11.973207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3373/6641] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:49:11 2022] POST /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:49:11.980375 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.981025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.993617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.994130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:11.995007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:11.995491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.176859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:12.187371 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66f036ef-0639-467f-9456-88a3ba70fa03 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1507 microversion: 2.1 time: 0.212068 Jul 19 20:49:12.188263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3269/6642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:12.213894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.214802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.228015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.228959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.230532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.231352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.256710 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd HTTP/1.1 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '2e6c3a03-2d7f-4e9e-a7c7-0280303066fd'} Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:12.259402 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 404 to user: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4e59f612-7b60-4ce7-ad30-b1242a76efbc tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 404 len: 111 microversion: 2.1 time: 0.055492 Jul 19 20:49:12.263092 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3374/6643] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:12 2022] DELETE /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:12.272268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.272908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.280329 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.280859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.281815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.282300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.298321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd HTTP/1.1 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '2e6c3a03-2d7f-4e9e-a7c7-0280303066fd'} Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:12.300063 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 404 to user: Instance 2e6c3a03-2d7f-4e9e-a7c7-0280303066fd could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bcbd6023-3ba9-4572-b2d0-cd2043fcae57 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd" status: 404 len: 111 microversion: 2.1 time: 0.034082 Jul 19 20:49:12.307965 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3270/6644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:12 2022] GET /compute/v2.1/servers/2e6c3a03-2d7f-4e9e-a7c7-0280303066fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:12.314305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.314814 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.323051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.323530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.324351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.324804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.358741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:49:12.467510 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b97c8487-c602-4c0a-9166-69b33de4c0a0 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 204 len: 0 microversion: 2.1 time: 0.157033 Jul 19 20:49:12.468197 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3375/6645] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:49:12 2022] DELETE /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:49:12.478039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.479028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.481575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:12.488198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.488658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.489477 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.489925 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.662198 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:12.670471 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-059f9a0b-1799-436a-b627-d81329d9f05f tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1513 microversion: 2.1 time: 0.196995 Jul 19 20:49:12.671167 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3271/6646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:12 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:13.689190 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:13.689985 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:13.698413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:13.698873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:13.699744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:13.700192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:13.908976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:13.917592 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-78761bac-561a-4c06-9a84-80823c8201ec tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1513 microversion: 2.1 time: 0.233003 Jul 19 20:49:13.918198 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3376/6647] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:13 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:14.951776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:14.952942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:14.963754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.964427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:14.965488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.966079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:15.005592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-14746b25-7a36-4134-b7d6-07f80c2916ff req-d2518d6e-394d-41ef-9626-abe22e51a295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4d0ae6-2da0-4343-9006-0f34c17bb8d1", "name": "network-vif-deleted", "tag": "10f15cfa-8acd-4697-89b5-1ab4c14ed98e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:15.026482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-14746b25-7a36-4134-b7d6-07f80c2916ff req-d2518d6e-394d-41ef-9626-abe22e51a295 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:15.028481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-14746b25-7a36-4134-b7d6-07f80c2916ff req-d2518d6e-394d-41ef-9626-abe22e51a295 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:15.057313 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-14746b25-7a36-4134-b7d6-07f80c2916ff req-d2518d6e-394d-41ef-9626-abe22e51a295 service nova] Creating event network-vif-deleted:10f15cfa-8acd-4697-89b5-1ab4c14ed98e for instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 on n-h1-843834-3 Jul 19 20:49:15.072257 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-14746b25-7a36-4134-b7d6-07f80c2916ff req-d2518d6e-394d-41ef-9626-abe22e51a295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069659 Jul 19 20:49:15.072545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5ff46355b401383f79d7e78ef5184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a87a1dac5142649c23cdaafcb18b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:15.074255 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3377/6648] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:15.099246 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-474d28b3-1150-42d3-b2c6-038fbd37d5a3 tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 200 len: 1471 microversion: 2.1 time: 0.158632 Jul 19 20:49:15.100302 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3272/6649] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:14 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:16.128923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:16.129995 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] [instance: 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:16.139696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.140203 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.141042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.141520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.158429 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] HTTP exception thrown: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Request method failure captured: Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 HTTP/1.1 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xip6rZANDBYhh6fsi6J4nYv9BGfkEusE2yU8h-MFcavHvZNo4uXRc88qkCL205pqag8O5YzPaY-_ijIl7e8WZ-CXGPKiJCRuUVGYxdwzzgP_Dx3nQkGIoSYGDwXn698HuM-XY2QrFL2X6-VZR6SM30xCfRrzunO3R2WfU0ZKrj35Oo Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/59a87a1dac5142649c23cdaafcb18b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 59a87a1dac5142649c23cdaafcb18b97 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-209128248 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: 6af5ff46355b401383f79d7e78ef5184 Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-ServersNegativeTestJSON-209128248-project Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '8a4d0ae6-2da0-4343-9006-0f34c17bb8d1'} Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:16.160294 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] Returning 404 to user: Instance 8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fdee4c51-0de6-41bc-b5a0-1116a7080f4c tempest-ServersNegativeTestJSON-209128248 tempest-ServersNegativeTestJSON-209128248-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1" status: 404 len: 111 microversion: 2.1 time: 0.038679 Jul 19 20:49:16.167325 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3378/6650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:16 2022] GET /compute/v2.1/servers/8a4d0ae6-2da0-4343-9006-0f34c17bb8d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:02.294747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.296940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=28 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.565995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a2436f18-91ae-457b-b57c-669bb2e0e497 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: .version_select at 0x7f23ee65a0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1853202529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdRzhwL4BLzYZgQJQJFB0zZ1+LTv7iNYsz+SynA+k6acLlCE/wryTGMhyfBH4udv47fCQvVIrGNEUcNpuAnB6sGkt2nh7aq42xu7qqhKWOWqZjxFC27JwIF6fGVBq3ypw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:02.583873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a2436f18-91ae-457b-b57c-669bb2e0e497 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for project 63b29cd0f36449b78f55368cda03b440. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:02.590260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-a2436f18-91ae-457b-b57c-669bb2e0e497 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for user 61c264be79d04d9a8cf3161acf095e00 and project 63b29cd0f36449b78f55368cda03b440. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:02.626267 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a2436f18-91ae-457b-b57c-669bb2e0e497 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.337594 Jul 19 20:50:02.626891 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3273/6651] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:50:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:02.717664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1970856494", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1853202529", "networks": [{"uuid": "031d6ee7-d304-43ab-8ee7-b806bbc434a8"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:02.737601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.738858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.800746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] validate_networks() for [('031d6ee7-d304-43ab-8ee7-b806bbc434a8', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:50:03.576410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:50:03.576910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:50:03.577455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:50:03.577954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:50:03.578680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:50:03.595623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.596577 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.598045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.598542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.620414 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for project 63b29cd0f36449b78f55368cda03b440. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:03.626852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for user 61c264be79d04d9a8cf3161acf095e00 and project 63b29cd0f36449b78f55368cda03b440. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:03.646113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:50:03.649305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:50:03.718790 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b945fc37-e27b-4274-ab2a-b1d9ccc9b90c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005487 Jul 19 20:50:03.729449 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3379/6652] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:50:03.742756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3c45ff0-d83f-428c-8a45-276ffadb3eef tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:03.744931 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3c45ff0-d83f-428c-8a45-276ffadb3eef tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:03.835616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a3c45ff0-d83f-428c-8a45-276ffadb3eef tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.850868 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3c45ff0-d83f-428c-8a45-276ffadb3eef tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1263 microversion: 2.1 time: 0.119282 Jul 19 20:50:03.852004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3274/6653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:03 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1263 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:04.876381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.877410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.889292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.889973 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.891401 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.892171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.994792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:05.009537 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f8b5b467-d000-488f-851b-3169cf00dba9 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1315 microversion: 2.1 time: 0.143304 Jul 19 20:50:05.011296 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3380/6654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:06.037620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:06.038427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:06.047814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.048344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.049958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.050556 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.303660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:06.324269 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-96d9a0a8-feb4-42b9-bc20-0c4e0bc0c9c2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.290756 Jul 19 20:50:06.325850 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3275/6655] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:06 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:07.351047 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:07.355502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:07.375304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.376598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.379493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.380324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.516095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8045329e-3c18-4626-9bdb-ee8f672b4c6b req-d5887646-39d5-40ce-ad63-acb317ba27bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa0976c-5a73-4b1c-969d-7064447ae969", "tag": "93a0a5ee-7943-4846-899d-55115df2521c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:07.544059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8045329e-3c18-4626-9bdb-ee8f672b4c6b req-d5887646-39d5-40ce-ad63-acb317ba27bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.545000 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8045329e-3c18-4626-9bdb-ee8f672b4c6b req-d5887646-39d5-40ce-ad63-acb317ba27bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.558498 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8045329e-3c18-4626-9bdb-ee8f672b4c6b req-d5887646-39d5-40ce-ad63-acb317ba27bd service nova] Creating event network-changed:93a0a5ee-7943-4846-899d-55115df2521c for instance 1aa0976c-5a73-4b1c-969d-7064447ae969 on n-h1-843834-3 Jul 19 20:50:07.564981 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8045329e-3c18-4626-9bdb-ee8f672b4c6b req-d5887646-39d5-40ce-ad63-acb317ba27bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057374 Jul 19 20:50:07.566587 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3276/6656] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:07.862247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.874121 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f9c0f15-3a29-41c6-a983-7f3ad366c84d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.529922 Jul 19 20:50:07.880379 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3381/6657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:07 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:08.906193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:08.907518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:08.918020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.918774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.920217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.920992 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.170260 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.185321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-437292c9-3924-4bb9-bdba-d1c0d175753d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.288105 Jul 19 20:50:09.186857 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3277/6658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:08 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:10.205465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:10.206317 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:10.214497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.215052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.216217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.216870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.393324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.402478 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b8c91f71-8e29-465a-81db-d62302eb71d5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.201616 Jul 19 20:50:10.403124 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3382/6659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:10 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:11.423903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:11.424947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:11.437481 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.438161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.439374 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.440111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.618716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:11.632118 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8e509ed-0dc6-4f6a-8c0a-69f8e4cc5890 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.215066 Jul 19 20:50:11.633015 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3278/6660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:11 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:12.657735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:12.659230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:12.667654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:12.668112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.668991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:12.669451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.840419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.849480 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-baf37290-1f52-43a8-95ee-cb089fe2b013 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.196314 Jul 19 20:50:12.850843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3383/6661] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:12 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:13.867957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:13.868572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:13.872219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:13.878944 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.879427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.880234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.880681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:14.031534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:14.040308 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-94efd84c-016f-4c2f-91be-1b13ca49660c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.176200 Jul 19 20:50:14.040930 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3279/6662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:13 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:14.729545 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3694162e-0563-40e3-89f2-c4c0be5b5627 req-e48ab542-aa5f-4507-90e7-ca07d53348a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa0976c-5a73-4b1c-969d-7064447ae969", "name": "network-vif-plugged", "status": "completed", "tag": "93a0a5ee-7943-4846-899d-55115df2521c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:14.736530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:14.737678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:14.752492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3694162e-0563-40e3-89f2-c4c0be5b5627 req-e48ab542-aa5f-4507-90e7-ca07d53348a9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:14.753312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3694162e-0563-40e3-89f2-c4c0be5b5627 req-e48ab542-aa5f-4507-90e7-ca07d53348a9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:14.775457 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3694162e-0563-40e3-89f2-c4c0be5b5627 req-e48ab542-aa5f-4507-90e7-ca07d53348a9 service nova] Creating event network-vif-plugged:93a0a5ee-7943-4846-899d-55115df2521c for instance 1aa0976c-5a73-4b1c-969d-7064447ae969 on n-h1-843834-3 Jul 19 20:50:14.784661 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3694162e-0563-40e3-89f2-c4c0be5b5627 req-e48ab542-aa5f-4507-90e7-ca07d53348a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061728 Jul 19 20:50:14.785555 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3384/6663] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:50:15.058529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:15.059322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:15.068365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.069147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.071287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.072167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.247272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:15.255924 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-16ac1ba5-ee8c-43e5-ab5a-03e42300a19f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.201411 Jul 19 20:50:15.256570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3280/6664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:15 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:16.276274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:16.277056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:16.285859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:16.286818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:16.287979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:16.288498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:16.491309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:16.499879 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57aba5ce-d1fe-4102-a61c-d0eaf1305f4b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1363 microversion: 2.1 time: 0.229008 Jul 19 20:50:16.500634 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3385/6665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:16 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:17.518640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:17.519421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:17.527414 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.527883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.528699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.529152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.683716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.692335 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b7cdf34f-c969-4c02-a773-9b287b31e254 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1555 microversion: 2.1 time: 0.177906 Jul 19 20:50:17.692973 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3281/6666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:17 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:17.710194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:17.710947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:17.718770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.719346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.720248 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.720748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.870492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.883286 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0671015-8bb6-4a06-9ec5-0bd4df213f17 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1555 microversion: 2.1 time: 0.177348 Jul 19 20:50:17.883940 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3386/6667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:17 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:19.631800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c920c73-226e-44f6-8bdb-07c1b833bc82"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:19.634010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:19.646623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.647502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.648994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.649856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.973823 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ec26e22-cd3f-4933-9b06-0b5c048dc9cc tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349208 Jul 19 20:50:19.974795 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3282/6668] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:50:19 2022] POST /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:31.936896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:31.937526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:31.940036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:31.940881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=40 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:31.951889 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:31.952788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:31.954229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:31.955075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:32.055690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lazy-loading 'services' on Instance uuid 1aa0976c-5a73-4b1c-969d-7064447ae969 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:50:32.137267 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89b9cbcd-23ba-4cc6-9447-aa6976d422c3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments/6c920c73-226e-44f6-8bdb-07c1b833bc82" status: 202 len: 0 microversion: 2.1 time: 0.204506 Jul 19 20:50:32.137881 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3387/6669] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:50:31 2022] DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments/6c920c73-226e-44f6-8bdb-07c1b833bc82 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:50:32.148245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:32.149849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:32.154320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:32.155468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:32.165301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:32.166023 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:32.167079 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:32.167624 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:32.207979 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a3693372-12f0-42f4-b305-ca7836d06e3c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065094 Jul 19 20:50:32.208580 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3283/6670] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:32 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:33.228862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:33.230816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:33.244196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:33.244984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:33.246430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:33.247261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:33.305167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8423b3a0-dc97-4270-9fc2-3bd5282b34f1 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086658 Jul 19 20:50:33.306368 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3388/6671] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:33 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:34.324524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:34.326194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:34.339226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:34.340073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:34.341508 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:34.342274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:34.400317 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4e48648b-6477-4d58-9c4f-aa62c95d360e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083346 Jul 19 20:50:34.401562 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3284/6672] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:34 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:35.415910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:35.417408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:35.426528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:35.427264 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:35.428288 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:35.428960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:35.473250 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef541a66-fd2a-4677-81c2-956741fb9659 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062138 Jul 19 20:50:35.473881 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3389/6673] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:35 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:36.488699 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:36.490294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:36.502491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.503256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.504499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.505202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.546054 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5c953c46-8ed2-4ec6-ba7a-e6da234055aa tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064631 Jul 19 20:50:36.546661 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3285/6674] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:36 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:37.563640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:37.565282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:37.577911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.578520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.579574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.580241 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.628895 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48855b6c-ed4f-4c15-abb2-ae67bda8b35b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073107 Jul 19 20:50:37.629847 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3390/6675] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:37 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:50:37.644012 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:37.644665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:37.652177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.652646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.653461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.653917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.783424 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] HTTP exception thrown: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 is not attached to volume 6c920c73-226e-44f6-8bdb-07c1b833bc82 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Request method failure captured: Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments/6c920c73-226e-44f6-8bdb-07c1b833bc82 HTTP/1.1 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xjzSPFTd-ok1owapyzYkkkM5uc8mmHi4_zLoMAOgxezsJabJrO9wLduQXZ73uf5mO_P-6DUacTj4Jw3Kw163NwIv1Lu5p0zgOx-Fc7UmrwPfC874RnATgU3hG7qyPpiesvE45GCqq16Qq5oggcGmv--D9fWWBZaG1MIj9WNNjZL5Q4 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_63b29cd0f36449b78f55368cda03b440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 61c264be79d04d9a8cf3161acf095e00 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 is not attached to volume 6c920c73-226e-44f6-8bdb-07c1b833bc82 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '1aa0976c-5a73-4b1c-969d-7064447ae969', 'id': '6c920c73-226e-44f6-8bdb-07c1b833bc82'} Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c920c73-226e-44f6-8bdb-07c1b833bc82. Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 is not attached to volume 6c920c73-226e-44f6-8bdb-07c1b833bc82 Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:37.792616 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 is not attached to volume 6c920c73-226e-44f6-8bdb-07c1b833bc82 Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Returning 404 to user: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 is not attached to volume 6c920c73-226e-44f6-8bdb-07c1b833bc82 {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d6c1bfb-8aaf-4870-b2bd-139446cc50a3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments/6c920c73-226e-44f6-8bdb-07c1b833bc82" status: 404 len: 154 microversion: 2.1 time: 0.155294 Jul 19 20:50:37.796975 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3286/6676] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:50:37 2022] DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969/os-volume_attachments/6c920c73-226e-44f6-8bdb-07c1b833bc82 => generated 154 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:42.255670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:42.257005 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:42.265039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.267745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.267745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.267745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.297344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:50:42.396937 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6dbb7a43-feed-4b53-910c-303f0b404770 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 204 len: 0 microversion: 2.1 time: 0.144916 Jul 19 20:50:42.399183 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3391/6677] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:50:42 2022] DELETE /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:50:42.410195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:42.411245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:42.421815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.422475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.423493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.424001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.622160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:42.632146 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-09566e08-d293-4b84-a396-e431edd9d835 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1561 microversion: 2.1 time: 0.228669 Jul 19 20:50:42.633037 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3287/6678] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:42 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1561 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:43.653942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:43.654747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:43.662823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:43.663541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:43.664360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:43.664779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:43.814861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:43.823910 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6426f5a-e1c4-4731-a7f0-41dde17be9b5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1561 microversion: 2.1 time: 0.174342 Jul 19 20:50:43.824586 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3392/6679] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:43 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:44.847240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:44.848549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:44.861060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.861883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.863602 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.864748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.165002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:45.179226 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f96a74d-bf34-482a-b00d-f28b1e7596ac tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 200 len: 1561 microversion: 2.1 time: 0.338868 Jul 19 20:50:45.180326 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3288/6680] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:44 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 1561 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:45.542194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c3cdd323-dda9-4f9f-8a4f-eb23b3b5ed72 req-3c80ed43-c21c-4874-81c2-d6cb3a59bd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa0976c-5a73-4b1c-969d-7064447ae969", "name": "network-vif-deleted", "tag": "93a0a5ee-7943-4846-899d-55115df2521c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:45.554022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3cdd323-dda9-4f9f-8a4f-eb23b3b5ed72 req-3c80ed43-c21c-4874-81c2-d6cb3a59bd13 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.554398 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c3cdd323-dda9-4f9f-8a4f-eb23b3b5ed72 req-3c80ed43-c21c-4874-81c2-d6cb3a59bd13 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.570866 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c3cdd323-dda9-4f9f-8a4f-eb23b3b5ed72 req-3c80ed43-c21c-4874-81c2-d6cb3a59bd13 service nova] Creating event network-vif-deleted:93a0a5ee-7943-4846-899d-55115df2521c for instance 1aa0976c-5a73-4b1c-969d-7064447ae969 on n-h1-843834-3 Jul 19 20:50:45.576915 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c3cdd323-dda9-4f9f-8a4f-eb23b3b5ed72 req-3c80ed43-c21c-4874-81c2-d6cb3a59bd13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Jul 19 20:50:45.577998 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3393/6681] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:46.200052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:46.200954 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 1aa0976c-5a73-4b1c-969d-7064447ae969] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:46.212157 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.212738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.213703 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.214833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.231971 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] HTTP exception thrown: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Request method failure captured: Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 HTTP/1.1 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xjzSPFTd-ok1owapyzYkkkM5uc8mmHi4_zLoMAOgxezsJabJrO9wLduQXZ73uf5mO_P-6DUacTj4Jw3Kw163NwIv1Lu5p0zgOx-Fc7UmrwPfC874RnATgU3hG7qyPpiesvE45GCqq16Qq5oggcGmv--D9fWWBZaG1MIj9WNNjZL5Q4 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_63b29cd0f36449b78f55368cda03b440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 61c264be79d04d9a8cf3161acf095e00 Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '1aa0976c-5a73-4b1c-969d-7064447ae969'} Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:46.233595 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Returning 404 to user: Instance 1aa0976c-5a73-4b1c-969d-7064447ae969 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b96012f-9950-4608-8d56-9eb97ae8c688 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969" status: 404 len: 111 microversion: 2.1 time: 0.041393 Jul 19 20:50:46.240164 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3289/6682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:46 2022] GET /compute/v2.1/servers/1aa0976c-5a73-4b1c-969d-7064447ae969 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:46.250857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-62a1a302-9c2e-4b89-909a-d9ac4af639a8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '.version_select at 0x7f23ef808c10>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:46.256903 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62a1a302-9c2e-4b89-909a-d9ac4af639a8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [90f78fcf-a43f-49ee-87ce-987660c2225a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:50:47.270585 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [None req-62a1a302-9c2e-4b89-909a-d9ac4af639a8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [90f78fcf-a43f-49ee-87ce-987660c2225a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 52410. Jul 19 20:50:47.299190 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-62a1a302-9c2e-4b89-909a-d9ac4af639a8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1853202529" status: 202 len: 0 microversion: 2.1 time: 1.056374 Jul 19 20:50:47.300387 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3394/6683] 10.222.0.23 () {58 vars in 1277 bytes} [Tue Jul 19 20:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1853202529 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:50:47.322572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40df1c16-629f-4ec9-b098-249a3bbd6530 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: .version_select at 0x7f23ee71ec10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-45041376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBThN9Ky0C0UphkU4EO1fn5nODv4AHsH3myWgD131tX42vQrqihB4GCbeMASqqRCmVyU/xg3fclnGnzQtNfL8hQhvsXU4KYR29qqGr65xb59OupSuXx0G5u8ZZntrsfe/g=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:47.344655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-40df1c16-629f-4ec9-b098-249a3bbd6530 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for project 63b29cd0f36449b78f55368cda03b440. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:47.352493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-40df1c16-629f-4ec9-b098-249a3bbd6530 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for user 61c264be79d04d9a8cf3161acf095e00 and project 63b29cd0f36449b78f55368cda03b440. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:47.380509 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40df1c16-629f-4ec9-b098-249a3bbd6530 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.063488 Jul 19 20:50:47.381139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3290/6684] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:50:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:47.447280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1799278949", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-45041376", "networks": [{"uuid": "031d6ee7-d304-43ab-8ee7-b806bbc434a8"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:47.507195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] validate_networks() for [('031d6ee7-d304-43ab-8ee7-b806bbc434a8', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:50:48.406528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:50:48.407162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:50:48.407479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:50:48.407902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:50:48.408321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:50:48.419411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.419878 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.420704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.421151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.441110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for project 63b29cd0f36449b78f55368cda03b440. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:48.447922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Getting quotas for user 61c264be79d04d9a8cf3161acf095e00 and project 63b29cd0f36449b78f55368cda03b440. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:48.462839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:50:48.465433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:50:48.518435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-430e4417-8dd1-4563-997a-c81dd3dfd211 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075970 Jul 19 20:50:48.519154 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3395/6685] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:50:48.535302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bf73161b-f3e5-49e1-a611-5761fbb1aea0 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:48.536555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bf73161b-f3e5-49e1-a611-5761fbb1aea0 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:48.603096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bf73161b-f3e5-49e1-a611-5761fbb1aea0 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:48.612425 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bf73161b-f3e5-49e1-a611-5761fbb1aea0 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1261 microversion: 2.1 time: 0.086055 Jul 19 20:50:48.613051 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3291/6686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:48 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:49.632976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:49.634321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:49.643849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.644906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.646643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.647426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.747931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:49.763327 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-18f786cb-237d-43e0-b23e-c036cded529e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1321 microversion: 2.1 time: 0.136101 Jul 19 20:50:49.764548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3396/6687] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:49 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1321 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:50.791890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:50.792914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:50.803628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.803628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.804456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.805092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.015160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:51.029838 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fc90676e-8f3d-481c-bbfb-b537f7e0471c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.242823 Jul 19 20:50:51.030949 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3292/6688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:50 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:51.860918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-ddf74b9a-43a8-442b-8606-11efbe403a4c req-fe3b105c-ac1e-4d75-83c6-fb52f4900c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320082a2-a81c-4668-acec-70550bb62767", "tag": "6f9538d5-64bc-4a6c-b842-7a6b6864245e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:51.907061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ddf74b9a-43a8-442b-8606-11efbe403a4c req-fe3b105c-ac1e-4d75-83c6-fb52f4900c65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.912821 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-ddf74b9a-43a8-442b-8606-11efbe403a4c req-fe3b105c-ac1e-4d75-83c6-fb52f4900c65 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.940513 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-ddf74b9a-43a8-442b-8606-11efbe403a4c req-fe3b105c-ac1e-4d75-83c6-fb52f4900c65 service nova] Creating event network-changed:6f9538d5-64bc-4a6c-b842-7a6b6864245e for instance 320082a2-a81c-4668-acec-70550bb62767 on n-h2-843834-3 Jul 19 20:50:51.949784 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-ddf74b9a-43a8-442b-8606-11efbe403a4c req-fe3b105c-ac1e-4d75-83c6-fb52f4900c65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095656 Jul 19 20:50:51.951289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3397/6689] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:52.057194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:52.058636 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:52.070899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.071902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.073559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.074978 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.275090 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:52.285473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fcbb84af-14a2-48fa-99a7-b91aa86f4807 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.233902 Jul 19 20:50:52.285944 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3293/6690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:52 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:53.306832 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:53.309479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:53.317488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.318080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.319576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.320368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.514704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:53.524670 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e69ee9c5-76fa-4e42-bf40-1af99f9590ad tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.224617 Jul 19 20:50:53.525932 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3398/6691] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:53 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:54.546429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:54.547642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:54.560711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.561558 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.562956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.563930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.776325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:54.785800 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61a197a6-0c58-4c1f-ab41-d562269e7ff2 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.246783 Jul 19 20:50:54.786596 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3294/6692] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:54 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:55.811986 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:55.812980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:55.820908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.821361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.822183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.822613 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.986327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:55.995266 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6d39486-1b95-46bf-9ed1-a5dd7f25d410 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.187390 Jul 19 20:50:55.995907 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3399/6693] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:55 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:56.752868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8c11cb7d-b789-42f2-a374-e06e3a0b0995 req-72f0c22f-8d91-4cc2-86fc-e69d1937acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320082a2-a81c-4668-acec-70550bb62767", "name": "network-vif-plugged", "status": "completed", "tag": "6f9538d5-64bc-4a6c-b842-7a6b6864245e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:56.766418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c11cb7d-b789-42f2-a374-e06e3a0b0995 req-72f0c22f-8d91-4cc2-86fc-e69d1937acf4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.767083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8c11cb7d-b789-42f2-a374-e06e3a0b0995 req-72f0c22f-8d91-4cc2-86fc-e69d1937acf4 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.785307 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8c11cb7d-b789-42f2-a374-e06e3a0b0995 req-72f0c22f-8d91-4cc2-86fc-e69d1937acf4 service nova] Creating event network-vif-plugged:6f9538d5-64bc-4a6c-b842-7a6b6864245e for instance 320082a2-a81c-4668-acec-70550bb62767 on n-h2-843834-3 Jul 19 20:50:56.793054 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8c11cb7d-b789-42f2-a374-e06e3a0b0995 req-72f0c22f-8d91-4cc2-86fc-e69d1937acf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044508 Jul 19 20:50:56.793956 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3295/6694] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:57.020498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:57.021256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:57.029350 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.029784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.030586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.031076 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.207899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:57.216456 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-64039563-1e67-49f1-a697-b8418c70c07c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1361 microversion: 2.1 time: 0.200222 Jul 19 20:50:57.217109 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3400/6695] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:57 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:58.239105 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.240155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.252974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.253575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.254963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.255766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.673133 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:58.809258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:58.818532 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9e7a16c-cd0f-4293-86b2-4031aeed589f tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1554 microversion: 2.1 time: 0.587324 Jul 19 20:50:58.819553 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3296/6696] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1554 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:58.845299 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.846065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.851221 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:58.852030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:58.856782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.857312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.858210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.858569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.067112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:59.076380 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f91edc5a-6bf1-4215-8318-19120e75892e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1554 microversion: 2.1 time: 0.235290 Jul 19 20:50:59.077008 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3401/6697] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:01.824470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:01.825596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:01.834385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.834943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:01.835881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.836385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.136590 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-14d34de7-a97e-455b-8b77-b14f0e75aa9a tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "POST /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316194 Jul 19 20:51:02.140298 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3297/6698] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:51:01 2022] POST /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:14.058705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:14.059646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:14.064764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:14.066198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:14.079634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.080439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.081846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.082620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.210930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lazy-loading 'services' on Instance uuid 320082a2-a81c-4668-acec-70550bb62767 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:14.294012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4caa3440-432a-4e2d-9669-d18147227975 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments/544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf" status: 202 len: 0 microversion: 2.1 time: 0.243229 Jul 19 20:51:14.294620 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3402/6699] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:51:14 2022] DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments/544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:51:14.302295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:14.303719 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:14.309996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:14.311435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:14.323656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.324318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.325286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.326128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.368743 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5904e93f-a480-449c-b0d2-4758fd53f4bf tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069024 Jul 19 20:51:14.369662 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3298/6700] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:14 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:15.388259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:15.389950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:15.401855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:15.402649 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:15.404187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:15.405044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:15.450428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-35ab0951-b384-4919-8164-17c65bbb6af4 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069356 Jul 19 20:51:15.450428 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3403/6701] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:15 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:51:16.462102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:16.463401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:16.473844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.474415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.475511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.476221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.516584 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2d264a9-fd6e-4b5e-a4e5-909a69147c0d tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059213 Jul 19 20:51:16.517187 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3299/6702] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:16 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:17.530281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:17.531391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:17.541067 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.541849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.543483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.544502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.604495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bc2dfe07-3ae0-4732-bf15-e6e19b696d85 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078289 Jul 19 20:51:17.605533 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3404/6703] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:17 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:18.623179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:18.624874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:18.637455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.638251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:18.639675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.640560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:18.696221 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9f83a2c4-fee3-4c3d-9a62-1fd54047b4ae tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080869 Jul 19 20:51:18.697153 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3300/6704] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:18 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:19.713260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:19.714850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:19.728600 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.729394 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.730830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.731617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.771618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7b14999d-c9a2-46a0-a58d-cf93daf6cea3 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065443 Jul 19 20:51:19.772234 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3405/6705] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:51:19 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:51:19.783470 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:19.784158 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:19.791751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.792227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.793069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.793532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.882658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] HTTP exception thrown: Instance 320082a2-a81c-4668-acec-70550bb62767 is not attached to volume 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Request method failure captured: Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments/544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf HTTP/1.1 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xjzSPFTd-ok1owapyzYkkkM5uc8mmHi4_zLoMAOgxezsJabJrO9wLduQXZ73uf5mO_P-6DUacTj4Jw3Kw163NwIv1Lu5p0zgOx-Fc7UmrwPfC874RnATgU3hG7qyPpiesvE45GCqq16Qq5oggcGmv--D9fWWBZaG1MIj9WNNjZL5Q4 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_63b29cd0f36449b78f55368cda03b440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 61c264be79d04d9a8cf3161acf095e00 Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 320082a2-a81c-4668-acec-70550bb62767 is not attached to volume 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '320082a2-a81c-4668-acec-70550bb62767', 'id': '544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf'} Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf. Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320082a2-a81c-4668-acec-70550bb62767 is not attached to volume 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:19.884405 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320082a2-a81c-4668-acec-70550bb62767 is not attached to volume 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Returning 404 to user: Instance 320082a2-a81c-4668-acec-70550bb62767 is not attached to volume 544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b77b3b1f-4462-4155-b2bc-023d21bf53a5 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments/544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf" status: 404 len: 154 microversion: 2.1 time: 0.106808 Jul 19 20:51:19.889953 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3301/6706] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:51:19 2022] DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767/os-volume_attachments/544cfba8-cbc4-40f8-b6ec-8d7f5e6ee3bf => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:23.368436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:23.369441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:23.380772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.381442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.382598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.383265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.429909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:51:23.557194 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f058a333-01ad-48cb-88fd-a9d669679f42 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 204 len: 0 microversion: 2.1 time: 0.195389 Jul 19 20:51:23.558309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3406/6707] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:51:23 2022] DELETE /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:51:23.569071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:23.570400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:23.582876 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.583547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.584612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.585278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.757420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:23.770516 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9538ef3-0b47-499f-b89b-713e67c9196c tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1560 microversion: 2.1 time: 0.205740 Jul 19 20:51:23.771753 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3302/6708] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:23 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:24.791421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:24.792543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:24.802199 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.802667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.803543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.806816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.001823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:25.016166 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6ed92cb4-d44a-40bb-b787-9691e6c5ff69 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1560 microversion: 2.1 time: 0.229617 Jul 19 20:51:25.017173 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3407/6709] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:24 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:25.716176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-205b20cd-ab2d-4c8a-bf33-160cd38aa22c req-973cebd9-3b45-43e9-adb8-be4b4fd2bb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320082a2-a81c-4668-acec-70550bb62767", "name": "network-vif-deleted", "tag": "6f9538d5-64bc-4a6c-b842-7a6b6864245e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:25.732980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-205b20cd-ab2d-4c8a-bf33-160cd38aa22c req-973cebd9-3b45-43e9-adb8-be4b4fd2bb54 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.741735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-205b20cd-ab2d-4c8a-bf33-160cd38aa22c req-973cebd9-3b45-43e9-adb8-be4b4fd2bb54 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.765133 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-205b20cd-ab2d-4c8a-bf33-160cd38aa22c req-973cebd9-3b45-43e9-adb8-be4b4fd2bb54 service nova] Creating event network-vif-deleted:6f9538d5-64bc-4a6c-b842-7a6b6864245e for instance 320082a2-a81c-4668-acec-70550bb62767 on n-h2-843834-3 Jul 19 20:51:25.775398 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-205b20cd-ab2d-4c8a-bf33-160cd38aa22c req-973cebd9-3b45-43e9-adb8-be4b4fd2bb54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064705 Jul 19 20:51:25.776946 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3303/6710] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:51:26.043839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:26.044723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:26.054204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.054665 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.055868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.056072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.118018 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.118703 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.119473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lazy-loading 'fault' on Instance uuid 320082a2-a81c-4668-acec-70550bb62767 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:26.180527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c264be79d04d9a8cf3161acf095e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b29cd0f36449b78f55368cda03b440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:26.196127 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4fc2bb6-fa92-4c30-a269-5cfc7555829b tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 200 len: 1351 microversion: 2.1 time: 0.156907 Jul 19 20:51:26.197740 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3408/6711] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:26 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:27.216227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:27.216845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] [instance: 320082a2-a81c-4668-acec-70550bb62767] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:27.224276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.224837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.225642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.226097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.243932 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] HTTP exception thrown: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Request method failure captured: Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 HTTP/1.1 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xjzSPFTd-ok1owapyzYkkkM5uc8mmHi4_zLoMAOgxezsJabJrO9wLduQXZ73uf5mO_P-6DUacTj4Jw3Kw163NwIv1Lu5p0zgOx-Fc7UmrwPfC874RnATgU3hG7qyPpiesvE45GCqq16Qq5oggcGmv--D9fWWBZaG1MIj9WNNjZL5Q4 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_63b29cd0f36449b78f55368cda03b440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/63b29cd0f36449b78f55368cda03b440"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 63b29cd0f36449b78f55368cda03b440 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1753802969 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 61c264be79d04d9a8cf3161acf095e00 Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestEncryptedCinderVolumes-1753802969-project Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '320082a2-a81c-4668-acec-70550bb62767'} Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:27.245709 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Returning 404 to user: Instance 320082a2-a81c-4668-acec-70550bb62767 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-56a3d3b5-96f0-42f2-8a71-b752c646966e tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767" status: 404 len: 111 microversion: 2.1 time: 0.036736 Jul 19 20:51:27.252856 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3304/6712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:27 2022] GET /compute/v2.1/servers/320082a2-a81c-4668-acec-70550bb62767 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:27.260543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45255443-9ad0-4d9a-9fa5-97a24dd35ff8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] Calling method '.version_select at 0x7f23ef808310>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:27.284245 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45255443-9ad0-4d9a-9fa5-97a24dd35ff8 tempest-TestEncryptedCinderVolumes-1753802969 tempest-TestEncryptedCinderVolumes-1753802969-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-45041376" status: 202 len: 0 microversion: 2.1 time: 0.029129 Jul 19 20:51:27.284876 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3409/6713] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 20:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-45041376 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:52:02.469031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-088607b6-0fb5-4140-bb22-78d22abc82db tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: .version_select at 0x7f23ec55ddc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-167368070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdODYmSFbcUsNxeWgwsvOIUSZ/dKtsexa41AyNCJoDU7jb1m5k6s37ODyfSQYw42tsuZkg3JJH8lTRbyqz2U0G7W6bBBMPlDnpUPYhKbUbjl+upxrL6ASHE6a1Knza9JQ=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:02.474144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:02.475295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:02.489452 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-088607b6-0fb5-4140-bb22-78d22abc82db tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for project 0a2580aa0907494d984967043cdbf8da. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:52:02.495717 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-088607b6-0fb5-4140-bb22-78d22abc82db tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for user ecb241fdd40f4dd1a1fedbb414c5a462 and project 0a2580aa0907494d984967043cdbf8da. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:52:02.524881 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-088607b6-0fb5-4140-bb22-78d22abc82db tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059968 Jul 19 20:52:02.525589 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3305/6714] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:52:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:02.593141 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:02.593933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:02.598675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-381947989", "imageRef": "e8d45cb7-afd9-412b-9f3c-6dea1f1966d9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-167368070", "networks": [{"uuid": "c4780d17-ca12-4111-9d77-a2514c8e5780"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:02.666997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] validate_networks() for [('c4780d17-ca12-4111-9d77-a2514c8e5780', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:52:03.131667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:52:03.132354 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:52:03.133129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:52:03.133898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:52:03.134662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:52:03.150766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:03.151540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:03.152909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:03.153663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:03.186186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for project 0a2580aa0907494d984967043cdbf8da. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:52:03.198233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for user ecb241fdd40f4dd1a1fedbb414c5a462 and project 0a2580aa0907494d984967043cdbf8da. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:52:03.223723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:52:03.227937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8d45cb7-afd9-412b-9f3c-6dea1f1966d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:52:03.308181 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90d4131f-e77e-4ad5-8969-577f87999129 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716770 Jul 19 20:52:03.309431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3410/6715] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:52:03.322874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2330821-087c-49aa-aca3-34ba84d8778b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:03.323589 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2330821-087c-49aa-aca3-34ba84d8778b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:03.384469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2330821-087c-49aa-aca3-34ba84d8778b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:03.392692 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2330821-087c-49aa-aca3-34ba84d8778b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1257 microversion: 2.1 time: 0.074195 Jul 19 20:52:03.393535 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3306/6716] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:03 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:04.418261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:04.419004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:04.428155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:04.428586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:04.429433 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:04.429887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:04.512441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:04.522659 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-170a8e93-e8c4-42c8-b41f-ec5566e7c243 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1309 microversion: 2.1 time: 0.108453 Jul 19 20:52:04.523707 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3411/6717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:04 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:05.546219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:05.548469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:05.577338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:05.578606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:05.580630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:05.581772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:05.720063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:05.735372 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b3460401-f919-4f50-a8f4-3ab5c9e30887 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1315 microversion: 2.1 time: 0.195476 Jul 19 20:52:05.737391 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3307/6718] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:05 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:06.765635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:06.766788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:06.779440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:06.780228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:06.781659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:06.782679 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:07.004296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:07.015546 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-047f4437-da11-478f-81e9-31532d36c603 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.259965 Jul 19 20:52:07.016360 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3412/6719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:06 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:08.038465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:08.039357 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:08.048131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:08.049033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:08.050225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:08.050968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:08.253495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:08.269651 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e6290187-f088-424b-b44e-460d4b71da5a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.235216 Jul 19 20:52:08.270598 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3308/6720] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:08 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:09.293751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:09.294887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:09.308566 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.309362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.310776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.311561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.525087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:09.540289 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0a204974-25bd-41b1-8196-16449388afab tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.253762 Jul 19 20:52:09.541670 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3413/6721] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:09 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:10.562070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:10.563162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:10.571864 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:10.572454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:10.573664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:10.574143 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:10.793809 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:10.804220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2502a553-e75b-4dfe-b762-b56a89aa48f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.246418 Jul 19 20:52:10.819424 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3309/6722] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:10 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:11.836726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:11.839321 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:11.853196 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.854086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.855728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.856599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:12.082152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:12.099572 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-900dc5af-e1b0-4849-89de-c6c53b08eb07 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.270366 Jul 19 20:52:12.100651 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3414/6723] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:11 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:13.127927 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:13.129910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:13.147511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:13.148234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:13.150055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:13.150762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:13.332968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:13.342544 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7f78d8e0-bd92-4fe1-895d-f285f508d396 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.225200 Jul 19 20:52:13.343200 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3310/6724] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:13 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:14.370534 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:14.372419 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:14.376998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:14.378371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:14.391292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.392092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.393575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.394353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.688151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:14.704328 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-02d3c0db-6a72-4423-b234-665bacf11f1a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.338829 Jul 19 20:52:14.706529 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3415/6725] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:14 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:14.842641 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1ccc002c-7cbd-4aa4-8510-da4a209aae63 req-2772986f-8c35-46c0-bb51-097ccc502ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:14.869983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:14.883006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1ccc002c-7cbd-4aa4-8510-da4a209aae63 req-2772986f-8c35-46c0-bb51-097ccc502ccc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:14.883690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1ccc002c-7cbd-4aa4-8510-da4a209aae63 req-2772986f-8c35-46c0-bb51-097ccc502ccc service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:14.901676 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1ccc002c-7cbd-4aa4-8510-da4a209aae63 req-2772986f-8c35-46c0-bb51-097ccc502ccc service nova] Creating event network-changed:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:52:14.908639 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1ccc002c-7cbd-4aa4-8510-da4a209aae63 req-2772986f-8c35-46c0-bb51-097ccc502ccc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073610 Jul 19 20:52:14.910056 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3311/6726] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:15.726155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:15.727055 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:15.737975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:15.738653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:15.740044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:15.740794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:15.957365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:15.966674 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b7641ba7-8e18-4e75-a642-4747267dec35 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.246968 Jul 19 20:52:15.967361 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3416/6727] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:15 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:16.993610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:16.994755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:17.003237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:17.003792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:17.004852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:17.005447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:17.177909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:17.186421 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a7dfa019-d1c5-4bb7-8570-97d16b9cbc1e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.198555 Jul 19 20:52:17.187144 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3312/6728] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:16 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:18.206044 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:18.206946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:18.215446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:18.215957 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:18.217160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:18.217772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:18.441562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:18.452087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a796ab43-1c9b-452a-bcac-ec7070b69c42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.249949 Jul 19 20:52:18.452746 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3417/6729] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:18 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:19.472387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:19.473458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:19.482177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:19.482972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:19.484277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:19.484961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:19.673313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:19.683963 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5691424-4860-4c55-8aa2-498b427215fe tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.216667 Jul 19 20:52:19.684936 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3313/6730] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:19 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:20.714839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:20.715951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:20.729169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:20.729932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:20.731408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:20.732165 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:20.897113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:20.909150 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-91212aa3-93f6-4aad-bab0-7ea90df069c8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.200766 Jul 19 20:52:20.910099 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3418/6731] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:20 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:21.556488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-f7e8ffbe-b7fc-4017-bf4d-6657765a9b3a req-59932aef-926b-4e53-924d-4bc75c73fdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "name": "network-vif-plugged", "status": "completed", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:21.570114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7e8ffbe-b7fc-4017-bf4d-6657765a9b3a req-59932aef-926b-4e53-924d-4bc75c73fdd9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:21.570968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-f7e8ffbe-b7fc-4017-bf4d-6657765a9b3a req-59932aef-926b-4e53-924d-4bc75c73fdd9 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:21.592311 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-f7e8ffbe-b7fc-4017-bf4d-6657765a9b3a req-59932aef-926b-4e53-924d-4bc75c73fdd9 service nova] Creating event network-vif-plugged:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:52:21.602399 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-f7e8ffbe-b7fc-4017-bf4d-6657765a9b3a req-59932aef-926b-4e53-924d-4bc75c73fdd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050346 Jul 19 20:52:21.603338 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3314/6732] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:21.934020 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:21.935001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:21.943131 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:21.943617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:21.944817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:21.945263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:22.334758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:22.347350 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-182216c1-f653-45a2-99b5-a6cf926904b4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1357 microversion: 2.1 time: 0.417508 Jul 19 20:52:22.348067 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3419/6733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:21 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:23.372755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.374067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:23.385575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.386373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.387880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.388648 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.627631 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:23.636745 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e2790e69-9771-41a6-8ea7-eff6191640bd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1548 microversion: 2.1 time: 0.273611 Jul 19 20:52:23.637344 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3315/6734] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:23.662378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.663116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:23.671794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.672471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.673366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.673849 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.834673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:23.844395 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a6781028-a85d-4a3a-9aea-7581d58b5d73 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1548 microversion: 2.1 time: 0.186491 Jul 19 20:52:23.845055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3420/6735] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:23.876633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.883570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:23.884863 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Searching by: {'deleted': False, 'project_id': '0a2580aa0907494d984967043cdbf8da'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:52:23.894555 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.895675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.897184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.897985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.937684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:52:23.972042 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-794a3f59-cc0a-47cd-ba5d-1d1e3617c46b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.102780 Jul 19 20:52:23.972714 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3316/6736] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:23.984230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.984902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:23.992240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.992694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.993548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.993966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:24.166038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:24.174989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-61a846f5-61e1-4785-82e1-8bd9341b9c82 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1548 microversion: 2.1 time: 0.194878 Jul 19 20:52:24.175623 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3421/6737] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1548 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:25.887977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe9fdfe-1922-472a-8144-3df9815faee2"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:25.889195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:25.898342 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:25.898899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:25.899937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:25.900682 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:26.220411 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9814925d-2baf-457a-80eb-4651aea820e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336663 Jul 19 20:52:26.221294 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3317/6738] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:52:25 2022] POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:29.282399 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:52:29.283369 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:52:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:52:40.591909 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:40.592578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:40.595519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:40.596222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=68 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:40.603520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:40.603989 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:40.604819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:40.605273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:40.796861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:40.806873 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3901479e-aa0d-497a-bb29-c6821f4fa147 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1594 microversion: 2.1 time: 0.219298 Jul 19 20:52:40.807548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3422/6739] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:40 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1594 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:43.205583 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:43.216095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:43.216670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:43.223778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-eb41d3e1-3316-46c9-9cdd-3127be5e174b req-cf55b29b-ba61-425f-94ea-1fc420a220c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:43.240923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-eb41d3e1-3316-46c9-9cdd-3127be5e174b req-cf55b29b-ba61-425f-94ea-1fc420a220c8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:43.241722 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-eb41d3e1-3316-46c9-9cdd-3127be5e174b req-cf55b29b-ba61-425f-94ea-1fc420a220c8 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:43.266540 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-eb41d3e1-3316-46c9-9cdd-3127be5e174b req-cf55b29b-ba61-425f-94ea-1fc420a220c8 service nova] Creating event network-changed:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:52:43.278211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-eb41d3e1-3316-46c9-9cdd-3127be5e174b req-cf55b29b-ba61-425f-94ea-1fc420a220c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075255 Jul 19 20:52:43.279638 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3318/6740] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:44.758528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1310823620"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:44.760151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:44.770045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.770486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.771376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.771833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.931837 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Adding security group d6ebfabc-9f9a-4ea0-9bff-ce0db924c0db to port 92e46762-d28e-4cfe-af35-c8d7f7c1d633 Jul 19 20:52:45.388551 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-766c1ead-7646-4c62-ba61-d6fe68a27f92 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action" status: 202 len: 0 microversion: 2.1 time: 0.635612 Jul 19 20:52:45.389877 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3423/6741] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:52:44 2022] POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:52:45.401562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-6df77aa4-31e2-4ead-bbc5-e66dbb326253 req-778cf8b6-56de-4e6c-b761-2e1207aef321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:45.419698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6df77aa4-31e2-4ead-bbc5-e66dbb326253 req-778cf8b6-56de-4e6c-b761-2e1207aef321 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.420161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-6df77aa4-31e2-4ead-bbc5-e66dbb326253 req-778cf8b6-56de-4e6c-b761-2e1207aef321 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.429279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:45.440378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:45.458024 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-6df77aa4-31e2-4ead-bbc5-e66dbb326253 req-778cf8b6-56de-4e6c-b761-2e1207aef321 service nova] Creating event network-changed:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:52:45.463301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.467097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.468997 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.472706 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-6df77aa4-31e2-4ead-bbc5-e66dbb326253 req-778cf8b6-56de-4e6c-b761-2e1207aef321 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075032 Jul 19 20:52:45.473349 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3424/6742] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:45.476251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.993042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:46.012659 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8cbe3c2-597b-46ca-99bd-67199d997772 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1760 microversion: 2.1 time: 0.615046 Jul 19 20:52:46.014592 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3319/6743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:45 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1760 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:09.420530 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:54:09.421163 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:54:33.005227 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:54:33.006968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:33.008161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:33.013856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:33.015167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:33.023876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.024343 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.025148 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.025588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.116050 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8f0c4d54-9e35-4ea0-b7ce-41d40bb28baf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action" status: 202 len: 0 microversion: 2.1 time: 0.110796 Jul 19 20:54:33.116050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3425/6744] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:54:33 2022] POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:33.129761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.130429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:33.136223 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 20:54:33.138073 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 20:54:33.138415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:33.139966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:33.147612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.148086 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.148891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:33.149388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:33.430184 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:33.441436 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c9547912-36a1-46c8-8b3a-a4cb248aa759 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1762 microversion: 2.1 time: 0.319825 Jul 19 20:54:33.442495 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3320/6745] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1762 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:34.466552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.467331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:34.480091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:34.480622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:34.481496 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:34.481978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:34.487435 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 52946. Jul 19 20:54:34.665388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:34.676223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5d2f7f27-4b9f-40f7-a6ba-abc6c92bffba tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1767 microversion: 2.1 time: 0.216093 Jul 19 20:54:34.676929 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3426/6746] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1767 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:35.694995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:35.695915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:35.707404 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:35.708080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:35.708963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:35.709441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:35.717758 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 52950. Jul 19 20:54:35.732119 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 52952. Jul 19 20:54:35.936758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:35.947841 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7f585932-ff49-480a-892b-4f3c8144b219 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1767 microversion: 2.1 time: 0.257135 Jul 19 20:54:35.948412 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3321/6747] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:35 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1767 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:36.974870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:36.975712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:36.984442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.984961 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:36.986223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:36.987174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:37.165924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:37.180871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fea47a22-f86b-4148-9709-53d0053b18e9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1767 microversion: 2.1 time: 0.210143 Jul 19 20:54:37.181897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3427/6748] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:36 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1767 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:38.201147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:38.201830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:38.210088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:38.210575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:38.211496 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:38.211956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:38.390306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:38.400985 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d667280c-a6be-4218-965d-58c074cf16e4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1767 microversion: 2.1 time: 0.204407 Jul 19 20:54:38.401621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3322/6749] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:38 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1767 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:39.420546 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:39.421213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:39.430661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:39.431344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:39.432300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:39.432870 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:39.621149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:39.630893 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b8d0132-a4a3-4348-b224-705199e0c7dd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1767 microversion: 2.1 time: 0.215233 Jul 19 20:54:39.631581 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3428/6750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:39 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1767 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:40.649781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:40.650532 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:40.660489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:40.660830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:40.661857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:40.662431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:40.842006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:40.851674 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1563ae25-4a0c-4b62-b241-1658d8c196b6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1760 microversion: 2.1 time: 0.205964 Jul 19 20:54:40.853038 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3323/6751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:40 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1760 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:49.293866 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:55:49.294748 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 20:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:55:55.612719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=8 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:55.613495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:55.618502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1310823620"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:55.619144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:55.628300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:55.628758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:55.629593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:55.630050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:55.800871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Removing security group d6ebfabc-9f9a-4ea0-9bff-ce0db924c0db from port 92e46762-d28e-4cfe-af35-c8d7f7c1d633 Jul 19 20:55:56.251172 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a514ac66-f2b4-4435-a621-b8c2ea1a463a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action" status: 202 len: 0 microversion: 2.1 time: 0.640079 Jul 19 20:55:56.265833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3429/6752] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:55:55 2022] POST /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:55:56.275639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=8 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:56.278730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=24 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:56.445542 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-899baf52-719b-432b-8972-d4da751e2432 req-8bbe71e6-a83d-4c6b-ad06-263c06c4bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:56.463206 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-899baf52-719b-432b-8972-d4da751e2432 req-8bbe71e6-a83d-4c6b-ad06-263c06c4bd2b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:56.464980 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-899baf52-719b-432b-8972-d4da751e2432 req-8bbe71e6-a83d-4c6b-ad06-263c06c4bd2b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:56.487805 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-899baf52-719b-432b-8972-d4da751e2432 req-8bbe71e6-a83d-4c6b-ad06-263c06c4bd2b service nova] Creating event network-changed:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:55:56.500252 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-899baf52-719b-432b-8972-d4da751e2432 req-8bbe71e6-a83d-4c6b-ad06-263c06c4bd2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234595 Jul 19 20:55:56.502330 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3324/6753] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:58.532368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2d86781a-ee71-4076-919c-1c69aa42fafa req-3ce8fdef-6765-4739-bf3c-62c39719c850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:58.550553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2d86781a-ee71-4076-919c-1c69aa42fafa req-3ce8fdef-6765-4739-bf3c-62c39719c850 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.551380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2d86781a-ee71-4076-919c-1c69aa42fafa req-3ce8fdef-6765-4739-bf3c-62c39719c850 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.577111 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2d86781a-ee71-4076-919c-1c69aa42fafa req-3ce8fdef-6765-4739-bf3c-62c39719c850 service nova] Creating event network-changed:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:55:58.579004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:58.579761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:58.588851 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2d86781a-ee71-4076-919c-1c69aa42fafa req-3ce8fdef-6765-4739-bf3c-62c39719c850 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060998 Jul 19 20:55:58.589229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.589229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.589229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.589868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.594628 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3430/6754] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:58.702514 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lazy-loading 'services' on Instance uuid 7595a499-fa26-482e-ada9-15f1900aaf26 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:55:58.847591 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f966dd75-28b2-4d02-a43c-7874dcdecf10 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments/3fe9fdfe-1922-472a-8144-3df9815faee2" status: 202 len: 0 microversion: 2.1 time: 0.274774 Jul 19 20:55:58.848388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3325/6755] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:55:58 2022] DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments/3fe9fdfe-1922-472a-8144-3df9815faee2 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:55:58.867668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:58.871436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:58.883267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.884183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.885900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.886748 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.945296 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2506b53a-7d4c-4a49-95f5-96e495796576 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088510 Jul 19 20:55:58.952147 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3431/6756] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:55:58 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:59.968640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:59.971232 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:59.983068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:59.983869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:59.985279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:59.986097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:00.025499 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-561e1aae-8fb1-4629-89f3-dced8e3c9760 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069039 Jul 19 20:56:00.027766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3326/6757] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:55:59 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:01.040691 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:01.042058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:01.051117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:01.051794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:01.052754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:01.053353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:01.111421 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f39785e9-3c12-4f96-a3da-78cbca9cabd8 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075143 Jul 19 20:56:01.112850 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3432/6758] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:01 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:02.133614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:02.135656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:02.149153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:02.149971 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:02.151494 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:02.152312 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:02.211780 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cdf059e1-d32c-457a-86e2-14ffa0fc5e7c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085772 Jul 19 20:56:02.212834 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3327/6759] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:02 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:03.229602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:03.231443 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:03.245213 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:03.246075 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:03.247734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:03.248604 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:03.309985 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d614994-6abc-45d1-b9da-aa6b3749d483 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087799 Jul 19 20:56:03.311960 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3433/6760] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:03 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:04.326671 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:04.328384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:04.343041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:04.344521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:04.346308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:04.347440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:04.405794 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-345e133c-b0ce-49a4-b16c-6b9ab5d71973 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084529 Jul 19 20:56:04.407268 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3328/6761] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:04 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:05.423290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:05.424847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:05.437195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:05.437980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:05.439442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:05.440326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:05.497957 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a0a0c2d-e96f-420f-9b47-441e56d39613 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082573 Jul 19 20:56:05.499056 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3434/6762] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:05 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:56:05.510039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:05.510687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:05.519234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:05.519788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:05.520727 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:05.521226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:05.607645 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] HTTP exception thrown: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 is not attached to volume 3fe9fdfe-1922-472a-8144-3df9815faee2 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Request method failure captured: Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: request: DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments/3fe9fdfe-1922-472a-8144-3df9815faee2 HTTP/1.1 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xlfUVTZj4C6EfzOMJXqBjUXRK8UywIFnC5vKGklzkpWzJH4k_5r1xm-kQ35OpMcUzsS9DzODhrKB3ftyiO9Awd231_zvo6X1kXkmSqcSF-NdUkQjANJtEv6mX7PD0wnxjtYSczXHqC1p1p0DnQn4pV_9HKtFlVJ00HaXT_XsJ_wsI0 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a2580aa0907494d984967043cdbf8da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: ecb241fdd40f4dd1a1fedbb414c5a462 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 is not attached to volume 3fe9fdfe-1922-472a-8144-3df9815faee2 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'server_id': '7595a499-fa26-482e-ada9-15f1900aaf26', 'id': '3fe9fdfe-1922-472a-8144-3df9815faee2'} Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3fe9fdfe-1922-472a-8144-3df9815faee2. Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 is not attached to volume 3fe9fdfe-1922-472a-8144-3df9815faee2 Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:05.609557 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 is not attached to volume 3fe9fdfe-1922-472a-8144-3df9815faee2 Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Returning 404 to user: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 is not attached to volume 3fe9fdfe-1922-472a-8144-3df9815faee2 {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f55ae69d-face-4662-b78a-6cf1a4ef0a3e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments/3fe9fdfe-1922-472a-8144-3df9815faee2" status: 404 len: 154 microversion: 2.1 time: 0.106185 Jul 19 20:56:05.618225 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3329/6763] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:56:05 2022] DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26/os-volume_attachments/3fe9fdfe-1922-472a-8144-3df9815faee2 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:56:10.041795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:10.042689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:10.050495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.050993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.051818 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.052271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.083240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:56:10.187709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8622ca97-0114-426e-a11c-ed7218b6b994 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 204 len: 0 microversion: 2.1 time: 0.149473 Jul 19 20:56:10.189931 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3435/6764] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:56:10 2022] DELETE /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:56:10.204182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:10.205313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:10.217646 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.218308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.219674 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.220426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.408933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:10.424242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e71ad226-a5ae-4f30-bc5d-7fdd62f7424e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1554 microversion: 2.1 time: 0.226272 Jul 19 20:56:10.425263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3330/6765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:10 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:11.444700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:11.445635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:11.454746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:11.455277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:11.456152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:11.456619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:11.615139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:11.624392 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4fbcdfb-ed6a-4917-b76f-a022cc3b9f32 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1554 microversion: 2.1 time: 0.184379 Jul 19 20:56:11.625120 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3436/6766] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:11 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:12.647837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:12.648937 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:12.662990 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.663828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.675871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.680474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.749668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2e993206-3b57-4c31-b7c0-293eaedd613e req-508c13db-06ba-453a-9490-d6d131bf120e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7595a499-fa26-482e-ada9-15f1900aaf26", "name": "network-vif-deleted", "tag": "92e46762-d28e-4cfe-af35-c8d7f7c1d633"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:12.765538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2e993206-3b57-4c31-b7c0-293eaedd613e req-508c13db-06ba-453a-9490-d6d131bf120e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.766481 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2e993206-3b57-4c31-b7c0-293eaedd613e req-508c13db-06ba-453a-9490-d6d131bf120e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.787396 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:12.789832 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2e993206-3b57-4c31-b7c0-293eaedd613e req-508c13db-06ba-453a-9490-d6d131bf120e service nova] Creating event network-vif-deleted:92e46762-d28e-4cfe-af35-c8d7f7c1d633 for instance 7595a499-fa26-482e-ada9-15f1900aaf26 on n-h1-843834-3 Jul 19 20:56:12.797898 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2e993206-3b57-4c31-b7c0-293eaedd613e req-508c13db-06ba-453a-9490-d6d131bf120e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054928 Jul 19 20:56:12.798831 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3437/6767] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:12.799205 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4a6029bc-30b2-4740-826d-b06efbd421e3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 200 len: 1512 microversion: 2.1 time: 0.159216 Jul 19 20:56:12.808210 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3331/6768] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:12 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:13.820538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:13.821205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 7595a499-fa26-482e-ada9-15f1900aaf26] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:13.828768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:13.829680 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:13.830015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:13.830461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:13.850932 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] HTTP exception thrown: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Request method failure captured: Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 HTTP/1.1 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xlfUVTZj4C6EfzOMJXqBjUXRK8UywIFnC5vKGklzkpWzJH4k_5r1xm-kQ35OpMcUzsS9DzODhrKB3ftyiO9Awd231_zvo6X1kXkmSqcSF-NdUkQjANJtEv6mX7PD0wnxjtYSczXHqC1p1p0DnQn4pV_9HKtFlVJ00HaXT_XsJ_wsI0 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a2580aa0907494d984967043cdbf8da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ecb241fdd40f4dd1a1fedbb414c5a462 Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '7595a499-fa26-482e-ada9-15f1900aaf26'} Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:13.852696 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Returning 404 to user: Instance 7595a499-fa26-482e-ada9-15f1900aaf26 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-41d74a94-236f-4d45-a421-e9fe5a73234e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26" status: 404 len: 111 microversion: 2.1 time: 0.039397 Jul 19 20:56:13.861226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3438/6769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:13 2022] GET /compute/v2.1/servers/7595a499-fa26-482e-ada9-15f1900aaf26 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:56:13.870228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e28dc6bd-a11f-402b-91a5-1fcf424e718e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '.version_select at 0x7f23fc0d64c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:13.900437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e28dc6bd-a11f-402b-91a5-1fcf424e718e tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-167368070" status: 202 len: 0 microversion: 2.1 time: 0.035045 Jul 19 20:56:13.901106 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3332/6770] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jul 19 20:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-167368070 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:56:24.391312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd2854db-c3fc-4b2e-87cc-54640a4f6efd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: .version_select at 0x7f23ef85d310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1861709096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8fkZPhR1rFw11pRUvHqTEOjXX0nIoklcKq233aElr5cskZwk2r0F02u/4bVRtoFxcF+k/8i8JOQQBqNUxJ72AclcUi9lTQN64b12Zavf41p540NQJhp7O/b8EEuDh9LQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:24.400772 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.402094 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.426519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fd2854db-c3fc-4b2e-87cc-54640a4f6efd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for project 0a2580aa0907494d984967043cdbf8da. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:24.433758 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fd2854db-c3fc-4b2e-87cc-54640a4f6efd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for user ecb241fdd40f4dd1a1fedbb414c5a462 and project 0a2580aa0907494d984967043cdbf8da. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:24.477627 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd2854db-c3fc-4b2e-87cc-54640a4f6efd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.094571 Jul 19 20:56:24.478516 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3439/6771] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:56:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:24.537059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1504464595", "imageRef": "6c1ae7b0-27e5-4055-872b-a37ebfb51b5c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1861709096", "networks": [{"uuid": "c4780d17-ca12-4111-9d77-a2514c8e5780"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:24.549831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.550617 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.607663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] validate_networks() for [('c4780d17-ca12-4111-9d77-a2514c8e5780', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:56:25.242445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:25.242880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:25.243432 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:25.243861 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:25.244330 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:25.255752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.256216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.257068 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.257505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.282893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for project 0a2580aa0907494d984967043cdbf8da. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:25.294220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Getting quotas for user ecb241fdd40f4dd1a1fedbb414c5a462 and project 0a2580aa0907494d984967043cdbf8da. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:25.321985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:56:25.326905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c1ae7b0-27e5-4055-872b-a37ebfb51b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:56:25.407394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-121764d3-666e-4689-b0e3-9c2b76febbbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877790 Jul 19 20:56:25.408570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3333/6772] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:56:25.427488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-213be0e6-846b-4544-9bab-f351b1fa7405 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:25.429620 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-213be0e6-846b-4544-9bab-f351b1fa7405 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:25.503377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-213be0e6-846b-4544-9bab-f351b1fa7405 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:25.517482 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-213be0e6-846b-4544-9bab-f351b1fa7405 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1259 microversion: 2.1 time: 0.097910 Jul 19 20:56:25.518527 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3440/6773] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:25 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1259 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:26.542130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:26.543480 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:26.558239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.559081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.560517 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.561322 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.692419 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:26.706145 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-beb9e31d-e607-494f-8f72-0b751eca06f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1311 microversion: 2.1 time: 0.171428 Jul 19 20:56:26.706953 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3334/6774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:26 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:27.736485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:27.742223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:27.757305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.758447 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.761114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.762344 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.115376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:28.134594 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9c456f59-a6c1-4f61-b8d2-f5cdd264ce72 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.406740 Jul 19 20:56:28.140023 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3441/6775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:27 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:29.171123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:29.183870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:29.211800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.212623 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.214225 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.228586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.584559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:29.610344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e55ca1a1-a4f2-49d4-b7fb-c90981f13610 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.446802 Jul 19 20:56:29.611970 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3335/6776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:29 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:30.062830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-21ab8480-7e36-442b-8f34-a0b6a8dbf0fb req-91165832-57ab-4a5d-a26d-d2ee3c1baaee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:30.074185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-21ab8480-7e36-442b-8f34-a0b6a8dbf0fb req-91165832-57ab-4a5d-a26d-d2ee3c1baaee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.075060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-21ab8480-7e36-442b-8f34-a0b6a8dbf0fb req-91165832-57ab-4a5d-a26d-d2ee3c1baaee service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.088935 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-21ab8480-7e36-442b-8f34-a0b6a8dbf0fb req-91165832-57ab-4a5d-a26d-d2ee3c1baaee service nova] Creating event network-changed:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:56:30.096265 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-21ab8480-7e36-442b-8f34-a0b6a8dbf0fb req-91165832-57ab-4a5d-a26d-d2ee3c1baaee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176800 Jul 19 20:56:30.098765 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3442/6777] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:30.635789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:30.642214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:30.651254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.651909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.652790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.653294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.907100 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:30.915758 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9acb36b-727c-49b9-a7de-f744f1324995 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.289235 Jul 19 20:56:30.919203 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3336/6778] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:30 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:31.942724 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:31.943731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.954729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.955744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.956967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.957657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.231816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:32.245738 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bbeb65a3-6327-4787-906e-0aff47b9bd89 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.308281 Jul 19 20:56:32.246555 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3443/6779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:31 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:33.265081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:33.266274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:33.277675 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.278430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.279758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.280540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.475778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:33.486293 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-df2324c8-9be2-427e-868c-44e6fb474b65 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.226093 Jul 19 20:56:33.487163 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3337/6780] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:33 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:34.509778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:34.510685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:34.522146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.523114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.524117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.524556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.778803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:34.793740 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4a0deb53-4ef7-41c1-b3e8-a23ad1a63370 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.291487 Jul 19 20:56:34.807029 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3444/6781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:34 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:35.815960 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:35.816771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:35.819425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:35.820446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:35.828035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.828499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.829350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.829844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.068228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:36.079853 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-047ba0ca-0d2e-4ca2-b7d8-b432c8ec6bd0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.269136 Jul 19 20:56:36.080647 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3338/6782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:35 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:37.102953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.104128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.108602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:37.120128 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.120979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.122319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.123429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.368612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:37.383333 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-89680b7a-2228-41f5-914e-7d220af11928 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.287594 Jul 19 20:56:37.384683 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3445/6783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:38.413628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:38.414420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:38.423261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.423736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.424761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.425243 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.631836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:38.643387 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-37c2f48e-8114-41d6-a543-93631678ef30 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.236649 Jul 19 20:56:38.643900 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3339/6784] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:38 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:39.664730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:39.665539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:39.674155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.674663 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.675678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.676182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.339857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:40.355316 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-55d73639-c013-40a6-ba44-a1e6f0d7dfbd tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.695174 Jul 19 20:56:40.356517 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3446/6785] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:39 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:40.565723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d49dd8d7-b51e-4ce7-8e56-e8ab6fa94cdd req-878d17db-aa37-421a-b4f5-c77fc6b1e38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "name": "network-vif-plugged", "status": "completed", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:40.579194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d49dd8d7-b51e-4ce7-8e56-e8ab6fa94cdd req-878d17db-aa37-421a-b4f5-c77fc6b1e38d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.579772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d49dd8d7-b51e-4ce7-8e56-e8ab6fa94cdd req-878d17db-aa37-421a-b4f5-c77fc6b1e38d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.597064 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d49dd8d7-b51e-4ce7-8e56-e8ab6fa94cdd req-878d17db-aa37-421a-b4f5-c77fc6b1e38d service nova] Creating event network-vif-plugged:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:56:40.604029 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d49dd8d7-b51e-4ce7-8e56-e8ab6fa94cdd req-878d17db-aa37-421a-b4f5-c77fc6b1e38d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149100 Jul 19 20:56:40.604755 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3340/6786] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:41.384470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:41.385389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:41.394027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.394516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.395383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.395831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.566031 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:41.578264 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef755850-8811-419a-936c-fb46ea5f0568 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1359 microversion: 2.1 time: 0.199013 Jul 19 20:56:41.579399 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3447/6787] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:41 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:42.605580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:42.606297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:42.614246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.614747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.615823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.616281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.778155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:42.787476 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b22ffc0d-3314-4985-a902-1e0e3388c1f0 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1550 microversion: 2.1 time: 0.187351 Jul 19 20:56:42.788110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3341/6788] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:42 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1550 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:42.804939 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:42.805633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:42.813978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.814446 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.815318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.815782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.991377 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:43.001618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7f1c7c4-0af9-41bb-ae42-b3c2be5cff42 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1550 microversion: 2.1 time: 0.200600 Jul 19 20:56:43.002682 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3448/6789] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:42 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1550 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:43.019984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:43.023716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:43.024573 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Searching by: {'deleted': False, 'project_id': '0a2580aa0907494d984967043cdbf8da'} {{(pid=131230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:56:43.031723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.032565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.034094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.034947 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.066781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.multi_cell_list [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:56:43.117159 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-10bc7ead-5edd-4531-9f57-637ddf3b90e6 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.100822 Jul 19 20:56:43.118256 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3342/6790] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jul 19 20:56:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:43.138332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:43.139521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:43.152064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.152884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.154361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.155233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.361347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:43.375355 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1ab64812-155e-4f63-b21d-77268f839d2c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1550 microversion: 2.1 time: 0.244041 Jul 19 20:56:43.376405 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3449/6791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:43 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1550 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:46.295761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fb40d01-e703-46bb-b443-64f756ebb151"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:46.297335 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:46.310246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.311116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:46.312165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.312733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:46.683942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3a928bea-6c67-4d9a-bc3c-f2c1d431c63a tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391720 Jul 19 20:56:46.685110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3343/6792] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 19 20:56:46 2022] POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:00.153161 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:00.154331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:00.159369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:00.160617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=50 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:00.173127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.173929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.175497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.183017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.403007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:00.421869 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6b5d51ec-9c95-4cca-b7ae-f1a2b15a9a18 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1596 microversion: 2.1 time: 0.275440 Jul 19 20:57:00.423310 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3450/6793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:00 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1596 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:03.041209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:03.043087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:03.045341 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:03.054950 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6c4698e9-653a-448b-b0b6-8b6e1d82a5ea req-85644121-cad8-4737-b247-91abb3459b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:03.075771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6c4698e9-653a-448b-b0b6-8b6e1d82a5ea req-85644121-cad8-4737-b247-91abb3459b19 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.076838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6c4698e9-653a-448b-b0b6-8b6e1d82a5ea req-85644121-cad8-4737-b247-91abb3459b19 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.102040 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6c4698e9-653a-448b-b0b6-8b6e1d82a5ea req-85644121-cad8-4737-b247-91abb3459b19 service nova] Creating event network-changed:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:57:03.111691 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6c4698e9-653a-448b-b0b6-8b6e1d82a5ea req-85644121-cad8-4737-b247-91abb3459b19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074096 Jul 19 20:57:03.113248 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3344/6794] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:04.901858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-906624432"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:04.904091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:04.918464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.919375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:04.920838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.921657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.185211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Adding security group 2b5a1c35-ea62-4850-af03-32db27d1225e to port 3ce6d5be-9d9d-4e0f-a658-6617d003de10 Jul 19 20:57:05.776398 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-17932db2-e619-43ed-b2c2-a5ec295dcf50 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action" status: 202 len: 0 microversion: 2.1 time: 0.882349 Jul 19 20:57:05.777622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3451/6795] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:57:04 2022] POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:05.792256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-774102d0-ed5f-4fba-a90d-1c91a1263c5d req-b72a2798-2bd8-42e6-ac65-4639b078ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:05.795506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:05.798244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:05.814490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.816831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.818661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.822472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.825528 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-774102d0-ed5f-4fba-a90d-1c91a1263c5d req-b72a2798-2bd8-42e6-ac65-4639b078ccd2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.826344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-774102d0-ed5f-4fba-a90d-1c91a1263c5d req-b72a2798-2bd8-42e6-ac65-4639b078ccd2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.851614 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-774102d0-ed5f-4fba-a90d-1c91a1263c5d req-b72a2798-2bd8-42e6-ac65-4639b078ccd2 service nova] Creating event network-changed:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:57:05.862044 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-774102d0-ed5f-4fba-a90d-1c91a1263c5d req-b72a2798-2bd8-42e6-ac65-4639b078ccd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076562 Jul 19 20:57:05.868263 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3345/6796] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:06.204440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:06.219516 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9d8d4b1a-e756-4a8d-98c4-ba1996e4a1ee tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1761 microversion: 2.1 time: 0.434793 Jul 19 20:57:06.220373 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3452/6797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:05 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1761 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:21.652147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.653298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.659889 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:21.661361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:21.674080 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.674507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.675902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.676622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.796536 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8193bca3-e6dc-4acc-809e-d00476487eeb tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action" status: 202 len: 0 microversion: 2.1 time: 0.146798 Jul 19 20:57:21.797614 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3346/6798] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:57:21 2022] POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:21.812897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:21.814046 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:21.819938 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.822122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=16 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.836242 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.837273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.838723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.839526 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.103940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.117082 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-27fe219f-5385-4d68-934a-5130faf43553 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1753 microversion: 2.1 time: 0.312355 Jul 19 20:57:22.118160 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3453/6799] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:21 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1753 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:23.147262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:23.148518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:23.161824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.162565 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.163930 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.164391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.653209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.671204 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae4f0b1c-151f-49b3-9750-6993c6b1d595 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.532648 Jul 19 20:57:23.672101 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3347/6800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:23 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:24.699615 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.700692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.713050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.713892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.715391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.716168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:25.118756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:25.141817 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-15ff6e38-2a95-4f43-9a4d-5c4512280654 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.449913 Jul 19 20:57:25.143047 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3454/6801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:26.172826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:26.173789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:26.185440 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.186146 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.187782 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.188566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.436393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.450335 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-59f59136-d840-4238-80b3-b50a2412cc44 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.284369 Jul 19 20:57:26.451262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3348/6802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:26 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:27.478482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.479295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.491270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.492066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.493464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.494265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.742756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.755008 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dfa1c402-de36-4a7d-81af-d27d15222e58 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.282598 Jul 19 20:57:27.755833 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3455/6803] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:28.780651 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.781843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.795580 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.796422 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.797973 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.798834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.066545 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.081279 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0acdb0be-3446-4c67-86ba-eb0360b36ad9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.308058 Jul 19 20:57:29.082265 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3349/6804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:29.854408 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:57:29.855329 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 20:57:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:57:30.104685 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:30.105574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:30.117900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.118370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.119260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.119708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.367222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.379068 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-352efe24-f6f6-46cb-ba4a-bf756195c9f9 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.280504 Jul 19 20:57:30.380123 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3456/6805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:30 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:31.403802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:31.404527 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:31.418311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.418787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.419738 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.420213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.666398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.677062 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5552f8db-b00d-4c93-8310-31c8990c1fe4 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.278110 Jul 19 20:57:31.677809 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3350/6806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:31 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:32.702992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:32.703831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:32.712815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.713272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.714125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.714616 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.941286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:32.956973 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b778561f-315f-41b3-ad7a-20768e19f092 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1758 microversion: 2.1 time: 0.259623 Jul 19 20:57:32.957897 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3457/6807] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:32 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1758 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:33.985611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.986799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.000264 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.000760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.001689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.002172 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.267696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.290969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6c9dd767-a6be-487b-bc81-e8b95c819eb7 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1761 microversion: 2.1 time: 0.312608 Jul 19 20:57:34.292079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3351/6808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1761 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:07.173285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-906624432"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:07.174235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:07.178239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=10 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:07.179393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=30 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:07.190001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.190751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.192217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.192979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.366235 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.network.security_group_api [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Removing security group 2b5a1c35-ea62-4850-af03-32db27d1225e from port 3ce6d5be-9d9d-4e0f-a658-6617d003de10 Jul 19 20:58:07.854751 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1eb781b0-1446-45ed-8848-069eef78f340 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action" status: 202 len: 0 microversion: 2.1 time: 0.685433 Jul 19 20:58:07.855950 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3458/6809] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:07 2022] POST /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:07.879813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-5d0c4fa3-7498-4cb8-ae07-452e62a8902d req-11694e2a-bf37-4a99-a25f-9823effaebcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:07.893875 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:07.900303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:07.928230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5d0c4fa3-7498-4cb8-ae07-452e62a8902d req-11694e2a-bf37-4a99-a25f-9823effaebcf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.931213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-5d0c4fa3-7498-4cb8-ae07-452e62a8902d req-11694e2a-bf37-4a99-a25f-9823effaebcf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.984140 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-5d0c4fa3-7498-4cb8-ae07-452e62a8902d req-11694e2a-bf37-4a99-a25f-9823effaebcf service nova] Creating event network-changed:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:58:07.997425 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-5d0c4fa3-7498-4cb8-ae07-452e62a8902d req-11694e2a-bf37-4a99-a25f-9823effaebcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124738 Jul 19 20:58:07.998793 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3352/6810] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:10.045090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:10.045994 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:10.055565 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.056493 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.057543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.057709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4179a513-0bf6-4bb5-9a0c-aa71ae3b7ccc req-b36061f3-bb22-4be6-903f-08c6aaba7db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:10.058752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.074429 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4179a513-0bf6-4bb5-9a0c-aa71ae3b7ccc req-b36061f3-bb22-4be6-903f-08c6aaba7db7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.075366 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4179a513-0bf6-4bb5-9a0c-aa71ae3b7ccc req-b36061f3-bb22-4be6-903f-08c6aaba7db7 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.098721 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4179a513-0bf6-4bb5-9a0c-aa71ae3b7ccc req-b36061f3-bb22-4be6-903f-08c6aaba7db7 service nova] Creating event network-changed:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:58:10.108040 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4179a513-0bf6-4bb5-9a0c-aa71ae3b7ccc req-b36061f3-bb22-4be6-903f-08c6aaba7db7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060921 Jul 19 20:58:10.109044 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3353/6811] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:10.184253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lazy-loading 'services' on Instance uuid 9329576b-bbb6-43bf-ab4d-09803095ad91 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:10.296487 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72d22683-de6e-4aae-9d8a-be146136431b tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments/7fb40d01-e703-46bb-b443-64f756ebb151" status: 202 len: 0 microversion: 2.1 time: 0.255929 Jul 19 20:58:10.299539 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3459/6812] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:58:10 2022] DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments/7fb40d01-e703-46bb-b443-64f756ebb151 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:10.317147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:10.318817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:10.335771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.337587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.338764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.339418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.397876 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f561719e-4637-415e-b597-f7af41241ff3 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088219 Jul 19 20:58:10.399577 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3354/6813] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:10 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:11.415991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:11.417168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:11.429875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.431275 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.433144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.435779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.511228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-155f198d-ec99-4e34-a70a-836d9e53c435 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100230 Jul 19 20:58:11.512600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3460/6814] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:11 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:12.528321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:12.531124 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:12.546320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.546880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.554116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.554116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.601087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a05dbcaa-6d1c-49a1-a67d-1621f8649fc1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077327 Jul 19 20:58:12.602272 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3355/6815] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:12 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:13.616484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:13.617658 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:13.629449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.630079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.631328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.631979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.679993 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-81cb3cfa-8cd8-4ccc-bb77-feae6fc9e222 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067612 Jul 19 20:58:13.681306 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3461/6816] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:13 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:14.695310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:14.697425 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:14.706516 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.707178 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.708173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.708788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.747991 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-07dd0af5-292a-4d42-955e-9b002deed8c2 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057559 Jul 19 20:58:14.748791 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3356/6817] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:14 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:15.762611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:15.763937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:15.773259 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.774058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.775253 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.775779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.825645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-69cdc921-cb2c-4806-9828-28138190116c tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068109 Jul 19 20:58:15.826975 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3462/6818] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:15 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:16.843281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.845033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.853916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.854435 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.855430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.855966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.896309 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-43607833-56bf-44c7-8192-4432ba84bbbf tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060115 Jul 19 20:58:16.897026 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3357/6819] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:16 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:58:16.909216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.910104 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.918866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.919369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.920197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.920647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.023835 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] HTTP exception thrown: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 is not attached to volume 7fb40d01-e703-46bb-b443-64f756ebb151 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Request method failure captured: Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: request: DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments/7fb40d01-e703-46bb-b443-64f756ebb151 HTTP/1.1 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xlfUVTZj4C6EfzOMJXqBjUXRK8UywIFnC5vKGklzkpWzJH4k_5r1xm-kQ35OpMcUzsS9DzODhrKB3ftyiO9Awd231_zvo6X1kXkmSqcSF-NdUkQjANJtEv6mX7PD0wnxjtYSczXHqC1p1p0DnQn4pV_9HKtFlVJ00HaXT_XsJ_wsI0 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a2580aa0907494d984967043cdbf8da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ecb241fdd40f4dd1a1fedbb414c5a462 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 is not attached to volume 7fb40d01-e703-46bb-b443-64f756ebb151 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'server_id': '9329576b-bbb6-43bf-ab4d-09803095ad91', 'id': '7fb40d01-e703-46bb-b443-64f756ebb151'} Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7fb40d01-e703-46bb-b443-64f756ebb151. Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 is not attached to volume 7fb40d01-e703-46bb-b443-64f756ebb151 Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:17.027541 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 is not attached to volume 7fb40d01-e703-46bb-b443-64f756ebb151 Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Returning 404 to user: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 is not attached to volume 7fb40d01-e703-46bb-b443-64f756ebb151 {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-de141f50-cfe8-45e2-a3b1-5bbdade0e7ff tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments/7fb40d01-e703-46bb-b443-64f756ebb151" status: 404 len: 154 microversion: 2.1 time: 0.125047 Jul 19 20:58:17.035669 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3463/6820] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 19 20:58:16 2022] DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91/os-volume_attachments/7fb40d01-e703-46bb-b443-64f756ebb151 => generated 154 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:21.478262 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:21.479221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.493382 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.494195 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.495746 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.496547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.550313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:21.721692 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bb93f306-57d0-496a-bc71-6bd5e8abef63 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 204 len: 0 microversion: 2.1 time: 0.249883 Jul 19 20:58:21.722875 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3358/6821] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:21 2022] DELETE /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:58:21.743860 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:21.747494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.760495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.761355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.762963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.764030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.979824 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:21.994645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bbea1324-ad2d-4d20-83e9-8e66a4c36592 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1556 microversion: 2.1 time: 0.262081 Jul 19 20:58:21.995867 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3464/6822] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:21 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:23.025606 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:23.026450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:23.035325 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.035795 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.036615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.037097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.202107 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:23.210887 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-13b8a608-4ce7-42e6-b805-1357d0eddb21 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1556 microversion: 2.1 time: 0.189731 Jul 19 20:58:23.212499 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3359/6823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:23 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:24.086946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2463c59d-e529-45e6-9f5f-a82e0d63641f req-a9a7530d-9ddf-4633-9b12-c93c965c8a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329576b-bbb6-43bf-ab4d-09803095ad91", "name": "network-vif-deleted", "tag": "3ce6d5be-9d9d-4e0f-a658-6617d003de10"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:24.098926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2463c59d-e529-45e6-9f5f-a82e0d63641f req-a9a7530d-9ddf-4633-9b12-c93c965c8a46 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.099387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2463c59d-e529-45e6-9f5f-a82e0d63641f req-a9a7530d-9ddf-4633-9b12-c93c965c8a46 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.115253 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2463c59d-e529-45e6-9f5f-a82e0d63641f req-a9a7530d-9ddf-4633-9b12-c93c965c8a46 service nova] Creating event network-vif-deleted:3ce6d5be-9d9d-4e0f-a658-6617d003de10 for instance 9329576b-bbb6-43bf-ab4d-09803095ad91 on n-h2-843834-3 Jul 19 20:58:24.123166 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2463c59d-e529-45e6-9f5f-a82e0d63641f req-a9a7530d-9ddf-4633-9b12-c93c965c8a46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040519 Jul 19 20:58:24.124155 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3465/6824] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:24.236257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:24.239942 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:24.254443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.254903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.256706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.257412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.299216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.299879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.300505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lazy-loading 'fault' on Instance uuid 9329576b-bbb6-43bf-ab4d-09803095ad91 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:24.362356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb241fdd40f4dd1a1fedbb414c5a462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2580aa0907494d984967043cdbf8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:24.370761 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-60e4aee3-aee1-4ccb-95e5-00bb6bf7a1f1 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 200 len: 1349 microversion: 2.1 time: 0.143394 Jul 19 20:58:24.371420 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3360/6825] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:24 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 1349 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:25.390753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:25.391459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] [instance: 9329576b-bbb6-43bf-ab4d-09803095ad91] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:25.398959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.399867 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.400596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.401048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.418067 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] HTTP exception thrown: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Request method failure captured: Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 HTTP/1.1 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xlfUVTZj4C6EfzOMJXqBjUXRK8UywIFnC5vKGklzkpWzJH4k_5r1xm-kQ35OpMcUzsS9DzODhrKB3ftyiO9Awd231_zvo6X1kXkmSqcSF-NdUkQjANJtEv6mX7PD0wnxjtYSczXHqC1p1p0DnQn4pV_9HKtFlVJ00HaXT_XsJ_wsI0 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a2580aa0907494d984967043cdbf8da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2580aa0907494d984967043cdbf8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: 0a2580aa0907494d984967043cdbf8da Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563765547 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: ecb241fdd40f4dd1a1fedbb414c5a462 Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestMinimumBasicScenario-563765547-project Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '9329576b-bbb6-43bf-ab4d-09803095ad91'} Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:25.419997 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Returning 404 to user: Instance 9329576b-bbb6-43bf-ab4d-09803095ad91 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-252972f6-7a91-4be7-bb34-9e602375e817 tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91" status: 404 len: 111 microversion: 2.1 time: 0.036405 Jul 19 20:58:25.426550 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3466/6826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:25 2022] GET /compute/v2.1/servers/9329576b-bbb6-43bf-ab4d-09803095ad91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:25.434063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fa34eaaa-6320-49b4-ac1f-c1f75f2afbed tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] Calling method '.version_select at 0x7f23ee799ee0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:25.465082 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fa34eaaa-6320-49b4-ac1f-c1f75f2afbed tempest-TestMinimumBasicScenario-563765547 tempest-TestMinimumBasicScenario-563765547-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861709096" status: 202 len: 0 microversion: 2.1 time: 0.037211 Jul 19 20:58:25.466022 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3361/6827] 10.222.0.23 () {58 vars in 1271 bytes} [Tue Jul 19 20:58:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861709096 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:38.548729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=18 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:38.550172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:38.764233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-45caea54-b5f1-4277-b2c8-52d1dc19c8fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: .version_select at 0x7f23ef6720d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1679257857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtnJE6WxXZWi3D7SrQf73h4oJZwZtybVufozYLhoQX2qIy9hJgeBtVPgbg/RYK2Nr9z5Lz5ljjOTe+tTuKAUjHzaxjiLnvf7hzxnwfYW8lUdqzg3yETi+lfpTaHGy4eFQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:38.781573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-45caea54-b5f1-4277-b2c8-52d1dc19c8fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:38.788763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-45caea54-b5f1-4277-b2c8-52d1dc19c8fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:38.821016 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-45caea54-b5f1-4277-b2c8-52d1dc19c8fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.282635 Jul 19 20:58:38.821787 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3467/6828] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:58:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:48.054230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:48.056182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:48.064469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1510854759", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "b7e0ac02-a14c-4afb-85c5-6abf4d29c66d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1679257857", "security_groups": [{"name": "tempest-secgroup-smoke-1819985243"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:48.269618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] validate_networks() for [('b7e0ac02-a14c-4afb-85c5-6abf4d29c66d', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:49.478310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:49.479400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:49.481272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:49.482271 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:49.483069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:49.500075 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.501768 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.504006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.505436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.537908 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:49.545486 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:49.574123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:49.579959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:49.673683 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [0ac76228-8b84-4e78-be0d-f472d1549a4e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 20:58:50.684344 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [0ac76228-8b84-4e78-be0d-f472d1549a4e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 53610. Jul 19 20:58:50.691930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-435089f8-d526-4732-b231-bc516cb7f8c1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.641011 Jul 19 20:58:50.694120 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3362/6829] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:58:50.709896 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-379cc383-11a8-4007-8066-53368609f1ac tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.710519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-379cc383-11a8-4007-8066-53368609f1ac tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.713676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:50.714380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:50.810144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-379cc383-11a8-4007-8066-53368609f1ac tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:50.818762 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-379cc383-11a8-4007-8066-53368609f1ac tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1267 microversion: 2.1 time: 0.113932 Jul 19 20:58:50.819548 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3468/6830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:50 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:51.840489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:51.841453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:51.850811 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.851504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.852886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.853306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.962572 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:51.973117 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd72f445-8ce8-4af1-a74f-09365159bc17 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1319 microversion: 2.1 time: 0.138222 Jul 19 20:58:51.980099 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3363/6831] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:51 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:53.002558 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:53.003634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:53.014743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.015308 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:53.016532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.017090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:53.116859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:53.130106 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1a1088b3-723c-4126-a552-a6f31c7ecb7d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1325 microversion: 2.1 time: 0.132150 Jul 19 20:58:53.131364 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3469/6832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:52 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1325 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:54.149653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:54.150510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:54.158628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.159456 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.160333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.160784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.549788 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d4b806d6-f4e8-493e-b6a8-42d1032b1822 req-2890be41-bf14-42eb-aff9-b669a0041b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e69aee-9236-4057-8bb3-c9402dff7695", "tag": "9c622af0-cd6f-490d-b578-896ad763c3c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:54.565440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4b806d6-f4e8-493e-b6a8-42d1032b1822 req-2890be41-bf14-42eb-aff9-b669a0041b68 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.566092 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d4b806d6-f4e8-493e-b6a8-42d1032b1822 req-2890be41-bf14-42eb-aff9-b669a0041b68 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.582722 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d4b806d6-f4e8-493e-b6a8-42d1032b1822 req-2890be41-bf14-42eb-aff9-b669a0041b68 service nova] Creating event network-changed:9c622af0-cd6f-490d-b578-896ad763c3c4 for instance 01e69aee-9236-4057-8bb3-c9402dff7695 on n-h1-843834-3 Jul 19 20:58:54.589436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:54.590453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d4b806d6-f4e8-493e-b6a8-42d1032b1822 req-2890be41-bf14-42eb-aff9-b669a0041b68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049886 Jul 19 20:58:54.592011 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3470/6833] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:54.606826 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8e98ac1b-fdbd-4196-9b39-8978aca69fc8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.460775 Jul 19 20:58:54.608498 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3364/6834] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:54 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:55.633069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:55.634207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:55.644329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.645007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.645846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.646337 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.879123 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:55.889179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1f7cb8ef-7473-40ec-a81e-6912f74e7de2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.263480 Jul 19 20:58:55.889709 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3471/6835] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:55 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:56.911244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:56.912254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:56.923984 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.924483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.925340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.925807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.097953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:57.107641 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-842444c3-dfe3-4888-8205-2b477e3619c8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.201873 Jul 19 20:58:57.108358 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3365/6836] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:56 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:58.126854 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:58.128405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:58.138858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.139357 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.140233 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.141108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.314470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:58.323883 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ea263e9-72d4-45bd-bf65-905e0bc182fb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.201713 Jul 19 20:58:58.324612 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3472/6837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:58 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:59.349006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:59.350211 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:59.365024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:59.365911 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:59.367431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:59.368221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:59.528981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:59.549975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8b376b86-9b7f-46ea-9062-ad3a64be7e80 req-ece29615-e412-49df-bebd-eac3e65a98f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e69aee-9236-4057-8bb3-c9402dff7695", "name": "network-vif-plugged", "status": "completed", "tag": "9c622af0-cd6f-490d-b578-896ad763c3c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:59.562385 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8b376b86-9b7f-46ea-9062-ad3a64be7e80 req-ece29615-e412-49df-bebd-eac3e65a98f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:59.562616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:59.563090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8b376b86-9b7f-46ea-9062-ad3a64be7e80 req-ece29615-e412-49df-bebd-eac3e65a98f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:59.581983 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8b376b86-9b7f-46ea-9062-ad3a64be7e80 req-ece29615-e412-49df-bebd-eac3e65a98f0 service nova] Creating event network-vif-plugged:9c622af0-cd6f-490d-b578-896ad763c3c4 for instance 01e69aee-9236-4057-8bb3-c9402dff7695 on n-h1-843834-3 Jul 19 20:58:59.591541 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8b376b86-9b7f-46ea-9062-ad3a64be7e80 req-ece29615-e412-49df-bebd-eac3e65a98f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045386 Jul 19 20:58:59.593967 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3473/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:59.639287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:59.651435 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1263ff3-2c4a-4c21-930d-319a7bc4cd03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.312138 Jul 19 20:58:59.653324 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3366/6839] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:59 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:00.682711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:00.683619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:00.696574 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.697358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.698808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.699672 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.816237 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:00.922601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:00.938817 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2ba1e9f5-0191-4881-b978-166627228da5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1393 microversion: 2.1 time: 0.266524 Jul 19 20:59:00.939865 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3474/6840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:00 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:01.960223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:01.961140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:01.970326 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.970854 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.972151 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.972662 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.203540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.215945 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ad797bcb-f351-4f46-8a79-079197a8c7dc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1565 microversion: 2.1 time: 0.259650 Jul 19 20:59:02.216571 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3367/6841] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:01 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:02.234278 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:02.235082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:02.244339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.245158 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.246274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.246683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.510228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.523179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14dbde1e-017c-4584-a693-26dab50610e3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1565 microversion: 2.1 time: 0.292824 Jul 19 20:59:02.523976 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3475/6842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:02 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1565 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:05.543140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:05.545176 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:05.549675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f1a27d56-739e-457a-8f6b-e98099835ba9 req-07e9302a-6100-443a-9b56-ac7e423e3c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e69aee-9236-4057-8bb3-c9402dff7695", "tag": "9c622af0-cd6f-490d-b578-896ad763c3c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:05.556446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.557739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.559728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.560916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.565588 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f1a27d56-739e-457a-8f6b-e98099835ba9 req-07e9302a-6100-443a-9b56-ac7e423e3c24 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.566404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f1a27d56-739e-457a-8f6b-e98099835ba9 req-07e9302a-6100-443a-9b56-ac7e423e3c24 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.589981 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f1a27d56-739e-457a-8f6b-e98099835ba9 req-07e9302a-6100-443a-9b56-ac7e423e3c24 service nova] Creating event network-changed:9c622af0-cd6f-490d-b578-896ad763c3c4 for instance 01e69aee-9236-4057-8bb3-c9402dff7695 on n-h1-843834-3 Jul 19 20:59:05.602221 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f1a27d56-739e-457a-8f6b-e98099835ba9 req-07e9302a-6100-443a-9b56-ac7e423e3c24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059530 Jul 19 20:59:05.603625 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3476/6843] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:05.926129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.939340 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e83b425-ac65-4bf4-b6ac-8cf40a33f8bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1565 microversion: 2.1 time: 0.401080 Jul 19 20:59:05.942371 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3368/6844] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:05 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1565 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:28.494863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:28.495968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.499207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=20 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:28.499935 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:28.509690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.510207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.511244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.511812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.577167 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-34945763-28b3-41f4-933e-cafe061d14a0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action" status: 200 len: 24568 microversion: 2.1 time: 0.087823 Jul 19 20:59:28.578348 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3477/6845] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:59:28 2022] POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:59:39.575912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:39.576773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:39.579447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:39.580239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=38 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:39.587669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.588236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.589180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.589802 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.676917 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-84d4bf23-4236-4b2c-b728-81fb3c3570be tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action" status: 202 len: 0 microversion: 2.1 time: 0.106441 Jul 19 20:59:39.678072 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3369/6846] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:59:39 2022] POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:39.691755 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:39.692657 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:39.695502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:39.696776 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:39.705980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.705980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.706720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.707250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.954507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.972399 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b835c7c5-5974-4951-b550-32ee84ed57bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1688 microversion: 2.1 time: 0.286332 Jul 19 20:59:39.973416 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3478/6847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:39 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1688 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:40.995757 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.996772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:41.006209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.006902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.008025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.008773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.209509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.222387 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-14ac0afe-63be-4e01-b815-615e64a6b053 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1668 microversion: 2.1 time: 0.232386 Jul 19 20:59:41.223105 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3370/6848] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:42.339708 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:42.341451 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.356016 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.356792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.358258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.359013 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.442855 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8c44cff3-9227-448d-9c2c-7da3dfc1bd7a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action" status: 200 len: 32639 microversion: 2.1 time: 0.109152 Jul 19 20:59:42.443690 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3479/6849] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:59:42 2022] POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action => generated 32639 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:59:42.457518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:42.458128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.467185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.467780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.468744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.469305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.571619 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f1f70f2f-2036-4989-a423-7c72c3026d81 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action" status: 202 len: 0 microversion: 2.1 time: 0.117510 Jul 19 20:59:42.572986 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3371/6850] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:59:42 2022] POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:59:42.591947 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:42.593160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.611978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.612522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.613484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.614086 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.864688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.883590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12557d36-4ef7-4136-bf6d-ec7022e39465 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1675 microversion: 2.1 time: 0.300673 Jul 19 20:59:42.884662 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3480/6851] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:42 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1675 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:43.907368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.908115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.920903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.921678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.923038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.923812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.200354 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:44.210374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ede6cdf8-8293-4070-a008-86b88e2e6d7b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1683 microversion: 2.1 time: 0.309017 Jul 19 20:59:44.211116 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3372/6852] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:43 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1683 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:44.342780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:44.343941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:44.358061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.358899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.360483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.361284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.429822 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9e617964-078c-4352-8681-91a1992ceb19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action" status: 200 len: 35840 microversion: 2.1 time: 0.091387 Jul 19 20:59:44.430630 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3481/6853] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 20:59:44 2022] POST /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695/action => generated 35840 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:59:46.125250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.126244 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-85098968-6aff-48af-80d2-32272f4ef3d5 req-1a52b33b-1176-4482-9490-8d15ccc62e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e69aee-9236-4057-8bb3-c9402dff7695", "tag": "9c622af0-cd6f-490d-b578-896ad763c3c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:46.133022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.148692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.149835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85098968-6aff-48af-80d2-32272f4ef3d5 req-1a52b33b-1176-4482-9490-8d15ccc62e02 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.150528 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-85098968-6aff-48af-80d2-32272f4ef3d5 req-1a52b33b-1176-4482-9490-8d15ccc62e02 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.151612 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.156814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.157569 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.178984 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-85098968-6aff-48af-80d2-32272f4ef3d5 req-1a52b33b-1176-4482-9490-8d15ccc62e02 service nova] Creating event network-changed:9c622af0-cd6f-490d-b578-896ad763c3c4 for instance 01e69aee-9236-4057-8bb3-c9402dff7695 on n-h1-843834-3 Jul 19 20:59:46.188310 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-85098968-6aff-48af-80d2-32272f4ef3d5 req-1a52b33b-1176-4482-9490-8d15ccc62e02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072208 Jul 19 20:59:46.194167 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3482/6854] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:46.206499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:46.380597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7bc42557-9ad4-4605-8486-106d90287a14 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 204 len: 0 microversion: 2.1 time: 0.271163 Jul 19 20:59:46.384381 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3373/6855] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:46 2022] DELETE /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:59:46.405071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.407143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.425201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.426274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.428304 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.429297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.697723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.716476 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7055ac9a-8cd4-40ec-bf7e-2e9c2a14dd50 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1689 microversion: 2.1 time: 0.325134 Jul 19 20:59:46.718033 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3483/6856] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1689 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:47.746765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:47.747633 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:47.756408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.757062 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.757958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.758622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.145147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:48.158720 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a41138c5-e75e-4eea-a622-8c773573b158 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1689 microversion: 2.1 time: 0.417763 Jul 19 20:59:48.159430 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3374/6857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:47 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1689 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:49.002809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-8c9afdef-cc87-4b4a-9272-b25fce406c60 req-667b7c55-f973-4a0c-9d8a-9b81faa42e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e69aee-9236-4057-8bb3-c9402dff7695", "name": "network-vif-deleted", "tag": "9c622af0-cd6f-490d-b578-896ad763c3c4"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:49.016217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8c9afdef-cc87-4b4a-9272-b25fce406c60 req-667b7c55-f973-4a0c-9d8a-9b81faa42e75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.016893 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-8c9afdef-cc87-4b4a-9272-b25fce406c60 req-667b7c55-f973-4a0c-9d8a-9b81faa42e75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.032826 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-8c9afdef-cc87-4b4a-9272-b25fce406c60 req-667b7c55-f973-4a0c-9d8a-9b81faa42e75 service nova] Creating event network-vif-deleted:9c622af0-cd6f-490d-b578-896ad763c3c4 for instance 01e69aee-9236-4057-8bb3-c9402dff7695 on n-h1-843834-3 Jul 19 20:59:49.041155 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-8c9afdef-cc87-4b4a-9272-b25fce406c60 req-667b7c55-f973-4a0c-9d8a-9b81faa42e75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043822 Jul 19 20:59:49.042099 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3484/6858] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:49.178848 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:49.179745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:49.188126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.188779 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.189772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.190495 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.231547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.232212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.232839 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lazy-loading 'fault' on Instance uuid 01e69aee-9236-4057-8bb3-c9402dff7695 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:49.295471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:49.309160 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7b3bc9fb-8137-4a32-ab8a-5c5d4ce0e383 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 200 len: 1357 microversion: 2.1 time: 0.134628 Jul 19 20:59:49.309835 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3375/6859] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:49 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 1357 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:50.333929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:50.335069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 01e69aee-9236-4057-8bb3-c9402dff7695] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:50.346667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.347497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.348897 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.349575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.379522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] HTTP exception thrown: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Request method failure captured: Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 HTTP/1.1 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xr9nrb49zQu7WaxZSdT805KQFppjC4a8B3v9f0ThMPSeqHVdXwJg0kRa5oe7dUsixeGuTqOKyxsCknd46MLik8M4fhETJHZQQVSj12g3bozBIxnGHsU3sMpO8qEOYzjs3rGHJyAiaTC6aD6Fb8BvGsEYBk1m0vjgUunB94QYv6vY0k Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c2937674a925420488961fb21fd37a97 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2937674a925420488961fb21fd37a97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2937674a925420488961fb21fd37a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c2937674a925420488961fb21fd37a97 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a2810fbc1ca54186b8e9b51620466855 Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '01e69aee-9236-4057-8bb3-c9402dff7695'} Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:50.382753 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Returning 404 to user: Instance 01e69aee-9236-4057-8bb3-c9402dff7695 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-be9b9e37-bfb7-47b1-8f93-95a91c36d00e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695" status: 404 len: 111 microversion: 2.1 time: 0.059767 Jul 19 20:59:50.391720 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3485/6860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:50 2022] GET /compute/v2.1/servers/01e69aee-9236-4057-8bb3-c9402dff7695 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:56.149751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-275c50a6-47ea-4858-9eff-34047648d563 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '.version_select at 0x7f23ee727280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.196364 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-275c50a6-47ea-4858-9eff-34047648d563 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1679257857" status: 202 len: 0 microversion: 2.1 time: 0.052206 Jul 19 20:59:56.204106 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3376/6861] 10.222.0.23 () {58 vars in 1283 bytes} [Tue Jul 19 20:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1679257857 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:59:56.240183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8403603f-a41a-426f-b5ea-e8e779f34a45 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: .version_select at 0x7f23ef85d430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-129143804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF64LjK5Fe3kGT3sO41FSTMCTaqJCo76FCQlN0bdDY3IlzIoO1XfpmEmShqk1sgQLXWVK6GIr27R5CRNhGBtcWt4EGZGsXgwil0YJbgYLAV5UEYUy+f3HPZjx5ttZaIh3Q=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:56.263597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8403603f-a41a-426f-b5ea-e8e779f34a45 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:56.272332 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-8403603f-a41a-426f-b5ea-e8e779f34a45 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:56.311201 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8403603f-a41a-426f-b5ea-e8e779f34a45 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.076620 Jul 19 20:59:56.311922 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3486/6862] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 20:59:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:05.451478 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-238687911", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "a0970725-79f7-44ea-a83b-a94d1c6be9b1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-129143804", "security_groups": [{"name": "tempest-secgroup-smoke-1508231538"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:05.472373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:05.627902 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] validate_networks() for [('a0970725-79f7-44ea-a83b-a94d1c6be9b1', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:00:06.247479 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:00:06.248272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:00:06.249379 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:00:06.250092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:00:06.250871 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:00:06.268040 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.268879 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.270257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:06.271181 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.299844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:00:06.312399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:00:06.338130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:00:06.341022 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:00:06.417234 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c7301503-87af-4789-b971-55625ed406a1 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973801 Jul 19 21:00:06.418601 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3377/6863] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:00:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:00:06.441265 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-258ca19a-2d72-4bb0-9c7b-068facfa84f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:06.442538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-258ca19a-2d72-4bb0-9c7b-068facfa84f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:06.457712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=32 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:06.459673 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:06.462189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:06.563765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-258ca19a-2d72-4bb0-9c7b-068facfa84f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.579136 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-258ca19a-2d72-4bb0-9c7b-068facfa84f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1265 microversion: 2.1 time: 0.146565 Jul 19 21:00:06.580452 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3487/6864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:06 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:07.604710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:07.605654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:07.616202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:07.616710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:07.617652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:07.618301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:07.761655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:07.780473 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ec068c29-67ab-42b6-9472-dc2e8d3d597b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1317 microversion: 2.1 time: 0.179942 Jul 19 21:00:07.782478 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3378/6865] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:07 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:08.826347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:08.828139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:08.844856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.845951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.848469 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.851033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.947204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:08.957568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a8b4e9e8-c3fd-4e3c-bd3b-2c35e3508ae9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1323 microversion: 2.1 time: 0.147924 Jul 19 21:00:08.958118 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3488/6866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:08 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:09.979595 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:09.980736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:09.983559 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:09.990469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:09.991497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:09.992652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:09.993460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:10.271734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:10.291797 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-667f8506-8212-442b-8a1c-37f8f8917788 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.316899 Jul 19 21:00:10.292610 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3379/6867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:09 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:10.626115 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-d82172d8-268c-4bc7-b83d-006360960c72 req-050874f4-cc5f-4f4b-9a62-864e9d717533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c596128d-1efd-4e76-adc1-4482afca11a3", "tag": "22d1b6fa-d95f-4580-8825-016040cceb1c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:10.657864 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d82172d8-268c-4bc7-b83d-006360960c72 req-050874f4-cc5f-4f4b-9a62-864e9d717533 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:10.663656 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-d82172d8-268c-4bc7-b83d-006360960c72 req-050874f4-cc5f-4f4b-9a62-864e9d717533 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:10.698950 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-d82172d8-268c-4bc7-b83d-006360960c72 req-050874f4-cc5f-4f4b-9a62-864e9d717533 service nova] Creating event network-changed:22d1b6fa-d95f-4580-8825-016040cceb1c for instance c596128d-1efd-4e76-adc1-4482afca11a3 on n-h2-843834-3 Jul 19 21:00:10.709223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-d82172d8-268c-4bc7-b83d-006360960c72 req-050874f4-cc5f-4f4b-9a62-864e9d717533 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090767 Jul 19 21:00:10.710577 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3489/6868] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:11.312502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:11.313279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:11.326702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:11.326702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:11.327827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:11.328628 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:11.554215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:11.563138 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-44a28382-b56d-4047-8549-47d45891b059 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.255960 Jul 19 21:00:11.563799 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3380/6869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:11 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:12.588642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:12.589888 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:12.602107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:12.605169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:12.606293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:12.606764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:12.831932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:12.845042 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8cd63a29-1222-47a3-b373-eaa7f8f102a3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.265431 Jul 19 21:00:12.845947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3490/6870] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:12 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:13.872244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:13.872887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:13.883899 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:13.884751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:13.886411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:13.887222 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:14.098424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:14.107840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8d8c8ec5-8b30-47f2-b48e-0770ffc287d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.240852 Jul 19 21:00:14.108599 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3381/6871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:13 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:15.136642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:15.137780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:15.152391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:15.153107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:15.154239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:15.154827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:15.345144 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:15.358803 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a0fa4434-1f5d-4c09-b5c1-eafe8861345d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.228360 Jul 19 21:00:15.360622 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3491/6872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:15 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:16.379360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:16.380298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:16.383726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:16.385144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:16.395453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:16.396472 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:16.397355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:16.397887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:16.599890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:16.611952 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0e903203-0bae-4a1e-bea0-b562172d9594 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.236760 Jul 19 21:00:16.612629 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3382/6873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:16 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:00:17.547714 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1f3fbe3f-7006-4ca8-ac7d-9d1b7f6fe795 req-daf54e9f-efeb-4de9-b914-d05e6731f0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c596128d-1efd-4e76-adc1-4482afca11a3", "name": "network-vif-plugged", "status": "completed", "tag": "22d1b6fa-d95f-4580-8825-016040cceb1c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:17.553004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:17.562779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1f3fbe3f-7006-4ca8-ac7d-9d1b7f6fe795 req-daf54e9f-efeb-4de9-b914-d05e6731f0b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:17.563553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1f3fbe3f-7006-4ca8-ac7d-9d1b7f6fe795 req-daf54e9f-efeb-4de9-b914-d05e6731f0b2 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:17.580029 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1f3fbe3f-7006-4ca8-ac7d-9d1b7f6fe795 req-daf54e9f-efeb-4de9-b914-d05e6731f0b2 service nova] Creating event network-vif-plugged:22d1b6fa-d95f-4580-8825-016040cceb1c for instance c596128d-1efd-4e76-adc1-4482afca11a3 on n-h2-843834-3 Jul 19 21:00:17.586087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1f3fbe3f-7006-4ca8-ac7d-9d1b7f6fe795 req-daf54e9f-efeb-4de9-b914-d05e6731f0b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042041 Jul 19 21:00:17.586997 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3492/6874] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:17.642311 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:17.652758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:17.674339 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:17.675209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:17.676849 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:17.677625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:17.886850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:17.900143 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a263f88e-11ca-4b88-9898-c0a04c03de9f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.266446 Jul 19 21:00:17.901286 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3383/6875] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:17 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:18.936082 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:18.937301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:18.949284 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:18.949906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:18.951391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:18.952200 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:19.205522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:19.220484 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49cf0922-b26e-418a-a08a-b3e9c1c86aa8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1391 microversion: 2.1 time: 0.294045 Jul 19 21:00:19.221596 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3493/6876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:18 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:20.257845 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:20.259843 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:20.273483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.274673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.276788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.277706 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.538220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:20.550757 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a17a4538-da41-43b8-94c0-04f47b2e71f5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1563 microversion: 2.1 time: 0.307184 Jul 19 21:00:20.551632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3384/6877] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:20 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:20.571618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:20.572661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:20.581179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.581707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.582555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.583126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.795277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:20.807022 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92106ff8-1f81-4ac4-bc20-5da98f9fda85 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1563 microversion: 2.1 time: 0.240603 Jul 19 21:00:20.807756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3494/6878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:20 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:23.381489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-c6260ea1-5742-4d44-ab6a-942183a9a915 req-b62cb66b-a7d7-42ef-8467-4fbabf206db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c596128d-1efd-4e76-adc1-4482afca11a3", "tag": "22d1b6fa-d95f-4580-8825-016040cceb1c"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:23.382301 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:23.383102 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:23.393747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6260ea1-5742-4d44-ab6a-942183a9a915 req-b62cb66b-a7d7-42ef-8467-4fbabf206db3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.394769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-c6260ea1-5742-4d44-ab6a-942183a9a915 req-b62cb66b-a7d7-42ef-8467-4fbabf206db3 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.396827 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.397714 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.399287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.400162 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.409150 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-c6260ea1-5742-4d44-ab6a-942183a9a915 req-b62cb66b-a7d7-42ef-8467-4fbabf206db3 service nova] Creating event network-changed:22d1b6fa-d95f-4580-8825-016040cceb1c for instance c596128d-1efd-4e76-adc1-4482afca11a3 on n-h2-843834-3 Jul 19 21:00:23.416255 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-c6260ea1-5742-4d44-ab6a-942183a9a915 req-b62cb66b-a7d7-42ef-8467-4fbabf206db3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037838 Jul 19 21:00:23.416947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3495/6879] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:23.637758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:23.653695 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-414c6ada-e338-489c-af37-6a1bf807fc52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1563 microversion: 2.1 time: 0.280032 Jul 19 21:00:23.654786 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3385/6880] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:23 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1563 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:44.112320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:44.114090 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:44.118595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=20 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:44.119987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:44.132192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:44.132982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:44.134607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:44.135383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:44.202495 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9effbb0-7fc0-4df2-a400-2d50c9f65dec tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action" status: 200 len: 24570 microversion: 2.1 time: 0.097893 Jul 19 21:00:44.203892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3496/6881] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:00:44 2022] POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:00:49.867087 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:00:49.868154 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:00:55.206285 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:55.208104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:55.211708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=13 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:55.212792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=50 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:55.225333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:55.226065 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:55.227492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:55.228307 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:55.347665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e4dd0f1-7538-4924-9dd4-c270933be31d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action" status: 202 len: 0 microversion: 2.1 time: 0.148980 Jul 19 21:00:55.348874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3386/6882] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:00:55 2022] POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:00:55.363569 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:55.365029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:55.372596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:55.374174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:55.383728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:55.384688 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:55.386479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:55.387425 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:55.651333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:55.670329 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7e658312-357a-45f6-9f7d-e352b8e164cc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1674 microversion: 2.1 time: 0.315260 Jul 19 21:00:55.671217 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3497/6883] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:55 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1674 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:56.695767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:56.697044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:56.706490 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:56.707055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:56.708101 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:56.708603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:56.935590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:56.947515 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-edb1e923-eff9-4557-9844-2cbadb8760e5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.259031 Jul 19 21:00:56.948335 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3387/6884] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:56 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:00:57.977324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:57.978245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:57.989531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:57.990358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:57.991802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:57.992485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:58.220171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:58.232039 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-932951e8-ddf8-404b-b9ee-c3eafc66b968 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.260021 Jul 19 21:00:58.232718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3498/6885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:57 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:00:59.261137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:59.262376 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:59.276297 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:59.277164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:59.278683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:59.279626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:59.561966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:59.578030 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83260c0e-0428-46c7-a92c-59935c953772 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.328660 Jul 19 21:00:59.579460 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3388/6886] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:00:59 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:00.606462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:00.607650 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:00.617504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.617968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.618811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.619440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.826502 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:00.839990 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0dd17d0-eb22-410c-88f6-20eaf5e02a03 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.239788 Jul 19 21:01:00.840851 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3499/6887] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:00 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:01.870390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:01.871505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:01.884686 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:01.885586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:01.887380 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:01.888175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:02.140794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:02.163084 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-83001d97-0c5d-4414-aca8-1c1ef8c7268b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.299777 Jul 19 21:01:02.164023 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3389/6888] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:01 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:03.186309 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:03.187231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:03.195711 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.196624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.197717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.198194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.410690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:03.424717 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ef7b8086-fa61-4d7b-a6de-2871b6b00571 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.242256 Jul 19 21:01:03.425676 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3500/6889] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:03 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:04.455537 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:04.456588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:04.469819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.470604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.472053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.472851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.700350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:04.714543 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cf7f3fce-55bd-4f10-839b-bc4219f6a2a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.267779 Jul 19 21:01:04.715608 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3390/6890] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:04 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:05.739653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:05.741037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:05.758436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.759726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:05.761728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.762727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:06.057464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:06.072099 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8d1bc4d8-d16b-4eeb-942e-6ef8f6cbbf1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.340110 Jul 19 21:01:06.073185 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3501/6891] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:05 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:07.106707 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:07.107850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:07.120383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:07.121716 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:07.123338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:07.124129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:07.379084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:07.388411 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9947166a-529f-49e1-a60a-ed4755f22286 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1679 microversion: 2.1 time: 0.290014 Jul 19 21:01:07.389023 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3391/6892] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:07 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1679 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:08.412154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:08.412154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:08.424197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:08.425043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:08.426066 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:08.426661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:08.650516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:08.659977 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-53b1b3e2-8486-4063-b8dc-099fb54b90a2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1682 microversion: 2.1 time: 0.255314 Jul 19 21:01:08.661085 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3502/6893] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:08 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:34.964208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:34.965251 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.968560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:34.969268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:34.977696 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.978276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.979331 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.979901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.046801 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-64bc6f9b-faea-4f39-9745-dfbfe4384bd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action" status: 200 len: 69102 microversion: 2.1 time: 0.087231 Jul 19 21:01:35.047769 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3392/6894] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:01:34 2022] POST /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3/action => generated 69102 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:01:43.136448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:43.137307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:43.142785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=12 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:43.148477 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:43.162369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.163898 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.166653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.168098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.209542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:01:43.284050 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e1b1fb4a-462e-4272-8b0f-f35d237bf442 req-1e78ed23-15ed-45d4-8b9a-742522783c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c596128d-1efd-4e76-adc1-4482afca11a3", "tag": "22d1b6fa-d95f-4580-8825-016040cceb1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:43.295698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e1b1fb4a-462e-4272-8b0f-f35d237bf442 req-1e78ed23-15ed-45d4-8b9a-742522783c62 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.296543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e1b1fb4a-462e-4272-8b0f-f35d237bf442 req-1e78ed23-15ed-45d4-8b9a-742522783c62 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.319244 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e1b1fb4a-462e-4272-8b0f-f35d237bf442 req-1e78ed23-15ed-45d4-8b9a-742522783c62 service nova] Creating event network-changed:22d1b6fa-d95f-4580-8825-016040cceb1c for instance c596128d-1efd-4e76-adc1-4482afca11a3 on n-h2-843834-3 Jul 19 21:01:43.331312 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e1b1fb4a-462e-4272-8b0f-f35d237bf442 req-1e78ed23-15ed-45d4-8b9a-742522783c62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189731 Jul 19 21:01:43.332874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3393/6895] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:43.382724 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-069e1317-6156-43e9-a8d2-3d6e6449eed3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 204 len: 0 microversion: 2.1 time: 0.253273 Jul 19 21:01:43.384326 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3503/6896] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:01:43 2022] DELETE /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 21:01:43.399221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:43.400603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:43.412715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.413605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.415027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.416041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.670660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:43.680394 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-38237c7b-c52f-4e23-8895-a62f46a52865 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1688 microversion: 2.1 time: 0.289071 Jul 19 21:01:43.681316 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3394/6897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:43 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:44.714099 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:44.716486 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:44.731505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.732417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.733877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.734652 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.983358 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:45.000903 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ebaf3e44-0733-470d-b55e-c66c73c02a0b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1688 microversion: 2.1 time: 0.295533 Jul 19 21:01:45.019857 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3504/6898] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:44 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1688 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:45.813043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4db062a3-4c8b-4271-9c79-ab23dc67f1ac req-196262e7-40c4-4a54-8c49-8414dbd29d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c596128d-1efd-4e76-adc1-4482afca11a3", "name": "network-vif-deleted", "tag": "22d1b6fa-d95f-4580-8825-016040cceb1c"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:45.829625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4db062a3-4c8b-4271-9c79-ab23dc67f1ac req-196262e7-40c4-4a54-8c49-8414dbd29d3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.830857 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4db062a3-4c8b-4271-9c79-ab23dc67f1ac req-196262e7-40c4-4a54-8c49-8414dbd29d3f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.855281 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4db062a3-4c8b-4271-9c79-ab23dc67f1ac req-196262e7-40c4-4a54-8c49-8414dbd29d3f service nova] Creating event network-vif-deleted:22d1b6fa-d95f-4580-8825-016040cceb1c for instance c596128d-1efd-4e76-adc1-4482afca11a3 on n-h2-843834-3 Jul 19 21:01:45.868734 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4db062a3-4c8b-4271-9c79-ab23dc67f1ac req-196262e7-40c4-4a54-8c49-8414dbd29d3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058975 Jul 19 21:01:45.877938 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3395/6899] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:01:46.030226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:46.031126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:46.039576 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.040406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.041918 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.042624 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.084247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.084828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.085417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lazy-loading 'fault' on Instance uuid c596128d-1efd-4e76-adc1-4482afca11a3 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:46.170690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:46.182847 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-84b52b9a-c71a-4c7a-b491-62162915f9a4 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 200 len: 1355 microversion: 2.1 time: 0.156765 Jul 19 21:01:46.183498 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3505/6900] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:46 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:47.214591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:47.215770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: c596128d-1efd-4e76-adc1-4482afca11a3] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:47.227238 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.227826 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.228726 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.229465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.246172 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] HTTP exception thrown: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Request method failure captured: Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 HTTP/1.1 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xr9nrb49zQu7WaxZSdT805KQFppjC4a8B3v9f0ThMPSeqHVdXwJg0kRa5oe7dUsixeGuTqOKyxsCknd46MLik8M4fhETJHZQQVSj12g3bozBIxnGHsU3sMpO8qEOYzjs3rGHJyAiaTC6aD6Fb8BvGsEYBk1m0vjgUunB94QYv6vY0k Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2937674a925420488961fb21fd37a97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2937674a925420488961fb21fd37a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a2810fbc1ca54186b8e9b51620466855 Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'c596128d-1efd-4e76-adc1-4482afca11a3'} Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:47.247958 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Returning 404 to user: Instance c596128d-1efd-4e76-adc1-4482afca11a3 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e50ca921-deeb-40c8-9b1e-71f079a55741 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3" status: 404 len: 111 microversion: 2.1 time: 0.044253 Jul 19 21:01:47.256410 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3396/6901] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:47 2022] GET /compute/v2.1/servers/c596128d-1efd-4e76-adc1-4482afca11a3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:01:51.966880 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ac9c97f7-497a-42e3-8baf-f3a06c9425ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '.version_select at 0x7f23eed090d0>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:52.001279 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ac9c97f7-497a-42e3-8baf-f3a06c9425ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129143804" status: 202 len: 0 microversion: 2.1 time: 0.041278 Jul 19 21:01:52.002298 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3506/6902] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 21:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129143804 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:52.046164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4d27355b-d3af-4785-ba52-81e3560c3e53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: .version_select at 0x7f23efb63790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1649862605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS56/6M8Vjmvp+EZjbTpQNsnAEUxy38ZT6nTjtiyMV2Kk0nHVbytGecjsgqnLYqgW/Jya0LWiLu66zzA695LNvM1FPvrgP079UMlwyvbJ0v915pfroRabndZEJ/yaYmsw=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:52.075363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-4d27355b-d3af-4785-ba52-81e3560c3e53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:52.087629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-4d27355b-d3af-4785-ba52-81e3560c3e53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:52.134312 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4d27355b-d3af-4785-ba52-81e3560c3e53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.095578 Jul 19 21:01:52.135838 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3397/6903] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:01:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:00.458322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2025956916", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "6543aae4-82b2-4f07-9a93-d6874ff7a4f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1649862605", "security_groups": [{"name": "tempest-secgroup-smoke-2107931400"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:00.472164 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:00.655093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] validate_networks() for [('6543aae4-82b2-4f07-9a93-d6874ff7a4f6', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:02:01.607514 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:02:01.608472 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:02:01.608858 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:02:01.609533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:02:01.609882 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:02:01.625884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.626547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.627741 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.628635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.658360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:02:01.664351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:02:01.682111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:02:01.685739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:02:01.774885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4b9f8466-cffe-46ab-b398-c914e0b6c01e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.320596 Jul 19 21:02:01.776331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3507/6904] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:02:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:02:01.795464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1e03f90a-fb96-4a99-a95f-97523958e1fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:01.798120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1e03f90a-fb96-4a99-a95f-97523958e1fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:01.804067 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=16 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:01.912526 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1e03f90a-fb96-4a99-a95f-97523958e1fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.927258 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1e03f90a-fb96-4a99-a95f-97523958e1fc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1267 microversion: 2.1 time: 0.139382 Jul 19 21:02:01.927933 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3398/6905] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:01 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:02.956913 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:02.958150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:02.973224 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.974146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.975258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.975806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:03.110455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:03.130469 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cac9797c-eafd-4028-9317-517fdac8227c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1319 microversion: 2.1 time: 0.180363 Jul 19 21:02:03.135825 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3508/6906] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:02 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:04.159364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:04.160240 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:04.169956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.170433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.171373 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.171905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.266137 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.285206 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-da14a2bf-cb5f-4be0-a6f3-144255f2251e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1325 microversion: 2.1 time: 0.131401 Jul 19 21:02:04.286313 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3399/6907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:04 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1325 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:05.305207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:05.306189 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:05.314100 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.314570 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.316230 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.316689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.547084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.563092 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bcec7e7-f9aa-4bcf-917d-5984e4477267 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.262611 Jul 19 21:02:05.564436 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3509/6908] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:05 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:05.973174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4e401952-469d-43b0-884e-ebeb7a403b07 req-1346961f-60c2-48a0-9484-31e94497c1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:05.980604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:05.998159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e401952-469d-43b0-884e-ebeb7a403b07 req-1346961f-60c2-48a0-9484-31e94497c1fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.998159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4e401952-469d-43b0-884e-ebeb7a403b07 req-1346961f-60c2-48a0-9484-31e94497c1fd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.015097 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4e401952-469d-43b0-884e-ebeb7a403b07 req-1346961f-60c2-48a0-9484-31e94497c1fd service nova] Creating event network-changed:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h1-843834-3 Jul 19 21:02:06.020814 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4e401952-469d-43b0-884e-ebeb7a403b07 req-1346961f-60c2-48a0-9484-31e94497c1fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160313 Jul 19 21:02:06.021529 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3400/6909] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:06.589412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:06.590256 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:06.602217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.603078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.604484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.605305 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.808929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:06.818841 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5b3bee84-f1dc-4eb3-8b3e-bd583a4663c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.235464 Jul 19 21:02:06.819610 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3510/6910] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:06 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:07.843741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:07.845037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:07.858175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.859030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.860588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.861454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:08.087245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:08.097822 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce7e1816-8163-4ff3-91e0-b6117688ce53 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.262516 Jul 19 21:02:08.098557 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3401/6911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:07 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:09.121296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:09.122831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:09.133690 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.134592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.135640 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.136295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.337556 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:09.349061 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa84fa9a-d99d-4562-8d28-5bd0d4fc162f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.233665 Jul 19 21:02:09.349780 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3511/6912] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:09 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:10.370028 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:10.370784 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:10.380586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:10.381076 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.382308 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:10.382792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.582044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:10.595366 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e973e8ba-7f75-4afc-b5e4-3680e9a22edc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.230456 Jul 19 21:02:10.597036 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3402/6913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:10 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:10.618405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-72386198-c6d4-40a6-9aa4-bd4a8bcfbf4e req-cbf2dfc8-a4f4-433e-ac5c-f27a0606ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "name": "network-vif-plugged", "status": "completed", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:10.627733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-72386198-c6d4-40a6-9aa4-bd4a8bcfbf4e req-cbf2dfc8-a4f4-433e-ac5c-f27a0606ca14 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:10.628114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-72386198-c6d4-40a6-9aa4-bd4a8bcfbf4e req-cbf2dfc8-a4f4-433e-ac5c-f27a0606ca14 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.650024 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-72386198-c6d4-40a6-9aa4-bd4a8bcfbf4e req-cbf2dfc8-a4f4-433e-ac5c-f27a0606ca14 service nova] Creating event network-vif-plugged:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h1-843834-3 Jul 19 21:02:10.664430 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-72386198-c6d4-40a6-9aa4-bd4a8bcfbf4e req-cbf2dfc8-a4f4-433e-ac5c-f27a0606ca14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142438 Jul 19 21:02:10.665270 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3512/6914] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:11.619150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:11.620164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:11.631910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.632640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.634007 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.634620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.871865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:11.883013 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7d04de68-a820-4d3e-809a-b8549b138810 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1393 microversion: 2.1 time: 0.270211 Jul 19 21:02:11.884045 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3403/6915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:11 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:12.904236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:12.905630 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:12.912223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:12.913201 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:12.925204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:12.925707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:12.928554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:12.928554 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.572847 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:13.592452 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2db95896-a888-4fce-a5b4-ff207fc8c7b0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1564 microversion: 2.1 time: 0.690708 Jul 19 21:02:13.593920 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3513/6916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:12 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1564 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:13.619786 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:13.620697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:13.623257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:13.635401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:13.636269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.637426 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:13.638091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.833888 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:13.845046 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb30c417-8d51-452a-be71-0f28a2e1ef62 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1564 microversion: 2.1 time: 0.229991 Jul 19 21:02:13.846071 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3404/6917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:13 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:16.913539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-36e53c53-596b-4fdc-84ea-c74c9df575bb req-cff2da7d-5e50-4f04-a68c-d54b7bfec3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:16.915871 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:16.917328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:16.924166 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-36e53c53-596b-4fdc-84ea-c74c9df575bb req-cff2da7d-5e50-4f04-a68c-d54b7bfec3bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:16.924776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-36e53c53-596b-4fdc-84ea-c74c9df575bb req-cff2da7d-5e50-4f04-a68c-d54b7bfec3bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:16.930584 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:16.934900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:16.935926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:16.937643 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:16.938822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:16.939983 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-36e53c53-596b-4fdc-84ea-c74c9df575bb req-cff2da7d-5e50-4f04-a68c-d54b7bfec3bf service nova] Creating event network-changed:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h1-843834-3 Jul 19 21:02:16.947993 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-36e53c53-596b-4fdc-84ea-c74c9df575bb req-cff2da7d-5e50-4f04-a68c-d54b7bfec3bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038985 Jul 19 21:02:16.949450 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3405/6918] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:17.240857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:17.256564 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-68c6145a-989a-40dd-8226-1c4fef3f4795 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1564 microversion: 2.1 time: 0.349380 Jul 19 21:02:17.268823 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3514/6919] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:16 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1564 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:41.843554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:41.845313 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:41.850409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=11 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:41.851655 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=34 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:41.864436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:41.865299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:41.866783 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:41.867715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:41.952557 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-81d9c18a-bd0d-48e7-8f53-fe136fc13ccb tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action" status: 200 len: 24558 microversion: 2.1 time: 0.117800 Jul 19 21:02:41.953749 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3406/6920] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:02:41 2022] POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action => generated 24558 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 21:02:52.957954 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:52.959245 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:52.962329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:52.963146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=40 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:52.970084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:52.970587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:52.971485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:52.972150 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.024379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:53.031866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Old instance type m1.heat2, new instance type m1.heat {{(pid=131229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 21:02:53.040391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:02:53.041060 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:02:53.041692 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:02:53.042331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:02:53.042861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:02:53.139104 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3bae827a-44a3-4a21-8e5b-bc0b96d98eb0 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action" status: 202 len: 0 microversion: 2.1 time: 0.185549 Jul 19 21:02:53.140255 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3515/6921] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:02:52 2022] POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:02:53.156061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:53.157349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:53.165540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:53.165540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:53.177654 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:53.178581 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.179877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:53.180488 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.483676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:53.495708 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-49e82779-fd0c-4c64-a6d8-912ecfe08a0a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1692 microversion: 2.1 time: 0.347799 Jul 19 21:02:53.496647 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3407/6922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:53 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1692 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:54.524429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:54.525676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:54.537340 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:54.538093 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:54.539498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:54.540388 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:54.848341 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:54.861989 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c3606346-bed1-4147-92c5-91e5bb0fca15 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1692 microversion: 2.1 time: 0.345274 Jul 19 21:02:54.863682 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3516/6923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:54 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:55.886409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:55.887547 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:55.913851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:55.914747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:55.916540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:55.917344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:56.116122 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:56.130632 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-34958554-220f-48d7-8400-7e68911343d8 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.251684 Jul 19 21:02:56.131779 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3408/6924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:55 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:57.162074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:57.163179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:57.175785 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.176595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.177943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.178622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.386706 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:57.399885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95d0c752-d506-4a75-bfcb-180c29f54e51 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.245551 Jul 19 21:02:57.400635 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3517/6925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:57 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:58.419082 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:58.420187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:58.428540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:58.429144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:58.430134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:58.430790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:58.627838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:58.641977 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9b090f40-28d8-42bc-ac5f-527248fd3f84 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.226980 Jul 19 21:02:58.643121 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3409/6926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:58 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:59.664448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:59.665091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:59.673383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:59.673841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:59.674646 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:59.675122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:59.879561 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:59.892528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cd3f17f9-03e1-476a-82c1-4c7e3385eb3b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.231835 Jul 19 21:02:59.893522 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3518/6927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:59 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:00.923599 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:00.924709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:00.938543 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:00.939332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:00.940790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:00.941670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.154383 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:01.163930 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ff5dfb1-bd98-4975-b1bf-6ad4ce9c5efe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.248531 Jul 19 21:03:01.164581 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3410/6928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:00 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:02.193933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:02.195142 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:02.209544 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:02.210389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:02.211900 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:02.212662 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:02.429611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:02.446211 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e5ce492-b105-4492-a964-000050ef18df tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.259920 Jul 19 21:03:02.447795 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3519/6929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:02 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:03.478209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:03.479239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:03.491368 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:03.492129 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:03.493227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:03.493766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:03.651434 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:03.660155 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a6ab0b0a-bcfc-43e6-9036-60498caa1a72 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.189033 Jul 19 21:03:03.660819 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3411/6930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:03 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:04.685628 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:04.686298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:04.694597 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:04.695421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:04.696730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:04.697171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:04.867562 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:04.880352 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aea59c06-9f12-41b4-b786-d22179f2e25d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.198679 Jul 19 21:03:04.881502 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3520/6931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:04 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:05.910874 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:05.911865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:05.922115 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:05.922836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:05.924159 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:05.924870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:06.110977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:06.122864 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3b6c8f96-d1df-4042-98f6-487cf8637494 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.218673 Jul 19 21:03:06.123665 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3412/6932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:05 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:07.142393 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:07.143229 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:07.151113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:07.151575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:07.152386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:07.152826 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:07.318074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:07.327700 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c01eb324-80f1-43ef-b1c9-1671199ac86d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.189435 Jul 19 21:03:07.328415 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3521/6933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:07 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:08.347983 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:08.348969 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:08.357109 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:08.357591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:08.358497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:08.358989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:08.528372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:08.537295 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bcd94738-6dbb-48e9-9ad6-cfcf8f879bfc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.194917 Jul 19 21:03:08.537941 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3413/6934] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:08 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:09.556112 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:09.556770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:09.565855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:09.565855 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:09.566580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:09.567050 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:09.728932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:09.737277 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8a31f82e-844f-4c3f-a3ce-15c65699e37b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.185572 Jul 19 21:03:09.737961 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3522/6935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:09 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:10.754935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:10.755645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:10.763692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:10.764173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:10.764985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:10.765446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:10.929858 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:10.938382 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-66e85128-2e17-4b5b-a309-407f09573696 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.187619 Jul 19 21:03:10.939034 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3414/6936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:10 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:11.976799 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:11.977825 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:11.990754 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:11.991257 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:11.992168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:11.992619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:12.170118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:12.181854 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-57c324ef-3aeb-48f0-873d-7aac1edb9553 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1697 microversion: 2.1 time: 0.218585 Jul 19 21:03:12.187291 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3523/6937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:11 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1697 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:13.203389 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:13.204471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:13.215156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:13.215666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:13.216562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:13.217011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:13.466702 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:13.478660 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f9cb47a-379a-4e79-9287-1fb0b0bfbeba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1696 microversion: 2.1 time: 0.279626 Jul 19 21:03:13.479659 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3415/6938] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:13 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1696 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:14.024593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "name": "network-vif-unplugged", "status": "completed", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:14.041143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:14.041803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:14.059741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] Creating event network-vif-unplugged:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h2-843834-3 Jul 19 21:03:14.067659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 21:03:14.082827 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f0e4513c-fefd-46b7-99fe-f5489c228c18 req-b9d6cc5f-ee15-4466-b8a7-88c7452745ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063074 Jul 19 21:03:14.084758 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3524/6939] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:14.502855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:14.504221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:14.517570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:14.518521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:14.520004 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:14.520807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:14.761630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:14.778739 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a8ffdf28-246d-4cc7-8a32-6ff7d118938d tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1696 microversion: 2.1 time: 0.282961 Jul 19 21:03:14.780580 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3416/6940] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:14 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1696 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:15.801355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:15.802391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:15.811298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:15.811766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:15.812641 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:15.813096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:16.000912 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:16.010066 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b56b238e-3925-4aa1-8749-89f1861fd49a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1694 microversion: 2.1 time: 0.214995 Jul 19 21:03:16.010848 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3525/6941] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:15 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:16.110292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:16.130318 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:16.131194 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:16.155016 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] Creating event network-changed:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h2-843834-3 Jul 19 21:03:16.166972 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-843834-3', 'n-h2-843834-3'} {{(pid=131230) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 21:03:16.188943 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-963c4b62-4934-46ba-8ec8-8c3e863dff2b req-a1bdad97-1efd-4024-a77a-40554f189c0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084756 Jul 19 21:03:16.190561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3417/6942] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:17.052540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:17.053522 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:17.067812 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.068602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.069902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.070543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.266334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:17.276207 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1b6993ec-c7a0-489a-9b8e-d7c8456b77af tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1691 microversion: 2.1 time: 0.245031 Jul 19 21:03:17.277050 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3526/6943] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:17 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:17.311118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:17.312085 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:17.324034 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.324870 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.326293 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.327165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.422423 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7c69b22a-69f9-452b-b7b0-926d5d8b89bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action" status: 204 len: 0 microversion: 2.1 time: 0.120851 Jul 19 21:03:17.423159 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3418/6944] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:03:17 2022] POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:03:17.433325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:17.433968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:17.442866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.443689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.445333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.446129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.640636 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:17.651480 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6aeab82a-4b76-47e9-a8ce-884d658acdf5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1691 microversion: 2.1 time: 0.222236 Jul 19 21:03:17.652132 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3527/6945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:17 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:03:17.670131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:17.670869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:17.678338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.678946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.679896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:17.680431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:17.862566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:17.872058 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e491822c-270f-458c-80b6-6f8cef8daec5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1691 microversion: 2.1 time: 0.206387 Jul 19 21:03:17.872674 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3419/6946] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:17 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:18.896045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:18.896920 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:18.906991 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:18.907720 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:18.909118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:18.909883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:19.100721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:19.116451 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-addcb56a-e7d8-4821-a848-1f84a3283a9c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1691 microversion: 2.1 time: 0.227819 Jul 19 21:03:19.118155 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3528/6947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:18 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:20.148208 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:20.149265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:20.162450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:20.163314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:20.164708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:20.165497 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:20.385684 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:20.396600 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9a03f1da-c152-4e1b-8bc4-74fcda6d6e19 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1683 microversion: 2.1 time: 0.256009 Jul 19 21:03:20.405388 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3420/6948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:20 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1683 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:20.420049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-de943bb5-01d3-4611-ba60-bf333bfa6e86 req-134c6d4c-09e5-4433-88e7-11a2a81a43bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "name": "network-vif-plugged", "status": "completed", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:20.432760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de943bb5-01d3-4611-ba60-bf333bfa6e86 req-134c6d4c-09e5-4433-88e7-11a2a81a43bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:20.433895 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-de943bb5-01d3-4611-ba60-bf333bfa6e86 req-134c6d4c-09e5-4433-88e7-11a2a81a43bf service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:20.452030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-de943bb5-01d3-4611-ba60-bf333bfa6e86 req-134c6d4c-09e5-4433-88e7-11a2a81a43bf service nova] Creating event network-vif-plugged:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h2-843834-3 Jul 19 21:03:20.459929 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-de943bb5-01d3-4611-ba60-bf333bfa6e86 req-134c6d4c-09e5-4433-88e7-11a2a81a43bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043832 Jul 19 21:03:20.461066 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3529/6949] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:42.679760 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:42.681139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:42.769484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:42.771282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:42.783217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:42.784483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:42.786169 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:42.787259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:42.870571 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-61de2e7c-5f15-4131-8731-15d19f26c16e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action" status: 200 len: 24581 microversion: 2.1 time: 0.199275 Jul 19 21:03:42.871803 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3421/6950] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:03:42 2022] POST /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc/action => generated 24581 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:03:50.715049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:50.717525 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:50.725113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:50.725927 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:50.727587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a8d7115c-5c31-418c-aec5-b4e383f0b774 req-1abab754-5a42-46ec-967e-0dfc6cf72d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:50.743355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.744408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.746465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.747292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a8d7115c-5c31-418c-aec5-b4e383f0b774 req-1abab754-5a42-46ec-967e-0dfc6cf72d2c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.747464 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.747587 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a8d7115c-5c31-418c-aec5-b4e383f0b774 req-1abab754-5a42-46ec-967e-0dfc6cf72d2c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.771422 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a8d7115c-5c31-418c-aec5-b4e383f0b774 req-1abab754-5a42-46ec-967e-0dfc6cf72d2c service nova] Creating event network-changed:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h2-843834-3 Jul 19 21:03:50.781008 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a8d7115c-5c31-418c-aec5-b4e383f0b774 req-1abab754-5a42-46ec-967e-0dfc6cf72d2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061828 Jul 19 21:03:50.782090 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3422/6951] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:50.807631 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:03:50.947496 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-634bc9e7-d783-4575-a991-9437b3fb69ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 204 len: 0 microversion: 2.1 time: 0.234580 Jul 19 21:03:50.953718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3530/6952] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:03:50 2022] DELETE /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:03:50.966596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:50.967921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:50.982394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.983745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.985529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.986712 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:51.244259 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:51.257497 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dfc57f0d-6717-443a-8d2a-71be9608ae3f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1689 microversion: 2.1 time: 0.298843 Jul 19 21:03:51.258564 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3423/6953] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:50 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1689 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:03:52.288996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:52.290084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:52.303779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.304612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.306009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.306837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.676876 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:52.691811 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-066766c7-947c-421f-933d-d29359f971ba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 200 len: 1689 microversion: 2.1 time: 0.410302 Jul 19 21:03:52.693224 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3531/6954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:52 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 1689 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:53.275163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-1b7ecd5f-5150-4933-bba5-a1cc69e5fa02 req-1ea0517b-0aa9-4351-aaab-c9d954717c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ddad3-ae6b-4227-ad19-664e6c6463bc", "name": "network-vif-deleted", "tag": "9024e611-7133-4f33-a4f2-fd79b21e383e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:53.293554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b7ecd5f-5150-4933-bba5-a1cc69e5fa02 req-1ea0517b-0aa9-4351-aaab-c9d954717c5b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.294281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-1b7ecd5f-5150-4933-bba5-a1cc69e5fa02 req-1ea0517b-0aa9-4351-aaab-c9d954717c5b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.318501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-1b7ecd5f-5150-4933-bba5-a1cc69e5fa02 req-1ea0517b-0aa9-4351-aaab-c9d954717c5b service nova] Creating event network-vif-deleted:9024e611-7133-4f33-a4f2-fd79b21e383e for instance 169ddad3-ae6b-4227-ad19-664e6c6463bc on n-h2-843834-3 Jul 19 21:03:53.327386 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-1b7ecd5f-5150-4933-bba5-a1cc69e5fa02 req-1ea0517b-0aa9-4351-aaab-c9d954717c5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060539 Jul 19 21:03:53.328632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3424/6955] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:53.721292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:53.722598 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 169ddad3-ae6b-4227-ad19-664e6c6463bc] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:53.734021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.734774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.736476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.737533 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.755708 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] HTTP exception thrown: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Request method failure captured: Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc HTTP/1.1 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xr9nrb49zQu7WaxZSdT805KQFppjC4a8B3v9f0ThMPSeqHVdXwJg0kRa5oe7dUsixeGuTqOKyxsCknd46MLik8M4fhETJHZQQVSj12g3bozBIxnGHsU3sMpO8qEOYzjs3rGHJyAiaTC6aD6Fb8BvGsEYBk1m0vjgUunB94QYv6vY0k Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2937674a925420488961fb21fd37a97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2937674a925420488961fb21fd37a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a2810fbc1ca54186b8e9b51620466855 Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '169ddad3-ae6b-4227-ad19-664e6c6463bc'} Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:53.757625 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Returning 404 to user: Instance 169ddad3-ae6b-4227-ad19-664e6c6463bc could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-88240f13-b966-4173-b74d-20d366348030 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc" status: 404 len: 111 microversion: 2.1 time: 0.045281 Jul 19 21:03:53.765861 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3532/6956] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:53 2022] GET /compute/v2.1/servers/169ddad3-ae6b-4227-ad19-664e6c6463bc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:58.977156 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-940ba0dc-698b-47e8-b1f9-3be22cfd2e16 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '.version_select at 0x7f23efbaa1f0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:59.005816 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-940ba0dc-698b-47e8-b1f9-3be22cfd2e16 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649862605" status: 202 len: 0 microversion: 2.1 time: 0.037089 Jul 19 21:03:59.013127 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3425/6957] 10.222.0.23 () {58 vars in 1283 bytes} [Tue Jul 19 21:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649862605 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:03:59.053228 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6d2eba87-fb7a-4981-ba7a-6042546888e9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: .version_select at 0x7f23eecef700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1958818780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm9sKX0kEEIYqV2L2cOczP/I7v/pPAzdfA5i8A//HEEw8fN++N4EX4vZ75tbPHnaEkjX19gE5JIIfC21UiJm6Tsk2x3axr+N8CZf9fkwxxHfYeTAWU2I7yWp7BHWwzfCQ=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:59.074868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6d2eba87-fb7a-4981-ba7a-6042546888e9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:03:59.082152 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-6d2eba87-fb7a-4981-ba7a-6042546888e9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:03:59.122578 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6d2eba87-fb7a-4981-ba7a-6042546888e9 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.073257 Jul 19 21:03:59.123809 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3533/6958] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:03:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:08.877087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=14 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:08.885265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-889579137", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "eb318be6-36de-4d9b-ba9e-52ca204e0036"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1958818780", "security_groups": [{"name": "tempest-secgroup-smoke-1982389713"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:09.092088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] validate_networks() for [('eb318be6-36de-4d9b-ba9e-52ca204e0036', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:04:09.830103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:04:09.830886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:04:09.832387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:04:09.832909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:04:09.833245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:04:09.850855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.851730 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:09.853337 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.854179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:09.892408 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:04:09.903116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:04:09.929731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:04:09.934629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:04:10.020123 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae382326-df16-4fcf-ac5f-be313af98421 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.146566 Jul 19 21:04:10.020849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3426/6959] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:04:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:04:10.034901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:10.036543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:10.037521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:10.046356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c090c6aa-6ec7-4f6f-a7a8-5c1d6162adee tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:10.051017 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c090c6aa-6ec7-4f6f-a7a8-5c1d6162adee tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:10.173617 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c090c6aa-6ec7-4f6f-a7a8-5c1d6162adee tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:10.182501 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c090c6aa-6ec7-4f6f-a7a8-5c1d6162adee tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1266 microversion: 2.1 time: 0.150988 Jul 19 21:04:10.187282 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3534/6960] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:10 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:11.214073 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:11.214991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:11.225333 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.226071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:11.227019 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.227833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:11.319139 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:11.329611 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-652dbf61-459b-498a-8010-4a739d648290 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1318 microversion: 2.1 time: 0.121579 Jul 19 21:04:11.330193 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3427/6961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:11 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:12.349048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:12.350287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:12.361445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:12.362294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:12.363454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:12.364271 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:12.500488 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:12.517548 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-40b1fa38-b82f-45aa-8ed3-d461402aca4c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1324 microversion: 2.1 time: 0.172780 Jul 19 21:04:12.522385 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3535/6962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:12 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1324 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:13.552524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:13.553734 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:13.557622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:13.568167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.569277 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.571286 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.572482 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.882182 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:13.899377 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-71be2ee4-d4c9-431c-8458-9af050b0c493 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.352648 Jul 19 21:04:13.900853 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3428/6963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:13 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:14.198901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-f1c6f169-ed8c-4b28-80cb-a3ef76a9de01 req-d40b350b-e394-4d19-a762-eaf82e96b637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ada4fd-a429-4055-bbcf-9a7074d63081", "tag": "3a53de4b-f70f-4e3c-a747-b4b3f40abde2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:14.239707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f1c6f169-ed8c-4b28-80cb-a3ef76a9de01 req-d40b350b-e394-4d19-a762-eaf82e96b637 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.242540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-f1c6f169-ed8c-4b28-80cb-a3ef76a9de01 req-d40b350b-e394-4d19-a762-eaf82e96b637 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.268741 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-f1c6f169-ed8c-4b28-80cb-a3ef76a9de01 req-d40b350b-e394-4d19-a762-eaf82e96b637 service nova] Creating event network-changed:3a53de4b-f70f-4e3c-a747-b4b3f40abde2 for instance f3ada4fd-a429-4055-bbcf-9a7074d63081 on n-h1-843834-3 Jul 19 21:04:14.277677 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-f1c6f169-ed8c-4b28-80cb-a3ef76a9de01 req-d40b350b-e394-4d19-a762-eaf82e96b637 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085963 Jul 19 21:04:14.278226 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3536/6964] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:14.930661 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:14.933016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:14.945882 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.947055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.948126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.948564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.179585 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:15.190081 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4842bd3e-baf2-4a23-aae9-4ff2a7a73dba tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.267627 Jul 19 21:04:15.190711 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3429/6965] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:14 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:16.222365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:16.224116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:16.238438 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.239293 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.240856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.241626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.490166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:16.502457 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1cab907e-981f-43a7-a8aa-50aedf899c4b tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.288347 Jul 19 21:04:16.512614 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3537/6966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:16 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:17.528433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:17.529989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:17.544399 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.545345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.546974 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.547844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.786267 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.795119 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3e2ab1c-25e6-4a29-a503-51b46f1f6f1e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.274171 Jul 19 21:04:17.795914 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3430/6967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:17 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:18.817809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:18.819036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:18.832498 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.833125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:18.833953 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.834483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.101169 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:19.114459 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1aecba09-9be0-4f41-8f24-0ce95f3a8843 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.303702 Jul 19 21:04:19.115431 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3538/6968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:18 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:19.333645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-883bc16e-10c5-4259-a17e-6dfbd657e2f6 req-b69c7c40-8f36-4a4d-985a-d8bbd8f64036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ada4fd-a429-4055-bbcf-9a7074d63081", "name": "network-vif-plugged", "status": "completed", "tag": "3a53de4b-f70f-4e3c-a747-b4b3f40abde2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:19.357141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-883bc16e-10c5-4259-a17e-6dfbd657e2f6 req-b69c7c40-8f36-4a4d-985a-d8bbd8f64036 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:19.358520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-883bc16e-10c5-4259-a17e-6dfbd657e2f6 req-b69c7c40-8f36-4a4d-985a-d8bbd8f64036 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.385253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-883bc16e-10c5-4259-a17e-6dfbd657e2f6 req-b69c7c40-8f36-4a4d-985a-d8bbd8f64036 service nova] Creating event network-vif-plugged:3a53de4b-f70f-4e3c-a747-b4b3f40abde2 for instance f3ada4fd-a429-4055-bbcf-9a7074d63081 on n-h1-843834-3 Jul 19 21:04:19.395964 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-883bc16e-10c5-4259-a17e-6dfbd657e2f6 req-b69c7c40-8f36-4a4d-985a-d8bbd8f64036 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066428 Jul 19 21:04:19.397110 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3431/6969] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:20.143580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:20.145012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:20.156287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:20.157091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:20.158222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:20.158506 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:20.180134 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:20.374030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:20.389033 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-14faca2d-c21b-4984-b4b2-b64f21c27c13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1392 microversion: 2.1 time: 0.250798 Jul 19 21:04:20.389948 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3539/6970] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:20 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1392 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:21.418052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:21.419230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:21.422895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:21.424160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:21.438165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.439052 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.440460 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.441215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.674822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:21.705555 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e828f6c5-e831-40b8-ac9e-d1b4d83f8292 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1563 microversion: 2.1 time: 0.294575 Jul 19 21:04:21.706628 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3432/6971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:21 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1563 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:21.735412 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:21.736450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:21.746782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.747979 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.748924 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.749661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.001286 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:22.014420 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c49d03ce-4102-42db-b457-9619e4a40f8a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1563 microversion: 2.1 time: 0.283593 Jul 19 21:04:22.015124 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3540/6972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:21 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1563 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:25.110141 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:25.111269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:25.122575 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1c08f9a0-cb63-4f4a-a6ac-f465e1b28cee req-0979830f-e262-4505-bcfc-156e6e87647a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ada4fd-a429-4055-bbcf-9a7074d63081", "tag": "3a53de4b-f70f-4e3c-a747-b4b3f40abde2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:25.124615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:25.125824 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:25.127711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:25.130096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:25.138429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1c08f9a0-cb63-4f4a-a6ac-f465e1b28cee req-0979830f-e262-4505-bcfc-156e6e87647a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:25.139428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1c08f9a0-cb63-4f4a-a6ac-f465e1b28cee req-0979830f-e262-4505-bcfc-156e6e87647a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:25.167191 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1c08f9a0-cb63-4f4a-a6ac-f465e1b28cee req-0979830f-e262-4505-bcfc-156e6e87647a service nova] Creating event network-changed:3a53de4b-f70f-4e3c-a747-b4b3f40abde2 for instance f3ada4fd-a429-4055-bbcf-9a7074d63081 on n-h1-843834-3 Jul 19 21:04:25.182094 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1c08f9a0-cb63-4f4a-a6ac-f465e1b28cee req-0979830f-e262-4505-bcfc-156e6e87647a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071295 Jul 19 21:04:25.182970 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3541/6973] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:25.409117 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:25.421277 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-192205b6-68bc-4d5a-b9c6-6ee835bddbd3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1563 microversion: 2.1 time: 0.318218 Jul 19 21:04:25.421914 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3433/6974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:25 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1563 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:47.931674 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=18 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:47.932505 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:47.936981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:47.938038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:47.947440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.948001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:47.948831 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.949312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.012728 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-484a68d2-b6ee-46e9-b3e5-b8189060a659 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action" status: 200 len: 24568 microversion: 2.1 time: 0.083014 Jul 19 21:04:48.013595 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3542/6975] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:04:47 2022] POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action => generated 24568 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:04:59.100235 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9cb3e6c9-5051-4904-9762-86d9937d4bff tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:59.102665 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=11 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.103388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=40 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.110130 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cb3e6c9-5051-4904-9762-86d9937d4bff tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.110590 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9cb3e6c9-5051-4904-9762-86d9937d4bff tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.137683 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9cb3e6c9-5051-4904-9762-86d9937d4bff tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Going to try to stop instance {{(pid=131230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 21:04:59.195125 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9cb3e6c9-5051-4904-9762-86d9937d4bff tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action" status: 202 len: 0 microversion: 2.1 time: 0.099158 Jul 19 21:04:59.196077 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3434/6976] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:04:59 2022] POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:04:59.208194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:59.209149 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:59.213426 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.214204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.220356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.220838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.221718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.222290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.402719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:59.412986 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7793c269-a4a9-4323-9074-02a98250f0b3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.209825 Jul 19 21:04:59.413633 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3543/6977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:59 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:00.434069 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:00.434739 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:00.443261 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.443774 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:00.444603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.445053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:00.610800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:00.619866 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-41301e5c-2383-4de8-a07f-11489f720021 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.191320 Jul 19 21:05:00.620542 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3435/6978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:00 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:01.638857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:01.639490 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:01.648236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:01.648761 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:01.649606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:01.650087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:01.832198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:01.842485 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1584c4c5-ee63-4085-9866-cf8d4bb49632 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.207407 Jul 19 21:05:01.843399 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3544/6979] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:01 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:02.862762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:02.863764 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:02.872436 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:02.873035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:02.874673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:02.875741 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:03.054192 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:03.063276 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-193bda13-1bef-40ec-9a50-f2de044fe9ea tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.204857 Jul 19 21:05:03.064047 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3436/6980] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:02 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:04.081530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:04.082378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:04.090328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.090794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.091653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.092105 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.303011 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:04.313458 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c0863bbc-3f70-4ce9-8a8b-d04ea7eb8244 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.236213 Jul 19 21:05:04.314103 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3545/6981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:04 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:05.334038 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:05.335002 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:05.346652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.347227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.348239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.349258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.539421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:05.554242 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cb1271a6-756a-4657-a7e7-eb0b0709be35 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.224720 Jul 19 21:05:05.555390 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3437/6982] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:05 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:06.581387 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:06.582386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:06.590516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.591114 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:06.592193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.592769 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:06.789108 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:06.804148 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5f79bdde-d7d6-4cfe-9536-a404ed9d377a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.227285 Jul 19 21:05:06.805144 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3546/6983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:06 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:07.833769 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:07.834687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:07.841806 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:07.842319 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:07.843315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:07.843873 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:08.069205 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:08.085282 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfb3bad4-562b-47a4-bda8-30b94d97a8c5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.256458 Jul 19 21:05:08.086321 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3438/6984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:07 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:09.118038 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:09.119328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:09.132689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.133467 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.134839 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.135647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.346866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:09.361757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2a49c4d5-033c-4ca0-ae31-3393c346fb34 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1691 microversion: 2.1 time: 0.250907 Jul 19 21:05:09.362843 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3547/6985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:09 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:10.382907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:10.383549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:10.393469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:10.394063 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:10.394957 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:10.395807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:10.579450 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:10.593329 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5b92a70d-069a-465a-b45e-69458b4ade1f tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1668 microversion: 2.1 time: 0.214076 Jul 19 21:05:10.594276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3439/6986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:10 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1668 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:11.716058 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:11.718239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:11.733269 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:11.734107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:11.735608 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:11.736389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:11.808401 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0f5a48fa-22e0-4b6a-9048-f3eef35e9626 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action" status: 200 len: 38347 microversion: 2.1 time: 0.099808 Jul 19 21:05:11.809649 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3548/6987] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:05:11 2022] POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action => generated 38347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 21:05:11.828187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c1315d7-a4e6-4f2d-841e-0dde1c08d153 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:11.842171 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1315d7-a4e6-4f2d-841e-0dde1c08d153 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:11.843051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c1315d7-a4e6-4f2d-841e-0dde1c08d153 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:11.895229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c1315d7-a4e6-4f2d-841e-0dde1c08d153 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Going to try to start instance {{(pid=131230) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 21:05:11.976606 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c1315d7-a4e6-4f2d-841e-0dde1c08d153 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action" status: 202 len: 0 microversion: 2.1 time: 0.156300 Jul 19 21:05:11.977432 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3440/6988] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:05:11 2022] POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:05:11.993730 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:11.995193 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:12.010626 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:12.011627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.013187 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:12.013982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.219929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:12.237664 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5ac706f7-1f3b-499b-89e4-4a40aecfab47 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1677 microversion: 2.1 time: 0.250519 Jul 19 21:05:12.237664 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3549/6989] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:11 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:13.272506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:13.273770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:13.285538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:13.286351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:13.287815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:13.288614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:13.517013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:13.529613 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d878ccb7-0ba2-40ca-9129-4025719325f2 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1677 microversion: 2.1 time: 0.266689 Jul 19 21:05:13.530707 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3441/6990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:13 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:14.560976 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:14.562079 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:14.576117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:14.576950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:14.578381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:14.579538 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:14.807479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:14.824189 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-04c1bf7a-e770-4ac8-a132-ca3af6a0ca43 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1681 microversion: 2.1 time: 0.269711 Jul 19 21:05:14.825207 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3550/6991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:14 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:39.126750 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:39.128513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:39.133294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=16 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:39.134692 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:39.145664 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:39.146362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:39.147700 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:39.148451 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:39.248616 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d41a877-8b09-4e5b-b7b3-41237e591495 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action" status: 200 len: 62907 microversion: 2.1 time: 0.129321 Jul 19 21:05:39.249574 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3442/6992] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:05:39 2022] POST /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081/action => generated 62907 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:05:47.307236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:47.308806 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:47.313728 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=16 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:47.314894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=46 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:47.315626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e0a8208b-2434-42c9-bbe4-1a75f6966ed5 req-445ebf2c-16ae-4b8d-874c-4438a6abc484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ada4fd-a429-4055-bbcf-9a7074d63081", "tag": "3a53de4b-f70f-4e3c-a747-b4b3f40abde2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:47.325424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.327267 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.327614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.328302 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.334246 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e0a8208b-2434-42c9-bbe4-1a75f6966ed5 req-445ebf2c-16ae-4b8d-874c-4438a6abc484 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.335127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e0a8208b-2434-42c9-bbe4-1a75f6966ed5 req-445ebf2c-16ae-4b8d-874c-4438a6abc484 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.362803 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e0a8208b-2434-42c9-bbe4-1a75f6966ed5 req-445ebf2c-16ae-4b8d-874c-4438a6abc484 service nova] Creating event network-changed:3a53de4b-f70f-4e3c-a747-b4b3f40abde2 for instance f3ada4fd-a429-4055-bbcf-9a7074d63081 on n-h1-843834-3 Jul 19 21:05:47.373183 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e0a8208b-2434-42c9-bbe4-1a75f6966ed5 req-445ebf2c-16ae-4b8d-874c-4438a6abc484 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065264 Jul 19 21:05:47.374231 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:05:47.374998 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3443/6993] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:05:47.557609 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-6eb4f915-7324-41ed-884e-adca2895bbcc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 204 len: 0 microversion: 2.1 time: 0.255883 Jul 19 21:05:47.558862 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3551/6994] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:05:47 2022] DELETE /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:05:47.577553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:47.579493 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:47.600092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.600914 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.602415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.603292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.853427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:47.867441 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6cdbf3c0-9ace-4c34-8925-f054724f80c6 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1687 microversion: 2.1 time: 0.298313 Jul 19 21:05:47.868560 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3444/6995] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:47 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1687 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:48.891573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:48.892770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:48.907760 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:48.908801 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:48.910713 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:48.911416 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:49.189209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:49.199962 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8933e11e-5a74-4b9e-8d47-61319d0e07ed tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1687 microversion: 2.1 time: 0.315571 Jul 19 21:05:49.200521 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3552/6996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:48 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1687 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:49.881585 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:05:49.882217 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:05:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:05:49.999502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b7ae29f3-54cb-444e-9b26-c28144834415 req-89154352-8527-4e1d-9a34-510712bf382e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ada4fd-a429-4055-bbcf-9a7074d63081", "name": "network-vif-deleted", "tag": "3a53de4b-f70f-4e3c-a747-b4b3f40abde2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:50.023032 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b7ae29f3-54cb-444e-9b26-c28144834415 req-89154352-8527-4e1d-9a34-510712bf382e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.023867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b7ae29f3-54cb-444e-9b26-c28144834415 req-89154352-8527-4e1d-9a34-510712bf382e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.046796 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b7ae29f3-54cb-444e-9b26-c28144834415 req-89154352-8527-4e1d-9a34-510712bf382e service nova] Creating event network-vif-deleted:3a53de4b-f70f-4e3c-a747-b4b3f40abde2 for instance f3ada4fd-a429-4055-bbcf-9a7074d63081 on n-h1-843834-3 Jul 19 21:05:50.056321 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b7ae29f3-54cb-444e-9b26-c28144834415 req-89154352-8527-4e1d-9a34-510712bf382e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064084 Jul 19 21:05:50.058302 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3445/6997] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:50.231113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:50.232296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:50.246794 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.248444 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.249003 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.251053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.317204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.318049 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.318884 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lazy-loading 'fault' on Instance uuid f3ada4fd-a429-4055-bbcf-9a7074d63081 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:05:50.405012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:50.417164 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67d163de-e481-40b1-84b4-3138a30c813c tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 200 len: 1356 microversion: 2.1 time: 0.194275 Jul 19 21:05:50.417866 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3553/6998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:50 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:51.448410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:51.449506 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: f3ada4fd-a429-4055-bbcf-9a7074d63081] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:51.458269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:51.458846 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:51.460104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:51.460708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:51.484087 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] HTTP exception thrown: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Request method failure captured: Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 HTTP/1.1 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1xr9nrb49zQu7WaxZSdT805KQFppjC4a8B3v9f0ThMPSeqHVdXwJg0kRa5oe7dUsixeGuTqOKyxsCknd46MLik8M4fhETJHZQQVSj12g3bozBIxnGHsU3sMpO8qEOYzjs3rGHJyAiaTC6aD6Fb8BvGsEYBk1m0vjgUunB94QYv6vY0k Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2937674a925420488961fb21fd37a97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2937674a925420488961fb21fd37a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: a2810fbc1ca54186b8e9b51620466855 Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'f3ada4fd-a429-4055-bbcf-9a7074d63081'} Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:05:51.485929 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Returning 404 to user: Instance f3ada4fd-a429-4055-bbcf-9a7074d63081 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6709d393-d90f-45ad-89fa-ebbbfd879bbd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081" status: 404 len: 111 microversion: 2.1 time: 0.048944 Jul 19 21:05:51.494306 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3446/6999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:51 2022] GET /compute/v2.1/servers/f3ada4fd-a429-4055-bbcf-9a7074d63081 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:05:56.334904 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f22c8373-2dbf-4f65-acb0-6ce7df01ce94 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '.version_select at 0x7f23ee32b940>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:56.372965 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f22c8373-2dbf-4f65-acb0-6ce7df01ce94 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1958818780" status: 202 len: 0 microversion: 2.1 time: 0.045783 Jul 19 21:05:56.374095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3554/7000] 10.222.0.23 () {58 vars in 1283 bytes} [Tue Jul 19 21:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1958818780 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:05:56.424385 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-48f7faa9-8657-43a8-9a12-843aeb990d88 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: .version_select at 0x7f2400a59790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-677729678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO7MbbKz7TXCRZIit4SkEB0xS26EQteliraQutTnj6iBFPZiRpaarN6BHCEPD3jGDB+AROgc0KVvdA9f9nruxQ6Empgx6f4na8e6OyI0ulTPNs7qNeYCrZ4XHwTjZ9lTQ=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:56.443388 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-48f7faa9-8657-43a8-9a12-843aeb990d88 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:05:56.451454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-48f7faa9-8657-43a8-9a12-843aeb990d88 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:05:56.480840 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-48f7faa9-8657-43a8-9a12-843aeb990d88 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.061016 Jul 19 21:05:56.481472 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3447/7001] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:05:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:04.947520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-146935899", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "networks": [{"uuid": "c8234f04-7488-4d04-846f-540d32e8455d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-677729678", "security_groups": [{"name": "tempest-secgroup-smoke-789353542"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:04.960217 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:05.125127 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] validate_networks() for [('c8234f04-7488-4d04-846f-540d32e8455d', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:06:05.922499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:06:05.922959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:06:05.923440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:06:05.924035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:06:05.924463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:06:05.941207 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.942838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.944618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.945415 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.991667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:06:06.002301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Getting quotas for user a2810fbc1ca54186b8e9b51620466855 and project c2937674a925420488961fb21fd37a97. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:06:06.028595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:06:06.033270 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:06:06.133610 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-006efa98-fe68-4581-a34b-dc0ca9fe1297 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.192579 Jul 19 21:06:06.133610 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3555/7002] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:06:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:06:06.153807 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-807cec8f-d313-464f-be52-562665a87e66 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:06.155418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-807cec8f-d313-464f-be52-562665a87e66 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:06.159163 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=16 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:06.262132 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-807cec8f-d313-464f-be52-562665a87e66 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:06.278508 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-807cec8f-d313-464f-be52-562665a87e66 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1265 microversion: 2.1 time: 0.134579 Jul 19 21:06:06.280654 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3448/7003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:06 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:07.305346 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.307040 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:07.315208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.316836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.319373 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.320808 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.436489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:07.449060 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f1281880-fbc5-4341-92f3-fe3eae8c93d7 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1317 microversion: 2.1 time: 0.148730 Jul 19 21:06:07.450653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3556/7004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:07 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:08.472446 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:08.473241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.485126 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.486011 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.487685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.490119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.730658 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:08.744090 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-68779364-c8a0-42c3-ab3d-7ba3a07ac85a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.275743 Jul 19 21:06:08.745474 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3449/7005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:08 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:09.666811 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-455baef8-d83e-493f-8a88-95a3bebbac09 req-a1812d4e-384b-4bfb-a367-f41dff51a938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060cadc7-b0b7-4c9d-9b5c-02bf905da258", "tag": "2f8ecb6b-6aa1-44ab-9991-131ea70fa33e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:09.681868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-455baef8-d83e-493f-8a88-95a3bebbac09 req-a1812d4e-384b-4bfb-a367-f41dff51a938 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.682721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-455baef8-d83e-493f-8a88-95a3bebbac09 req-a1812d4e-384b-4bfb-a367-f41dff51a938 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.707690 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-455baef8-d83e-493f-8a88-95a3bebbac09 req-a1812d4e-384b-4bfb-a367-f41dff51a938 service nova] Creating event network-changed:2f8ecb6b-6aa1-44ab-9991-131ea70fa33e for instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 on n-h2-843834-3 Jul 19 21:06:09.715032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-455baef8-d83e-493f-8a88-95a3bebbac09 req-a1812d4e-384b-4bfb-a367-f41dff51a938 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052432 Jul 19 21:06:09.715982 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3557/7006] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:09.763351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:09.764361 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:09.768196 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:09.774743 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.775483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.776401 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.777186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:10.272597 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:10.280938 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-663c8afe-592d-4723-b88d-a817b3a7dc64 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.522293 Jul 19 21:06:10.281555 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3450/7007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:09 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:11.299726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:11.300492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:11.307705 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:11.308167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:11.308965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:11.309409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:11.561436 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:11.570046 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-06dce477-79c8-4b55-bdc2-7cab43775c4a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.275698 Jul 19 21:06:11.570960 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3558/7008] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:11 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:12.589378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:12.590056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:12.598975 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:12.599475 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:12.600351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:12.600780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:12.765150 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:12.774243 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1b24ad62-19bb-47ff-b6af-11f421c70789 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.188843 Jul 19 21:06:12.774846 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3451/7009] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:12 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:13.793599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:13.795246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:13.804780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:13.805537 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:13.806833 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:13.807489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:13.983972 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:13.993498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-220c0fea-f723-4952-870f-d0e345aab112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.204844 Jul 19 21:06:13.994304 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3559/7010] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:13 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:15.016679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:15.017744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:15.031755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:15.032649 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:15.034060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:15.035054 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:15.278964 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:15.281281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-1dd8132a-3ae3-490d-aecb-95dcb2739bf3 req-88e99199-0a65-4f59-a398-6eeb999d2746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060cadc7-b0b7-4c9d-9b5c-02bf905da258", "name": "network-vif-plugged", "status": "completed", "tag": "2f8ecb6b-6aa1-44ab-9991-131ea70fa33e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:15.293785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-30a36e40-be74-436a-b73d-00ff501e10f3 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.284471 Jul 19 21:06:15.295416 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3452/7011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:15 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:15.308894 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1dd8132a-3ae3-490d-aecb-95dcb2739bf3 req-88e99199-0a65-4f59-a398-6eeb999d2746 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:15.309382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-1dd8132a-3ae3-490d-aecb-95dcb2739bf3 req-88e99199-0a65-4f59-a398-6eeb999d2746 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:15.324935 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-1dd8132a-3ae3-490d-aecb-95dcb2739bf3 req-88e99199-0a65-4f59-a398-6eeb999d2746 service nova] Creating event network-vif-plugged:2f8ecb6b-6aa1-44ab-9991-131ea70fa33e for instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 on n-h2-843834-3 Jul 19 21:06:15.332780 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-1dd8132a-3ae3-490d-aecb-95dcb2739bf3 req-88e99199-0a65-4f59-a398-6eeb999d2746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058545 Jul 19 21:06:15.333958 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3560/7012] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:16.317905 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:16.319047 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:16.324199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:16.335561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:16.336483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:16.337981 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:16.338838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:16.521509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:16.529894 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f5732ce7-1f1b-44ff-a41d-163796f92f37 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1390 microversion: 2.1 time: 0.220203 Jul 19 21:06:16.530729 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3453/7013] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:16 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:17.548715 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:17.549838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:17.552367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:17.553179 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:17.555132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:17.564329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:17.564786 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:17.565606 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:17.566175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:17.764578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:17.773233 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-90cda5dc-99ff-48f7-905d-9b561d613cd5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1562 microversion: 2.1 time: 0.229287 Jul 19 21:06:17.774099 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3561/7014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:17 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:17.795787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:17.796998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:17.810248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:17.811070 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:17.812391 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:17.813167 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:17.977815 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:17.986462 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dc6be923-ba8e-4a05-b24d-7879f0710b60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1562 microversion: 2.1 time: 0.198418 Jul 19 21:06:17.987130 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3454/7015] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:17 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:20.234611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:20.235873 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:20.241161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-0d731652-8dde-47c9-a448-e280d8736432 req-79ba3c40-b912-446b-8d5d-58fc98859c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060cadc7-b0b7-4c9d-9b5c-02bf905da258", "tag": "2f8ecb6b-6aa1-44ab-9991-131ea70fa33e"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:20.249967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:20.250792 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:20.252307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:20.253445 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:20.261596 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d731652-8dde-47c9-a448-e280d8736432 req-79ba3c40-b912-446b-8d5d-58fc98859c18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:20.262790 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-0d731652-8dde-47c9-a448-e280d8736432 req-79ba3c40-b912-446b-8d5d-58fc98859c18 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:20.290847 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-0d731652-8dde-47c9-a448-e280d8736432 req-79ba3c40-b912-446b-8d5d-58fc98859c18 service nova] Creating event network-changed:2f8ecb6b-6aa1-44ab-9991-131ea70fa33e for instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 on n-h2-843834-3 Jul 19 21:06:20.301528 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-0d731652-8dde-47c9-a448-e280d8736432 req-79ba3c40-b912-446b-8d5d-58fc98859c18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070862 Jul 19 21:06:20.305805 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3455/7016] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:20.560437 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:20.575702 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-49ecbfc7-8ece-445e-bc65-0c70fabfb5bd tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1562 microversion: 2.1 time: 0.350240 Jul 19 21:06:20.578323 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3562/7017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:20 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1562 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:43.036453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=11 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:43.037754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=38 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:43.045772 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:43.047629 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:43.060415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:43.061219 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:43.062697 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:43.063540 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:43.140141 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9fb9dc30-b740-4dba-96c6-1fc331c55c60 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action" status: 200 len: 24570 microversion: 2.1 time: 0.107313 Jul 19 21:06:43.141004 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3456/7018] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:06:43 2022] POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action => generated 24570 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:06:54.227473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:54.228074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:54.230429 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:54.231120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=36 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:54.238461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:54.239036 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:54.239834 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:54.240280 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:54.266749 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lazy-loading 'flavor' on Instance uuid 060cadc7-b0b7-4c9d-9b5c-02bf905da258 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:06:54.396107 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b6340a4d-4966-47d5-9fe2-569d285ef409 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action" status: 202 len: 0 microversion: 2.1 time: 0.171823 Jul 19 21:06:54.397330 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3563/7019] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:06:54 2022] POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:06:54.412320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:54.413603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:54.419216 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:54.421694 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=4 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:54.437230 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:54.438024 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:54.439394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:54.440315 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:54.668747 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:54.677698 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-edacd17b-c676-4364-a9b9-c49d011663b5 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1689 microversion: 2.1 time: 0.274104 Jul 19 21:06:54.678307 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3457/7020] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:54 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1689 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:55.701911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:55.702622 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:55.709998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:55.710465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:55.711356 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:55.711796 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:55.867744 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:55.876365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0863aaf0-a1db-4a86-ba44-b89b246b1a52 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1672 microversion: 2.1 time: 0.180242 Jul 19 21:06:55.876983 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3564/7021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:55 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:56.969836 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:56.970813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:56.978224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:56.978689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:56.979529 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:56.979963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:57.059417 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f17ae365-329d-4609-a8d0-9c898c40d12a tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action" status: 200 len: 38367 microversion: 2.1 time: 0.093430 Jul 19 21:06:57.060100 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3458/7022] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:06:56 2022] POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action => generated 38367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:06:57.073704 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:57.074378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:57.083135 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:57.083659 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:57.084523 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:57.085006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:57.163718 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8dbff7e5-b2b3-4c2a-8cba-6f74f622f6bc tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action" status: 202 len: 0 microversion: 2.1 time: 0.094799 Jul 19 21:06:57.164566 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3565/7023] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:06:57 2022] POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:06:57.176231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:57.177110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:57.184610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:57.185089 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:57.185988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:57.186423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:57.389656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:57.398526 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bbef98de-a6b6-4bfe-a0c1-b88c37d0ba91 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1678 microversion: 2.1 time: 0.226759 Jul 19 21:06:57.399288 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3459/7024] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:57 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:58.418634 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:58.419466 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:58.426892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:58.427369 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:58.428139 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:58.428601 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:58.598329 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:58.606590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9071d6fb-c239-4332-94b8-5d59179ba827 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1678 microversion: 2.1 time: 0.193196 Jul 19 21:06:58.607232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3566/7025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:58 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:59.624761 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:59.625433 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:59.633812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:59.634258 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:59.635121 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:59.635588 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:59.795199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:59.803744 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-737d86e7-ad63-4cf6-9bf9-dd75625f0329 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1681 microversion: 2.1 time: 0.183100 Jul 19 21:06:59.804349 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3460/7026] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:59 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:00.278710 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:00.279725 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:00.290088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:00.290890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:00.292442 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:00.293247 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:00.343757 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bba9775-7a18-4f7e-bd33-9beefb7e7c32 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action" status: 200 len: 38367 microversion: 2.1 time: 0.068323 Jul 19 21:07:00.344998 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3567/7027] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:07:00 2022] POST /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258/action => generated 38367 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:07:01.948367 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:01.949291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:01.953355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-268001a7-d1b3-4db8-bac0-1b1a9b31ef07 req-011ed524-813a-44b4-9072-9dac71dc1c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060cadc7-b0b7-4c9d-9b5c-02bf905da258", "tag": "2f8ecb6b-6aa1-44ab-9991-131ea70fa33e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:01.962098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:01.963398 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:01.964796 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:01.965551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:01.972521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-268001a7-d1b3-4db8-bac0-1b1a9b31ef07 req-011ed524-813a-44b4-9072-9dac71dc1c98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:01.973381 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-268001a7-d1b3-4db8-bac0-1b1a9b31ef07 req-011ed524-813a-44b4-9072-9dac71dc1c98 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:01.988236 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-268001a7-d1b3-4db8-bac0-1b1a9b31ef07 req-011ed524-813a-44b4-9072-9dac71dc1c98 service nova] Creating event network-changed:2f8ecb6b-6aa1-44ab-9991-131ea70fa33e for instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 on n-h2-843834-3 Jul 19 21:07:01.995590 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-268001a7-d1b3-4db8-bac0-1b1a9b31ef07 req-011ed524-813a-44b4-9072-9dac71dc1c98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052252 Jul 19 21:07:01.997446 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3568/7028] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:02.014652 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Going to try to terminate instance {{(pid=131230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:07:02.145281 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0117b361-89f9-4d9b-9852-af4480c7e049 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 204 len: 0 microversion: 2.1 time: 0.204948 Jul 19 21:07:02.146530 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3461/7029] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:07:01 2022] DELETE /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:07:02.157762 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:02.158633 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:02.166322 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:02.167146 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:02.168116 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:02.168551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:02.376485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:02.385928 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3b57f5d4-447f-4805-bbb7-7e38c32f06fe tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1687 microversion: 2.1 time: 0.233972 Jul 19 21:07:02.386740 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3569/7030] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:02 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1687 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:03.409704 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:03.410405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:03.418248 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:03.418778 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:03.419562 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:03.420013 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:03.697867 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:03.707580 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-764ed69a-e4bc-49b2-b213-c35eedca1b13 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1687 microversion: 2.1 time: 0.302390 Jul 19 21:07:03.708415 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3462/7031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:03 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1687 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:04.397964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-34fecc50-4f8f-4be5-9b97-0db9ddfa986a req-171be37b-ec23-47d5-98d1-25750efca2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060cadc7-b0b7-4c9d-9b5c-02bf905da258", "name": "network-vif-deleted", "tag": "2f8ecb6b-6aa1-44ab-9991-131ea70fa33e"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:04.408578 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-34fecc50-4f8f-4be5-9b97-0db9ddfa986a req-171be37b-ec23-47d5-98d1-25750efca2cd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:04.409033 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-34fecc50-4f8f-4be5-9b97-0db9ddfa986a req-171be37b-ec23-47d5-98d1-25750efca2cd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:04.421699 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-34fecc50-4f8f-4be5-9b97-0db9ddfa986a req-171be37b-ec23-47d5-98d1-25750efca2cd service nova] Creating event network-vif-deleted:2f8ecb6b-6aa1-44ab-9991-131ea70fa33e for instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 on n-h2-843834-3 Jul 19 21:07:04.427357 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-34fecc50-4f8f-4be5-9b97-0db9ddfa986a req-171be37b-ec23-47d5-98d1-25750efca2cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Jul 19 21:07:04.428055 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3570/7032] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:04.734209 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:04.734830 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:04.742884 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:04.743397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:04.744214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:04.744673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:04.791834 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:04.793025 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:04.793835 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lazy-loading 'fault' on Instance uuid 060cadc7-b0b7-4c9d-9b5c-02bf905da258 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:07:04.847123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2810fbc1ca54186b8e9b51620466855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2937674a925420488961fb21fd37a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:04.858196 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9c8c4fc6-c9f5-4d2b-afa4-062e383c152e tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 200 len: 1355 microversion: 2.1 time: 0.129929 Jul 19 21:07:04.859441 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3463/7033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:04 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 1355 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:05.877885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:05.878595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] [instance: 060cadc7-b0b7-4c9d-9b5c-02bf905da258] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:05.886001 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:05.886458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:05.887315 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:05.887756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:05.903344 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] HTTP exception thrown: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Request method failure captured: Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 HTTP/1.1 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1xr9nrb49zQu7WaxZSdT805KQFppjC4a8B3v9f0ThMPSeqHVdXwJg0kRa5oe7dUsixeGuTqOKyxsCknd46MLik8M4fhETJHZQQVSj12g3bozBIxnGHsU3sMpO8qEOYzjs3rGHJyAiaTC6aD6Fb8BvGsEYBk1m0vjgUunB94QYv6vY0k Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2937674a925420488961fb21fd37a97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2937674a925420488961fb21fd37a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2937674a925420488961fb21fd37a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: c2937674a925420488961fb21fd37a97 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-324715111 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: a2810fbc1ca54186b8e9b51620466855 Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-324715111-project Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '060cadc7-b0b7-4c9d-9b5c-02bf905da258'} Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:05.905183 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Returning 404 to user: Instance 060cadc7-b0b7-4c9d-9b5c-02bf905da258 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-836b8452-577c-4aa5-aa82-d7c8579df112 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258" status: 404 len: 111 microversion: 2.1 time: 0.034256 Jul 19 21:07:05.910163 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3571/7034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:05 2022] GET /compute/v2.1/servers/060cadc7-b0b7-4c9d-9b5c-02bf905da258 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:07:09.932228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f6e72b88-a210-4392-b183-fbb99ae1c621 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] Calling method '.version_select at 0x7f23ef5e8280>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:09.958982 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f6e72b88-a210-4392-b183-fbb99ae1c621 tempest-TestNetworkAdvancedServerOps-324715111 tempest-TestNetworkAdvancedServerOps-324715111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677729678" status: 202 len: 0 microversion: 2.1 time: 0.033161 Jul 19 21:07:09.960034 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3464/7035] 10.222.0.23 () {58 vars in 1280 bytes} [Tue Jul 19 21:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677729678 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:07:25.617805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=18 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:25.619147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:26.038886 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0fc31c9-5088-4fde-b80b-7a6e07e738b5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'create', calling method: .version_select at 0x7f23eebcd670>, body: {"keypair": {"name": "tempest-TestShelveInstance-27301620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALHFkc06pg5Cu06CFtervsN3eOOCEP7JAt7q6xPEk4r6cA24FkqRml/FjuWI9S/b/4hAiLQwZFPnOUawaFyXiRwzbWi6spqCaChQPS6ZvaldBz2GDXm4mrCIq34yKlA4g=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:26.064951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d0fc31c9-5088-4fde-b80b-7a6e07e738b5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for project e7d53ae11da64e28ba7c85541c61142c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:07:26.075307 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-d0fc31c9-5088-4fde-b80b-7a6e07e738b5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for user b68a401ddf04467b8f920d99aead86e3 and project e7d53ae11da64e28ba7c85541c61142c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:07:26.123963 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0fc31c9-5088-4fde-b80b-7a6e07e738b5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.516076 Jul 19 21:07:26.125368 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3572/7036] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:07:25 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:27.465009 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:27.466294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:27.470886 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1461869987", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-27301620", "security_groups": [{"name": "tempest-secgroup-smoke-1291242820"}], "networks": [{"uuid": "d9c60de5-4171-4943-87ed-3b22b089e8f7"}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:27.619320 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] validate_networks() for [('d9c60de5-4171-4943-87ed-3b22b089e8f7', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:07:28.158418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:07:28.159660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:07:28.160613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:07:28.161338 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:07:28.161994 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:07:28.176928 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:28.177611 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:28.179049 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:28.179819 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:28.213851 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for project e7d53ae11da64e28ba7c85541c61142c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:07:28.225763 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for user b68a401ddf04467b8f920d99aead86e3 and project e7d53ae11da64e28ba7c85541c61142c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:07:28.249324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:07:28.253215 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:07:28.320677 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [0ac76228-8b84-4e78-be0d-f472d1549a4e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:07:29.330482 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [0ac76228-8b84-4e78-be0d-f472d1549a4e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54668. Jul 19 21:07:29.336806 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-760ca0c4-e5a0-47d5-bbd1-7c396d34c4be tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.873439 Jul 19 21:07:29.345482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3465/7037] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:07:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:07:29.353890 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f542324-6dfd-4ed1-9f2b-44aa92c41c5a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:29.358802 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f542324-6dfd-4ed1-9f2b-44aa92c41c5a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:29.439404 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f542324-6dfd-4ed1-9f2b-44aa92c41c5a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:29.447262 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f542324-6dfd-4ed1-9f2b-44aa92c41c5a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1245 microversion: 2.1 time: 0.099865 Jul 19 21:07:29.448395 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3573/7038] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:29 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:30.475428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:30.476530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:30.487444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:30.488113 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:30.489395 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:30.490111 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:30.583272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:30.603158 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ef0e1ec9-c907-4c18-95a7-78499053d2a0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1297 microversion: 2.1 time: 0.136911 Jul 19 21:07:30.604599 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3466/7039] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:30 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:31.639004 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:31.639678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:31.651182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:31.651777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:31.652756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:31.653290 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:31.923022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:31.936864 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46261eee-5a0d-466c-adf4-18ea5d79a824 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.308857 Jul 19 21:07:31.937559 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3574/7040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:31 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:32.823189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-8d9c3414-49fc-4daf-837c-e0fd8a5ca310 req-c9b0abda-d76e-4b5f-ba1f-52c53cc5b82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:32.836593 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8d9c3414-49fc-4daf-837c-e0fd8a5ca310 req-c9b0abda-d76e-4b5f-ba1f-52c53cc5b82f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:32.837228 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-8d9c3414-49fc-4daf-837c-e0fd8a5ca310 req-c9b0abda-d76e-4b5f-ba1f-52c53cc5b82f service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:32.858519 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-8d9c3414-49fc-4daf-837c-e0fd8a5ca310 req-c9b0abda-d76e-4b5f-ba1f-52c53cc5b82f service nova] Creating event network-changed:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h1-843834-3 Jul 19 21:07:32.864909 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-8d9c3414-49fc-4daf-837c-e0fd8a5ca310 req-c9b0abda-d76e-4b5f-ba1f-52c53cc5b82f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152121 Jul 19 21:07:32.865538 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3467/7041] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:32.958635 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:32.959614 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:32.969591 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:32.973531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:32.973531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:32.973531 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:33.226061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:33.234525 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-26268c44-1e40-4197-9294-1a06564651d8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.282963 Jul 19 21:07:33.235213 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3575/7042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:32 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:34.262103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:34.263575 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:34.276220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.277006 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.278291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.279227 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.543767 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:34.553472 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6b04cc13-0ca0-4fbd-abeb-414c54ffbc69 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.301957 Jul 19 21:07:34.554215 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3468/7043] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:34 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:35.573295 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:35.573906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:35.582006 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.582552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.583618 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.584151 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.779216 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:35.792692 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0d4a0012-3bdb-4337-90d8-8478601f13f1 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.223509 Jul 19 21:07:35.793780 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3576/7044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:35 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:36.819173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:36.820072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:36.828689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.829155 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:36.830045 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.830502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:37.011469 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:37.020125 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-40d1397c-c47a-4acf-b196-b5f90830f5d5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.205533 Jul 19 21:07:37.020683 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3469/7045] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:36 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:38.038287 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:38.038933 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:38.047180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.047644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.048536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.048980 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.192448 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:38.210723 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-61e4795f-ebf5-4c5e-8e5f-873ff9adaa32 req-65143002-2315-48e0-a249-78accfaffdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "name": "network-vif-plugged", "status": "completed", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:38.224351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-61e4795f-ebf5-4c5e-8e5f-873ff9adaa32 req-65143002-2315-48e0-a249-78accfaffdc6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.225561 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-61e4795f-ebf5-4c5e-8e5f-873ff9adaa32 req-65143002-2315-48e0-a249-78accfaffdc6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.246721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:38.251934 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-61e4795f-ebf5-4c5e-8e5f-873ff9adaa32 req-65143002-2315-48e0-a249-78accfaffdc6 service nova] Creating event network-vif-plugged:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h1-843834-3 Jul 19 21:07:38.262139 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-61e4795f-ebf5-4c5e-8e5f-873ff9adaa32 req-65143002-2315-48e0-a249-78accfaffdc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180538 Jul 19 21:07:38.263482 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3470/7046] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:38.664379 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:38.675209 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2de428af-04e6-4a02-9b7f-501febdc64cd tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.640779 Jul 19 21:07:38.676266 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3577/7047] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:38 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:39.702551 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:39.703305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:39.710792 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.711393 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:39.712411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.712411 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:39.924511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:39.934949 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05b87c98-33c7-4b83-a3f0-5c9b24b21735 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1371 microversion: 2.1 time: 0.239542 Jul 19 21:07:39.935570 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3471/7048] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:39 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:40.956683 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:40.957842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:40.962178 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:40.975339 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:40.976160 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:40.977586 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:40.978352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.155430 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:41.166465 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d9aa88da-09f6-4ccb-ab20-a66624841fd7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1555 microversion: 2.1 time: 0.217104 Jul 19 21:07:41.167240 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3578/7049] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:40 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:41.186289 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:41.187610 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:41.195536 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.195996 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.197142 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.197591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.381125 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:41.391437 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17a62405-3e89-4ab6-a10e-570e6360e17e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1555 microversion: 2.1 time: 0.210934 Jul 19 21:07:41.392230 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3472/7050] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:41 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:43.972260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-2ea22501-e7a0-460d-b529-1f6040450d50 req-d5dbd67c-4ca1-4f7b-b7a1-a2d662bbe7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:43.982492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2ea22501-e7a0-460d-b529-1f6040450d50 req-d5dbd67c-4ca1-4f7b-b7a1-a2d662bbe7f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:43.983091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-2ea22501-e7a0-460d-b529-1f6040450d50 req-d5dbd67c-4ca1-4f7b-b7a1-a2d662bbe7f1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:43.997091 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-2ea22501-e7a0-460d-b529-1f6040450d50 req-d5dbd67c-4ca1-4f7b-b7a1-a2d662bbe7f1 service nova] Creating event network-changed:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h1-843834-3 Jul 19 21:07:44.003179 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-2ea22501-e7a0-460d-b529-1f6040450d50 req-d5dbd67c-4ca1-4f7b-b7a1-a2d662bbe7f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110447 Jul 19 21:07:44.003940 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3579/7051] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:09.893957 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:09:09.894764 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:09:39.223162 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:09:39.224428 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:09:39.225678 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:39.226627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=36 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:39.232799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:39.233705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:39.245924 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:39.246740 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:39.248185 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:39.248979 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:39.292294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.objects.instance [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lazy-loading 'flavor' on Instance uuid 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 {{(pid=131230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:09:39.822597 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-55df2f4d-9280-4560-a542-808c3de24921 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.601960 Jul 19 21:09:39.823429 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3473/7052] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:09:39 2022] POST /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:09:39.832888 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:09:39.835573 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:39.836837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=32 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:39.845819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:39.846780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:39.859406 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:39.859950 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:39.860952 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:39.861480 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:40.172227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:40.180709 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-bd6a9a76-1989-4bda-b7a0-bf6146dacc27 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.351299 Jul 19 21:09:40.181309 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3580/7053] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:39 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:41.203842 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:41.204570 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:41.216037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:41.216511 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:41.217363 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:41.217813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:41.222678 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54780. Jul 19 21:09:41.229786 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54782. Jul 19 21:09:41.383560 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:41.392116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2fe1fc1b-3a6c-4790-8a80-88204a20c560 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.196110 Jul 19 21:09:41.392979 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3474/7054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:41 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:42.411859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:42.412819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:42.430625 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:42.431461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:42.432908 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:42.433697 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:42.444531 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54786. Jul 19 21:09:42.642136 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:42.650587 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-72a691dd-7e8d-4c55-8b24-27bb593ba95f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.244136 Jul 19 21:09:42.651276 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3581/7055] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:42 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:43.670421 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:43.671091 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:43.678903 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:43.679406 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:43.680217 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:43.680673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:43.848355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:43.859102 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ee1fcf46-c252-4f5b-b05b-ee75dbccadb8 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.193378 Jul 19 21:09:43.859802 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3475/7056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:43 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:44.877747 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:44.878375 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:44.886959 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:44.887731 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:44.888661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:44.889091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:45.062682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:45.071923 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-260f8eb0-4a89-4b78-9efd-3cf7607d5f81 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.198070 Jul 19 21:09:45.072624 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3582/7057] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:44 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:45.209030 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:09:45.209346 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:09:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:09:46.090087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:46.090797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:46.098233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:46.098765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:46.099553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:46.100120 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:46.260810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:46.270699 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5679629c-7a10-4ae8-a4be-a03db270af70 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.184545 Jul 19 21:09:46.271315 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3476/7058] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:46 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:47.287823 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:47.288431 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:47.296138 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:47.296592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:47.297383 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:47.297816 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:47.471524 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:47.480096 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5e508c0f-9d42-45cb-8d87-ea9da7121fc3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.196180 Jul 19 21:09:47.480694 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3583/7059] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:47 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:48.498221 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:48.498780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:48.505993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:48.506461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:48.507360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:48.507847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:48.658071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:48.667178 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8a835c61-f1a5-4a5e-a50d-3c16bd0ac30b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.173229 Jul 19 21:09:48.667772 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3477/7060] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:48 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:49.685098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:49.685734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:49.693694 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:49.694143 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:49.694930 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:49.695407 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:49.851609 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:49.860212 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-29690dee-7b82-4d95-b69e-b71fec62d0d3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.179153 Jul 19 21:09:49.860823 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3584/7061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:49 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:50.878594 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:50.879350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:50.887294 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:50.887770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:50.888586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:50.889044 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:51.041977 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:51.055663 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-c2e709e5-a2a5-4e7a-a0db-6c3b1caaef9b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1700 microversion: 2.1 time: 0.181116 Jul 19 21:09:51.056287 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3478/7062] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:50 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:52.075084 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:52.076378 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:52.084671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:52.085120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:52.085915 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:52.086347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:52.245243 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:52.260687 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-893bfca8-abf1-4b6c-95d7-02a1f4d0f33e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1700 microversion: 2.1 time: 0.189996 Jul 19 21:09:52.261501 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3585/7063] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:52 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1700 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:53.280901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:53.294672 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:53.304278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:53.305223 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:53.306278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:53.306953 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:53.515910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:53.527525 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cfc19610-2c55-4e0e-86c4-66f4470dd04e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.250748 Jul 19 21:09:53.538169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3479/7064] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:53 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:54.546767 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:54.547473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:54.562682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:54.563474 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:54.564292 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:54.564726 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:54.714010 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b249fc93-5ab9-4be0-b18b-a164bd7d4a76 req-aaabd9bd-8b70-4fe6-8c3a-1d52b9121a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "name": "network-vif-plugged", "status": "completed", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:54.732567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b249fc93-5ab9-4be0-b18b-a164bd7d4a76 req-aaabd9bd-8b70-4fe6-8c3a-1d52b9121a75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:54.733364 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b249fc93-5ab9-4be0-b18b-a164bd7d4a76 req-aaabd9bd-8b70-4fe6-8c3a-1d52b9121a75 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:54.756350 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b249fc93-5ab9-4be0-b18b-a164bd7d4a76 req-aaabd9bd-8b70-4fe6-8c3a-1d52b9121a75 service nova] Creating event network-vif-plugged:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h1-843834-3 Jul 19 21:09:54.764313 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b249fc93-5ab9-4be0-b18b-a164bd7d4a76 req-aaabd9bd-8b70-4fe6-8c3a-1d52b9121a75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054105 Jul 19 21:09:54.765893 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3480/7065] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:54.780462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:54.789900 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7c123ef2-3eac-4278-a3c7-b7deb73a5a0d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.247132 Jul 19 21:09:54.790806 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3586/7066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:54 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:55.812454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:55.813788 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:55.828135 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:55.829334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:55.830770 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:55.831607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.041170 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:56.050055 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9faca1c2-fccc-4544-a3b8-1f6efd53c5bc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.245641 Jul 19 21:09:56.051378 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3481/7067] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:55 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:57.070857 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:57.072804 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:57.081507 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.081964 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:57.082763 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.083236 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:57.275333 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:57.284032 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-98f74e6e-d2a6-4516-a021-6db3b4465b21 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.217387 Jul 19 21:09:57.292467 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3587/7068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:57 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:09:58.301810 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:58.302468 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:58.310603 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:58.311110 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.311909 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:58.312427 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.478492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:58.487783 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a5f336c9-3915-441b-bc88-5f58e84fa9ed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.190543 Jul 19 21:09:58.488619 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3482/7069] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:58 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:59.506417 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:59.507087 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:59.516389 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.516962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:59.523940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.523940 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:59.711494 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:59.722512 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2cd83f93-9167-42ea-b052-92cf152f56a2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.220679 Jul 19 21:09:59.723547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3588/7070] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:59 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:00.743670 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:00.744586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:00.752935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:00.753405 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:00.754254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:00.754713 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:00.943766 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:00.953524 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a910a338-0b7c-47ee-829a-b8156d330a1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.214077 Jul 19 21:10:00.954458 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3483/7071] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:00 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:01.972843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:01.973413 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:01.981470 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.981926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.982770 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.983246 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:02.139061 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:02.150607 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-9080ecfb-3760-4558-a546-c6d2ba53dd4d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1695 microversion: 2.1 time: 0.181652 Jul 19 21:10:02.151333 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3589/7072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:01 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:03.168780 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:03.169554 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:03.177233 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.177787 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.178591 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.179097 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.341187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:03.350599 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e5aa8344-9fe9-4b2c-abf2-133eb67dccb0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1677 microversion: 2.1 time: 0.185790 Jul 19 21:10:03.351386 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3484/7073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:03 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:04.369039 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:04.369678 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:04.377836 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:04.378198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:04.379021 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:04.379458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:04.536934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:04.544835 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f3ebc0b4-1f9d-4ecc-a77a-75c3de673857 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1677 microversion: 2.1 time: 0.179943 Jul 19 21:10:04.545447 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3590/7074] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:04 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:04.660174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-6276bf45-e04c-4ca8-8126-ae8b2a2d5c4a req-59c2437e-2005-438c-9957-d6f3d23521bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "name": "network-vif-unplugged", "status": "completed", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:04.676812 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6276bf45-e04c-4ca8-8126-ae8b2a2d5c4a req-59c2437e-2005-438c-9957-d6f3d23521bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:04.677690 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-6276bf45-e04c-4ca8-8126-ae8b2a2d5c4a req-59c2437e-2005-438c-9957-d6f3d23521bd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:04.699860 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-6276bf45-e04c-4ca8-8126-ae8b2a2d5c4a req-59c2437e-2005-438c-9957-d6f3d23521bd service nova] Creating event network-vif-unplugged:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h1-843834-3 Jul 19 21:10:04.706585 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-6276bf45-e04c-4ca8-8126-ae8b2a2d5c4a req-59c2437e-2005-438c-9957-d6f3d23521bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060180 Jul 19 21:10:04.707890 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3485/7075] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:05.562069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:05.562723 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:05.570901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.572012 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.572902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.573353 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.727963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:05.737357 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-00d2dff4-89b6-40c4-b3f9-da9e51668fb7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1620 microversion: 2.1 time: 0.179021 Jul 19 21:10:05.738105 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3591/7076] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:05 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1620 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:05.757567 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:05.758400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:05.765614 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.766074 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.766891 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.767362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.922874 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-3abf17e0-86bf-44de-9cc0-611cb04053f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.171320 Jul 19 21:10:05.923843 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3486/7077] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:05 2022] POST /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:10:05.933119 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:05.933965 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:05.942509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.943547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.944851 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.945465 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:06.125098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:06.139568 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0239db39-9c2a-4160-a26c-6ef10c801b73 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1628 microversion: 2.1 time: 0.210542 Jul 19 21:10:06.143981 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3592/7078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:05 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1628 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:07.160850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:07.162378 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:07.170530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.171030 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.171895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.172345 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.354197 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:07.358027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:07.363175 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d24d25a7-e7a7-4d73-811d-046bfa204800 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1630 microversion: 2.1 time: 0.208263 Jul 19 21:10:07.363766 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3487/7079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:07 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1630 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:08.382096 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:08.382707 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:08.390225 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:08.390684 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:08.391516 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:08.391946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:08.557352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-65095b1c-f0e2-440c-83b9-7032e2c6d268 req-5ab7b911-218f-45ff-8dd5-0daaa09d46f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:08.567996 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:08.571279 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65095b1c-f0e2-440c-83b9-7032e2c6d268 req-5ab7b911-218f-45ff-8dd5-0daaa09d46f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:08.573409 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-65095b1c-f0e2-440c-83b9-7032e2c6d268 req-5ab7b911-218f-45ff-8dd5-0daaa09d46f0 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:08.581157 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-ee73ba30-505c-477b-9b1d-16a7e0807961 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.203025 Jul 19 21:10:08.582178 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3593/7080] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:08 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:08.597114 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-65095b1c-f0e2-440c-83b9-7032e2c6d268 req-5ab7b911-218f-45ff-8dd5-0daaa09d46f0 service nova] Creating event network-changed:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h2-843834-3 Jul 19 21:10:08.605116 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-65095b1c-f0e2-440c-83b9-7032e2c6d268 req-5ab7b911-218f-45ff-8dd5-0daaa09d46f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066773 Jul 19 21:10:08.606561 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3488/7081] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:09.604326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:09.606456 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:09.621484 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:09.622380 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:09.623987 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:09.624881 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:09.886838 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:09.891732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=89 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:09.907517 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-7579e1b7-9138-4588-b79b-7bc3b5fa421f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.309898 Jul 19 21:10:09.908661 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3594/7082] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:09 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:10.928781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:10.929773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:10.937282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=35 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:10.941933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:10.942510 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:10.943679 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:10.944237 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:11.120061 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:11.129942 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22766359-a6c5-4fe9-a6b4-d406c957bf1e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.205755 Jul 19 21:10:11.130621 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3489/7083] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:10 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:12.152074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:12.153468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:12.160455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=31 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:10:12.168449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:12.169342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:12.170837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:12.171721 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:12.360053 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:12.373890 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dd8ed18c-941a-46c9-853e-7cbbf4bd785f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.227250 Jul 19 21:10:12.375009 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3595/7084] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:12 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:13.393832 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:13.394701 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:13.403521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:13.403985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:13.404791 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:13.405234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:13.654989 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:13.698372 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-88cc671f-9f1a-4c9e-80fe-c91174081ec7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.309334 Jul 19 21:10:13.706814 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3490/7085] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:13 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:10:14.733530 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:14.734542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:14.742362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:14.742866 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:14.743765 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:14.744211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:14.915132 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:14.927307 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1c4598c-a2d7-4b2d-9607-9abc8c2996a9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.199167 Jul 19 21:10:14.928297 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3596/7086] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:14 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:15.952332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:15.952961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:15.960708 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:15.961173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:15.961961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:15.962417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:16.147291 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:16.158067 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-4ebcaae4-60c5-47b6-a6bf-e01de571d7bb tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.209666 Jul 19 21:10:16.158758 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3491/7087] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:15 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:17.177363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:17.178110 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:17.187130 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:17.187603 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:17.188463 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:17.188919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:17.340118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:17.348228 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-02d0312c-c3dc-440d-98c9-17b7e7aa402a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.175132 Jul 19 21:10:17.348853 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3597/7088] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:17 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:18.365982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:18.366685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:18.374439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:18.374828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:18.375656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:18.376103 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:18.534305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:18.543257 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-14e4d9bf-6bf1-4ca4-873e-460850c2eeef tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.181101 Jul 19 21:10:18.543869 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3492/7089] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:18 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:19.560829 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:19.561457 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:19.571926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:19.572391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:19.573204 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:19.573644 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:19.735756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:19.746489 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-94ab689f-dbd7-42af-9ca6-f7e21137d15c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.189798 Jul 19 21:10:19.747156 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3598/7090] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:19 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:20.765895 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:20.766553 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:20.774365 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:20.774828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:20.775688 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:20.776180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:20.961444 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:20.969665 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-58257df5-6272-40c8-a00e-aff8d7d21dce tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.207968 Jul 19 21:10:20.979439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3493/7091] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:20 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:21.990117 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:21.990777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:22.002439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:22.002951 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:22.003735 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:22.004182 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:22.172736 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:22.185408 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b1158615-8957-49e0-91c0-e66e96471223 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.201298 Jul 19 21:10:22.186425 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3599/7092] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:21 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:22.351751 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-640b4328-090c-442d-88dc-ac2faea8875e req-29aa2cfb-680b-4c37-8477-c3055bd349d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "name": "network-vif-plugged", "status": "completed", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:22.367387 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-640b4328-090c-442d-88dc-ac2faea8875e req-29aa2cfb-680b-4c37-8477-c3055bd349d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:22.367733 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-640b4328-090c-442d-88dc-ac2faea8875e req-29aa2cfb-680b-4c37-8477-c3055bd349d6 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:22.389576 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-640b4328-090c-442d-88dc-ac2faea8875e req-29aa2cfb-680b-4c37-8477-c3055bd349d6 service nova] Creating event network-vif-plugged:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h2-843834-3 Jul 19 21:10:22.398267 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-640b4328-090c-442d-88dc-ac2faea8875e req-29aa2cfb-680b-4c37-8477-c3055bd349d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052618 Jul 19 21:10:22.399439 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3494/7093] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:10:23.206687 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:23.207599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:23.215698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:23.216166 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:23.217072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:23.217579 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:23.375274 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:23.384070 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-797f3250-0197-4d56-b97d-51525451276c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.181671 Jul 19 21:10:23.384688 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3600/7094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:23 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:24.414165 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:24.415081 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:24.423226 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:24.423808 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:24.424855 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:24.425499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:24.622272 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:24.637620 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ed00fb17-8348-4656-bd1e-7ef8325983df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1686 microversion: 2.1 time: 0.229403 Jul 19 21:10:24.638874 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3495/7095] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:24 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1686 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:25.665998 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:25.666764 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:25.674368 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:25.674835 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:25.675677 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:25.676122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:25.846208 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:25.857629 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4660d0c1-d60a-4872-9d8f-8fd06170d746 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1673 microversion: 2.1 time: 0.197105 Jul 19 21:10:25.858289 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3601/7096] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:25 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:40.226530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=13 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:40.227355 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=40 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:40.227607 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=13 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:40.228984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=43 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:40.232112 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-53541cff-7e76-4530-8976-ec874648814c req-966eaba1-494b-49cc-bee8-d1b4841ecf34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:40.233903 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:40.234495 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:40.242458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:40.242963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:40.243757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:40.244239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:40.245033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-53541cff-7e76-4530-8976-ec874648814c req-966eaba1-494b-49cc-bee8-d1b4841ecf34 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:40.245650 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-53541cff-7e76-4530-8976-ec874648814c req-966eaba1-494b-49cc-bee8-d1b4841ecf34 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:40.262015 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-53541cff-7e76-4530-8976-ec874648814c req-966eaba1-494b-49cc-bee8-d1b4841ecf34 service nova] Creating event network-changed:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h2-843834-3 Jul 19 21:11:40.269126 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-53541cff-7e76-4530-8976-ec874648814c req-966eaba1-494b-49cc-bee8-d1b4841ecf34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044661 Jul 19 21:11:40.270008 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3496/7097] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:40.284171 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:11:40.432645 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-eb950634-17bf-4581-b0e7-6a6998816bd3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 204 len: 0 microversion: 2.1 time: 0.207798 Jul 19 21:11:40.433187 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3602/7098] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:11:40 2022] DELETE /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:11:40.443332 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:40.444249 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:40.455072 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:40.455656 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:40.456622 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:40.457084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:40.621234 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:40.635614 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1ecc88c6-0b68-4f8c-a377-a7fc1fb1c9a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.196862 Jul 19 21:11:40.636688 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3497/7099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:40 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:41.660147 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:41.663642 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:41.673540 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:41.674101 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:41.674984 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:41.675405 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:41.895427 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:41.904223 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d0e15537-a5f8-4301-8e3e-bcbf38ca772e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 200 len: 1679 microversion: 2.1 time: 0.252389 Jul 19 21:11:41.912329 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3603/7100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:41 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 1679 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:42.408412 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-11452c15-11a9-43b3-b0be-914e95d0450a req-2815163d-53f1-4f1e-b979-496dbb62b8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab3bfef-1b92-414c-9cee-a7aa1374b1d5", "name": "network-vif-deleted", "tag": "dbe5b859-f606-4064-b24d-e96ff6e76f31"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:42.419187 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-11452c15-11a9-43b3-b0be-914e95d0450a req-2815163d-53f1-4f1e-b979-496dbb62b8dd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:42.420140 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-11452c15-11a9-43b3-b0be-914e95d0450a req-2815163d-53f1-4f1e-b979-496dbb62b8dd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:42.436416 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-11452c15-11a9-43b3-b0be-914e95d0450a req-2815163d-53f1-4f1e-b979-496dbb62b8dd service nova] Creating event network-vif-deleted:dbe5b859-f606-4064-b24d-e96ff6e76f31 for instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 on n-h2-843834-3 Jul 19 21:11:42.442143 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-11452c15-11a9-43b3-b0be-914e95d0450a req-2815163d-53f1-4f1e-b979-496dbb62b8dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038135 Jul 19 21:11:42.442800 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3498/7101] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:42.923536 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:42.924175 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:42.930968 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:42.931756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:42.932572 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:42.933367 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:42.953801 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.wsgi [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] HTTP exception thrown: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Request method failure captured: Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: request: GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 HTTP/1.1 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Accept: application/json Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Accept-Encoding: identity Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Connection: close Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Content-Length: 0 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Content-Type: application/json Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Host: 10.222.0.23 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: Openstack-System-Scope: None Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: User-Agent: python-urllib3/1.26.9 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Auth-Token: gAAAAABi1x0FjgGEjgTU6FegSQAcV9iXu8awQcyvnl72etNQfcEHW6btxLRPG1fyWAw5skmZgET73tnfpYM678ur0xRtDwsc6ZK7I2HgDQggD8_tQwgXZRQe2902i7fbIWIZc7KlMh7z8xdOD-_qpWnbVSbhMXZyYucdecXsp5i01XRroTI5C7o Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Id: None Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Domain-Name: None Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Identity-Status: Confirmed Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Is-Admin-Project: True Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Id: default Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Domain-Name: Default Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Id: e7d53ae11da64e28ba7c85541c61142c Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Project-Name: tempest-TestShelveInstance-2081148350 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Role: reader,member Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Roles: reader,member Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant: tempest-TestShelveInstance-2081148350 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Id: e7d53ae11da64e28ba7c85541c61142c Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-Tenant-Name: tempest-TestShelveInstance-2081148350 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-User: tempest-TestShelveInstance-2081148350-project Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Id: default Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-User-Domain-Name: Default Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-User-Id: b68a401ddf04467b8f920d99aead86e3 Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: X-User-Name: tempest-TestShelveInstance-2081148350-project Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: method: > Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: exception: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: action_args: {'id': '9ab3bfef-1b92-414c-9cee-a7aa1374b1d5'} Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:11:42.955580 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: ERROR nova.api.openstack.wsgi Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Returning 404 to user: Instance 9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 could not be found. {{(pid=131229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-df05ba85-0573-4677-b19c-3f20ae4e4435 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5" status: 404 len: 111 microversion: 2.1 time: 0.038635 Jul 19 21:11:42.960966 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3604/7102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:42 2022] GET /compute/v2.1/servers/9ab3bfef-1b92-414c-9cee-a7aa1374b1d5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:11:43.146144 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-cd05ca08-73df-4860-8af6-6a852cc66aa7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '.version_select at 0x7f23ef4834c0>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:43.150648 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd05ca08-73df-4860-8af6-6a852cc66aa7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:11:44.160348 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd05ca08-73df-4860-8af6-6a852cc66aa7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55050. Jul 19 21:11:44.186716 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-cd05ca08-73df-4860-8af6-6a852cc66aa7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-27301620" status: 202 len: 0 microversion: 2.1 time: 1.045210 Jul 19 21:11:44.187275 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3499/7103] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 19 21:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-27301620 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:11:44.217162 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-10a003fe-dd67-4d2f-9387-857d292d7e2d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'create', calling method: .version_select at 0x7f23ee2b23a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-221650087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJWHQQSxBQt5dgh04r5YmUZ11np+FYo2+x0j6LKM0Om5oiptgOhpAaCG1b0/DjEDzRvLpRxgYEIg7/rrPACXnJr8TrXTp77FHVMT6eEVfecmvhCrOr25j6x5KoOH73lig=="}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:44.236037 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-10a003fe-dd67-4d2f-9387-857d292d7e2d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for project e7d53ae11da64e28ba7c85541c61142c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:11:44.244083 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-10a003fe-dd67-4d2f-9387-857d292d7e2d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for user b68a401ddf04467b8f920d99aead86e3 and project e7d53ae11da64e28ba7c85541c61142c. Resources: {'key_pairs'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:11:44.278002 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-10a003fe-dd67-4d2f-9387-857d292d7e2d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.064068 Jul 19 21:11:44.278600 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3605/7104] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:11:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:03.318344 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:03.319283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:03.324618 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1891157003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-221650087", "security_groups": [{"name": "tempest-secgroup-smoke-954267200"}], "networks": [{"uuid": "d9c60de5-4171-4943-87ed-3b22b089e8f7"}], "block_device_mapping_v2": [{"uuid": "17241e6c-a226-4d7e-9ab0-6997c473c978", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:03.463869 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.network.neutron [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] validate_networks() for [('d9c60de5-4171-4943-87ed-3b22b089e8f7', None, None, None, None, None)] {{(pid=131230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:12:03.881519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Flavor limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:12:03.882174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Image limits 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:12:03.882881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Flavor pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:12:03.883512 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Image pref 0:0:0 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:12:03.884071 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.virt.hardware [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:12:03.899825 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:03.900304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:03.901131 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:03.901613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:03.920443 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for project e7d53ae11da64e28ba7c85541c61142c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:12:03.925993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Getting quotas for user b68a401ddf04467b8f920d99aead86e3 and project e7d53ae11da64e28ba7c85541c61142c. Resources: {'instances', 'cores', 'ram'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:12:03.992592 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Going to run 1 instances... {{(pid=131230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:12:03.995566 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17241e6c-a226-4d7e-9ab0-6997c473c978',volume_size=None,volume_type=None)] {{(pid=131230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:12:04.131915 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-6ebc13e6-7599-42e8-b838-ec2e3439114a tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815260 Jul 19 21:12:04.137721 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3500/7105] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:12:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:12:04.141281 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:04.142661 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:04.143462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:04.148399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4cc0afcd-9122-45dc-b4f8-f5926c8fcc6c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:04.149028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4cc0afcd-9122-45dc-b4f8-f5926c8fcc6c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:04.211962 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4cc0afcd-9122-45dc-b4f8-f5926c8fcc6c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:04.222360 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4cc0afcd-9122-45dc-b4f8-f5926c8fcc6c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1088 microversion: 2.1 time: 0.083040 Jul 19 21:12:04.223222 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3606/7106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:04 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:05.242991 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0f8c7782-754d-47fe-86ab-cd7a87c7f9c0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:05.243637 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0f8c7782-754d-47fe-86ab-cd7a87c7f9c0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:05.300993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0f8c7782-754d-47fe-86ab-cd7a87c7f9c0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:05.309314 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0f8c7782-754d-47fe-86ab-cd7a87c7f9c0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1088 microversion: 2.1 time: 0.072977 Jul 19 21:12:05.309915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3501/7107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:05 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:06.326503 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-92d08c85-73ee-48f6-8078-25049be603f5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:06.327222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-92d08c85-73ee-48f6-8078-25049be603f5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:06.392355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-92d08c85-73ee-48f6-8078-25049be603f5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:06.399969 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-92d08c85-73ee-48f6-8078-25049be603f5 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1088 microversion: 2.1 time: 0.077601 Jul 19 21:12:06.400611 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3607/7108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:06 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:07.418288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8bbb201b-666d-4fa7-aa83-1c18c1b7cb19 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:07.418904 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8bbb201b-666d-4fa7-aa83-1c18c1b7cb19 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:07.481305 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8bbb201b-666d-4fa7-aa83-1c18c1b7cb19 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:07.492835 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8bbb201b-666d-4fa7-aa83-1c18c1b7cb19 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1088 microversion: 2.1 time: 0.079085 Jul 19 21:12:07.494068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3502/7109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:07 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:08.512729 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:08.513386 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:08.527045 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:08.527497 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:08.528325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:08.528768 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:08.596696 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:08.608721 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8be7daaf-2821-46f6-b014-aae5b05070df tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1138 microversion: 2.1 time: 0.099648 Jul 19 21:12:08.609763 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3608/7110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:08 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1138 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:09.634474 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:09.636524 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:09.653491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:09.654001 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.654752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:09.655241 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.738578 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:09.752220 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fdf4e5f8-8cda-46b7-be7d-09c761891e1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1204 microversion: 2.1 time: 0.125295 Jul 19 21:12:09.753276 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3503/7111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:09 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1204 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:10.779552 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:10.781042 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:10.793539 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.794192 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:10.795670 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.796273 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.056499 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:11.067631 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c9077e46-1fc1-4c0a-a8a5-ab68788c7ed0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1271 microversion: 2.1 time: 0.292853 Jul 19 21:12:11.068894 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3609/7112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:10 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:11.232890 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4473060b-9fc7-4de8-b378-97c20be99150 req-6ed647d1-e787-4f64-95e8-39c0a49db23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:11.249106 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4473060b-9fc7-4de8-b378-97c20be99150 req-6ed647d1-e787-4f64-95e8-39c0a49db23b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:11.249381 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4473060b-9fc7-4de8-b378-97c20be99150 req-6ed647d1-e787-4f64-95e8-39c0a49db23b service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.274271 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4473060b-9fc7-4de8-b378-97c20be99150 req-6ed647d1-e787-4f64-95e8-39c0a49db23b service nova] Creating event network-changed:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:12:11.280533 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4473060b-9fc7-4de8-b378-97c20be99150 req-6ed647d1-e787-4f64-95e8-39c0a49db23b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053030 Jul 19 21:12:11.282079 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3504/7113] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:12.101702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:12.102513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:12.112781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:12.113220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:12.114211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:12.114828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:12.347504 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:12.356714 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-577b90af-39fc-4288-9ba3-bf54df711204 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1271 microversion: 2.1 time: 0.262156 Jul 19 21:12:12.366617 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3610/7114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:12 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:13.375758 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:13.377423 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:13.384828 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:13.385487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:13.386310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:13.386814 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:13.545794 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:13.556058 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-17f1650d-fb9f-47d6-8f7d-70ea9a4ce9bf tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1271 microversion: 2.1 time: 0.184861 Jul 19 21:12:13.563088 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3505/7115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:13 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:14.578771 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:14.579589 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:14.588390 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:14.589098 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:14.589750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:14.590156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:14.755929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:14.769475 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f277ef06-33af-4163-892a-8c775ba58fed tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1271 microversion: 2.1 time: 0.199351 Jul 19 21:12:14.770188 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3611/7116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:14 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:15.790118 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:15.790715 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:15.793756 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:15.799627 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:15.800096 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:15.800898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:15.801362 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:15.954384 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:15.962466 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ae18c2cc-5c8d-4b7a-844f-304d27c2d813 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.176537 Jul 19 21:12:15.963055 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3506/7117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:15 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:16.980157 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:16.980793 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:16.983543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=4 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:16.989509 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:16.989960 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:16.990746 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:16.991209 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:17.131936 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:17.147756 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-a2315b20-4282-4038-b783-101e1d2652f3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.168378 Jul 19 21:12:17.147756 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3612/7118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:16 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:18.162523 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:18.163179 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:18.165966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=10 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:18.172584 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:18.173705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:18.173705 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:18.174520 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:18.326776 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:18.336743 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b744a4de-1420-492f-afdf-ca90dda1ef1b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.178187 Jul 19 21:12:18.337395 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3507/7119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:18 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:19.357120 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:19.358009 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:19.366887 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:19.367548 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:19.368654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:19.369473 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:19.526789 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:19.536611 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-590c20f7-3a76-4063-b5e4-11acaed9665d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.185619 Jul 19 21:12:19.537331 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3613/7120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:19 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:20.562877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:20.563544 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:20.571147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:20.571961 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:20.572765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:20.573213 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:20.711626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:20.719614 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-05713dd5-742c-4f41-b43d-01ff2e56a9a6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.160730 Jul 19 21:12:20.720243 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3508/7121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:20 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:21.742323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:21.742872 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:21.751781 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:21.752587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:21.753942 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:21.754717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:21.920822 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:21.934036 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-67b7975a-ffb4-4f2e-88ce-66f661e225f2 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.196377 Jul 19 21:12:21.935164 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3614/7122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:21 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:22.952630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:22.953292 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:22.960838 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:22.961302 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:22.962099 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:22.962549 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:23.120605 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:23.132170 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-dcd00ba2-860b-4add-b7c4-b050bbff3149 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.183402 Jul 19 21:12:23.132696 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3509/7123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:22 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:24.155587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:24.156210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:24.163999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:24.164491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:24.165411 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:24.165967 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:24.319088 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:24.327764 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fd39d5a9-456c-4965-88ad-543e4f153352 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.176876 Jul 19 21:12:24.328371 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3615/7124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:24 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:25.443487 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:25.444304 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:25.460220 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:25.460872 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:25.461502 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:25.461933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:25.533371 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-805285c7-46bc-4b09-a4e8-32f4b97eeb0d req-91967cda-42de-463e-875b-8adc44f4592a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "name": "network-vif-plugged", "status": "completed", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:25.553868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-805285c7-46bc-4b09-a4e8-32f4b97eeb0d req-91967cda-42de-463e-875b-8adc44f4592a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:25.554532 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-805285c7-46bc-4b09-a4e8-32f4b97eeb0d req-91967cda-42de-463e-875b-8adc44f4592a service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:25.572012 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-805285c7-46bc-4b09-a4e8-32f4b97eeb0d req-91967cda-42de-463e-875b-8adc44f4592a service nova] Creating event network-vif-plugged:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:12:25.581388 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-805285c7-46bc-4b09-a4e8-32f4b97eeb0d req-91967cda-42de-463e-875b-8adc44f4592a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052945 Jul 19 21:12:25.582947 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3616/7125] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:12:25.657418 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:25.668671 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d97da6ef-097e-4037-a66b-bcbbc1c4d309 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.324444 Jul 19 21:12:25.669489 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3510/7126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:25 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:26.694817 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:26.695645 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:26.702943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:26.703400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:26.704176 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:26.704602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:26.859048 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:26.867031 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2c263788-abaf-469b-89d7-4cb6e5a8885b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1259 microversion: 2.1 time: 0.177406 Jul 19 21:12:26.867713 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3617/7127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:26 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:27.884244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:27.885147 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:27.894785 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:27.895295 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:27.896058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:27.896534 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:28.048134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:28.056337 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f94cac35-3995-45a7-969d-60928886233c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1442 microversion: 2.1 time: 0.176006 Jul 19 21:12:28.056938 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3511/7128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:27 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:28.073202 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:28.073929 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:28.081468 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:28.081919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:28.082702 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:28.083163 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:28.256440 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:28.265111 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4bf5052b-ee4b-495e-86eb-0b8402bb062e tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1442 microversion: 2.1 time: 0.196306 Jul 19 21:12:28.265726 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3618/7129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:28 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1442 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:29.903384 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:12:29.904114 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:12:30.151813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-97cd27be-8068-4e98-84ce-4f47a468d95b req-db3631a1-35eb-4d1e-9c80-dcfaff909291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:30.168959 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-97cd27be-8068-4e98-84ce-4f47a468d95b req-db3631a1-35eb-4d1e-9c80-dcfaff909291 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:30.169669 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-97cd27be-8068-4e98-84ce-4f47a468d95b req-db3631a1-35eb-4d1e-9c80-dcfaff909291 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:30.189530 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-97cd27be-8068-4e98-84ce-4f47a468d95b req-db3631a1-35eb-4d1e-9c80-dcfaff909291 service nova] Creating event network-changed:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:12:30.199738 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-97cd27be-8068-4e98-84ce-4f47a468d95b req-db3631a1-35eb-4d1e-9c80-dcfaff909291 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054961 Jul 19 21:12:30.201022 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3512/7130] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:14:09.455984 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:09.456931 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:14:27.753229 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:14:27.754392 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fa8d10f-2496-44b5-b4dc-1dffee6e8c22] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:14:27.754948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=30 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:27.755719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=62 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:27.759926 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:14:27.760483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:27.767330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:27.767798 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:27.768553 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:27.768983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:27.795780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lazy-loading 'flavor' on Instance uuid a7b7b6b7-3910-4308-80c5-46c143e877bd {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:14:27.886885 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-51fc1185-2e9f-41cb-affd-2675d3c8651d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd/action" status: 202 len: 0 microversion: 2.1 time: 0.135333 Jul 19 21:14:27.887643 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3619/7131] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:14:27 2022] POST /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:14:27.896852 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 21:14:27.898767 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 21:14:27.899501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:27.900471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=54 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:27.906160 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:27.907505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:27.917577 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:27.918051 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:27.919709 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:27.920518 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:28.063917 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:28.073211 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-412b352a-c95e-43b8-a661-32b10affa5ae tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.180399 Jul 19 21:14:28.073792 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3513/7132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:27 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:29.100250 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:29.101007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:29.108577 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fa8d10f-2496-44b5-b4dc-1dffee6e8c22] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55336. Jul 19 21:14:29.110602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:29.111072 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:29.111852 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:29.112282 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:29.117108 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55334. Jul 19 21:14:29.260869 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:29.271622 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4c16a50a-8941-4dfa-8119-3274de78078b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.180890 Jul 19 21:14:29.272349 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3620/7133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:29 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:30.289781 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:30.290397 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:30.302413 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:30.302880 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:30.303676 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:30.304119 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:30.314628 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55342. Jul 19 21:14:30.315353 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55340. Jul 19 21:14:30.458349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:30.466442 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ecb8f314-f56e-4d7c-9534-fb30c01896c6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.181012 Jul 19 21:14:30.467054 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3514/7134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:30 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:31.484258 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:31.484977 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:31.498051 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:31.498479 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:31.499326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:31.499732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:31.650071 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:31.661847 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e250144-123b-4120-8846-851afe6080e0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.181203 Jul 19 21:14:31.662819 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3621/7135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:31 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:32.683968 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:32.684604 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:32.692127 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:32.692598 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:32.693403 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:32.693859 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:32.840476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:32.849456 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-22f36e3c-e59f-4004-a45e-1764e8f04cd4 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.169352 Jul 19 21:14:32.850068 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3515/7136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:32 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:33.868779 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:33.869399 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:33.876910 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:33.877362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:33.878156 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:33.878587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:34.032999 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:34.045087 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f033fca4-019f-4e0b-ab8a-bfa8d7f5b594 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.180222 Jul 19 21:14:34.051653 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3622/7137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:33 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:35.069668 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:35.070371 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:35.078458 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:35.078939 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:35.079749 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:35.080177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:35.224317 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:35.232658 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9ad00a25-2668-4b81-be47-b2e0835f1d06 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.167024 Jul 19 21:14:35.233238 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3516/7138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:35 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:36.250214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:36.250902 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:36.260319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:36.260756 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:36.261547 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:36.261978 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:36.419352 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:36.427428 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-037aa1c3-76c6-490a-afdf-ad041384bfc6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.181330 Jul 19 21:14:36.428060 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3623/7139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:36 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:37.446582 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:37.447327 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:37.454626 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:37.455128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:37.455907 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:37.456352 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:37.617083 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:37.627767 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-1648cc74-5db5-4b54-83ce-865818bb2dba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.185593 Jul 19 21:14:37.628367 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3517/7140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:37 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:38.647126 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:38.648180 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:38.657220 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:38.657993 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:38.659491 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:38.660239 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:38.943875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:38.957871 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-95bb60e9-472f-43e2-b16d-a2226333f6ba tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.315975 Jul 19 21:14:38.958892 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3624/7141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:38 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:39.978043 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:39.979541 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:39.989881 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:39.990586 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:39.992410 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:39.993088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:40.200175 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:40.209080 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-103c6f19-9a6e-4e6d-8f70-3f24825ae753 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.235077 Jul 19 21:14:40.209783 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3518/7142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:39 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:41.226983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:41.227975 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:41.239400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:41.239946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:41.240941 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:41.241298 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:41.451455 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:41.461514 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c2229e3-6196-4427-b0f0-73b6f753b951 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.239413 Jul 19 21:14:41.462292 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3625/7143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:41 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:42.479039 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:42.479852 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:42.487745 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:42.488224 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:42.489055 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:42.489509 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:42.713837 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:42.725969 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bda75732-f22e-4dbc-a0c4-2409fcd9a07b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.251251 Jul 19 21:14:42.726901 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3519/7144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:42 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:43.745856 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:43.746478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:43.754078 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.754521 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:43.755342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.755775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:43.906675 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:43.915588 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dffa2734-2d47-487a-9b35-fbf1228a3198 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1508 microversion: 2.1 time: 0.174088 Jul 19 21:14:43.916192 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3626/7145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:43 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:43.933431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:14:43.934114 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:43.941943 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.942415 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:43.943254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:43.943711 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.065398 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f75d5c05-026f-4bff-8d83-524d88ba0a84 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "POST /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd/action" status: 202 len: 0 microversion: 2.1 time: 0.135479 Jul 19 21:14:44.068891 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3520/7146] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:14:43 2022] POST /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:14:44.074943 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:44.076391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:44.083277 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:44.083732 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.084610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:44.085262 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.180037 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-73c9be64-4c79-4894-a3e6-a867b657f17b req-cfda5d36-23ef-4acc-97b7-68ab0896b451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "name": "network-vif-unplugged", "status": "completed", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:14:44.190299 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-73c9be64-4c79-4894-a3e6-a867b657f17b req-cfda5d36-23ef-4acc-97b7-68ab0896b451 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:44.191094 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-73c9be64-4c79-4894-a3e6-a867b657f17b req-cfda5d36-23ef-4acc-97b7-68ab0896b451 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:44.205087 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.compute.server_external_events [req-73c9be64-4c79-4894-a3e6-a867b657f17b req-cfda5d36-23ef-4acc-97b7-68ab0896b451 service nova] Unable to find a host for instance a7b7b6b7-3910-4308-80c5-46c143e877bd. Dropping event network-vif-unplugged {{(pid=131230) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 21:14:44.206375 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-73c9be64-4c79-4894-a3e6-a867b657f17b req-cfda5d36-23ef-4acc-97b7-68ab0896b451 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.104994 Jul 19 21:14:44.218474 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3521/7147] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 21:14:44.290382 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:44.302499 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-58c58805-2419-4d48-86f6-9f571d72d678 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1516 microversion: 2.1 time: 0.231808 Jul 19 21:14:44.303353 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3627/7148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:44 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:45.320042 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:45.320901 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:45.329036 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:45.329698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:45.330615 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:45.331193 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:45.512020 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:45.522346 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bd21d008-afaa-48a4-88e3-a0f45acc36a7 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1518 microversion: 2.1 time: 0.206176 Jul 19 21:14:45.529939 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3522/7149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:45 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:46.540982 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:46.541557 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:46.549750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:46.550222 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:46.551043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:46.551489 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:46.699828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:46.710122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-0c8dfb24-a08c-4124-aca1-d613c006d692 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1518 microversion: 2.1 time: 0.173140 Jul 19 21:14:46.710718 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3628/7150] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:46 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:47.732386 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:47.733454 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:47.745735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:47.746530 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:47.747936 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:47.748755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:47.903645 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:47.912039 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-eb52ad28-7e98-4786-bf44-58965a9f379b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1518 microversion: 2.1 time: 0.187119 Jul 19 21:14:47.912676 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3523/7151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:47 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:48.930129 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:48.931454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:48.940027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:48.940448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:48.941261 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:48.941676 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:49.109739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:49.118558 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5adcf0e5-c233-4c04-a1d4-2b718d445b80 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1518 microversion: 2.1 time: 0.192276 Jul 19 21:14:49.119848 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3629/7152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:48 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:50.138210 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:50.138822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:50.146420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:50.146877 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:50.147689 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:50.148134 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:50.325207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:50.333640 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5156f6bd-7806-4243-bb17-f336da5ea9a3 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.199362 Jul 19 21:14:50.334255 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3524/7153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:50 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:51.351777 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:51.352441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:51.360669 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:51.361475 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:51.362421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:51.363205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:51.510097 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:51.518302 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-12f572ef-ec3e-4466-a26e-6fd781f729e9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.170938 Jul 19 21:14:51.518894 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3630/7154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:51 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:52.536630 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:52.537283 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:52.545453 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:52.545923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:52.546748 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:52.547244 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:52.716199 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:52.724900 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0aeb0230-aae5-4666-b813-c8692dd9afa6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.192570 Jul 19 21:14:52.725562 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3525/7155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:52 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:53.742194 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:53.742841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:53.750289 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:53.750846 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:53.751693 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:53.752301 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:53.923043 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:53.933435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f5246e5d-d49f-484b-99be-1ffbbef209c9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.195518 Jul 19 21:14:53.934091 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3631/7156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:53 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:54.953447 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:54.953998 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:54.962281 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:54.962753 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:54.963805 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:54.964336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:55.133535 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:55.144323 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d389c97e-b8ee-433d-8d1c-0df05374b12f tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.194929 Jul 19 21:14:55.144915 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3526/7157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:54 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:56.165155 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:56.166080 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:56.177541 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:56.178074 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:56.179223 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:56.179752 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:56.342974 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:56.355911 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f81b8703-ec14-48fd-b380-9b226fbba7b0 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.196720 Jul 19 21:14:56.357332 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3632/7158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:56 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:57.375400 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:57.376300 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:57.384963 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:57.385441 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:57.386245 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:57.386698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:57.540681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:57.549501 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-8c282957-4541-4962-b1c3-dcdac1be2f67 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.178316 Jul 19 21:14:57.550120 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3527/7159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:57 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:58.568069 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:58.568790 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:58.572102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=29 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:58.578342 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:58.578795 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:58.579766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:58.580410 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:58.583797 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:58.748766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:58.758483 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b3989bc9-0d99-43db-b9bf-3098c2872577 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.194786 Jul 19 21:14:58.759121 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3633/7160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:58 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:14:59.776823 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:14:59.777483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:14:59.780455 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=33 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:59.789231 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:59.790505 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:59.791424 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:14:59.791878 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:14:59.795822 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:14:59.959416 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:14:59.972064 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d92ecdcf-e2e6-4bb0-b4fd-8c1734e1db48 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.198929 Jul 19 21:14:59.973139 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3528/7161] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:14:59 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:00.991587 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:00.992206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:00.999029 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:00.999482 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:01.000347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:01.000784 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:01.156923 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:01.165184 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-948de695-5597-4aed-9f25-5aa5491b6f9d tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.177953 Jul 19 21:15:01.165796 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3634/7162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:00 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:02.183660 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:02.184360 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:02.191041 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.191513 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.192328 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.192777 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.281698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-67da425b-d037-4c9f-8ebf-5d45bb322951 req-dbb1e35c-b69d-4a5e-85a1-4879872c9beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "name": "network-vif-plugged", "status": "completed", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:02.297458 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-67da425b-d037-4c9f-8ebf-5d45bb322951 req-dbb1e35c-b69d-4a5e-85a1-4879872c9beb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:02.298185 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-67da425b-d037-4c9f-8ebf-5d45bb322951 req-dbb1e35c-b69d-4a5e-85a1-4879872c9beb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:02.318145 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-67da425b-d037-4c9f-8ebf-5d45bb322951 req-dbb1e35c-b69d-4a5e-85a1-4879872c9beb service nova] Creating event network-vif-plugged:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:15:02.325090 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-67da425b-d037-4c9f-8ebf-5d45bb322951 req-dbb1e35c-b69d-4a5e-85a1-4879872c9beb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048172 Jul 19 21:15:02.327986 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3635/7163] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:02.370229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:02.387917 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b54307ce-3dd3-4048-b587-deb75262b163 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.208100 Jul 19 21:15:02.389253 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3529/7164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:02 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:03.410945 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:03.411653 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:03.419226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:03.419717 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:03.420513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:03.421638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:03.610638 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:03.624122 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3ea359a8-0f82-48c9-b8c7-3c1793abbf05 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1574 microversion: 2.1 time: 0.218011 Jul 19 21:15:03.625295 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3636/7165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:03 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:04.648762 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:04.649437 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:04.658504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:04.659180 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:04.660174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:04.660720 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:04.808212 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:04.816823 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f867153c-69d3-4b80-ae3a-4016c242ec15 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1561 microversion: 2.1 time: 0.172970 Jul 19 21:15:04.817463 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3530/7166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:04 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:49.912957 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:15:49.913622 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:16:21.677297 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=7 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:21.678689 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=19 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:21.684174 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=5 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:21.684739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:21.686260 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:21.686476 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=17 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:21.694214 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:21.694667 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:21.695712 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:21.698007 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:21.728174 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:16:21.761471 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-dfdc152b-7bae-4f5a-a79d-04330e3c9af3 req-9e137bdf-f854-4e3d-99a3-ec3aef86ef2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:21.774057 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dfdc152b-7bae-4f5a-a79d-04330e3c9af3 req-9e137bdf-f854-4e3d-99a3-ec3aef86ef2e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:21.774729 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-dfdc152b-7bae-4f5a-a79d-04330e3c9af3 req-9e137bdf-f854-4e3d-99a3-ec3aef86ef2e service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:21.792360 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-dfdc152b-7bae-4f5a-a79d-04330e3c9af3 req-9e137bdf-f854-4e3d-99a3-ec3aef86ef2e service nova] Creating event network-changed:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:16:21.800276 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-dfdc152b-7bae-4f5a-a79d-04330e3c9af3 req-9e137bdf-f854-4e3d-99a3-ec3aef86ef2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122969 Jul 19 21:16:21.801523 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3531/7167] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:21.839365 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-aa375796-234c-4031-96af-3288529d14b6 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 204 len: 0 microversion: 2.1 time: 0.163505 Jul 19 21:16:21.840978 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3637/7168] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:16:21 2022] DELETE /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:16:21.853445 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:21.855084 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:21.863390 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:21.863933 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:21.865056 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:21.865616 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:22.031116 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:22.041253 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ce66e94e-fcbf-4696-a904-8c33bd6d6944 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.194289 Jul 19 21:16:22.042041 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3532/7169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:21 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:23.061830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:23.062719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:23.070519 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:23.071008 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:23.072113 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:23.072555 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:23.229621 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:23.237786 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c4c0ae4e-082d-4903-93e9-c87372126f2c tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1567 microversion: 2.1 time: 0.180308 Jul 19 21:16:23.238416 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3638/7170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:23 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:23.908736 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-ba6b68f2-e7b4-49ef-8727-ff4785d935d7 req-118e5776-e7d1-4eeb-ac1d-36bb0786058c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b7b6b7-3910-4308-80c5-46c143e877bd", "name": "network-vif-deleted", "tag": "81c154cf-56ee-479f-b109-f3d1e9b687e8"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:23.919868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ba6b68f2-e7b4-49ef-8727-ff4785d935d7 req-118e5776-e7d1-4eeb-ac1d-36bb0786058c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:23.920334 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-ba6b68f2-e7b4-49ef-8727-ff4785d935d7 req-118e5776-e7d1-4eeb-ac1d-36bb0786058c service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:23.933456 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-ba6b68f2-e7b4-49ef-8727-ff4785d935d7 req-118e5776-e7d1-4eeb-ac1d-36bb0786058c service nova] Creating event network-vif-deleted:81c154cf-56ee-479f-b109-f3d1e9b687e8 for instance a7b7b6b7-3910-4308-80c5-46c143e877bd on n-h1-843834-3 Jul 19 21:16:23.940907 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-ba6b68f2-e7b4-49ef-8727-ff4785d935d7 req-118e5776-e7d1-4eeb-ac1d-36bb0786058c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038800 Jul 19 21:16:23.941633 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3533/7171] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:24.260122 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:24.261612 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:24.274596 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:24.275527 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:24.276698 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:24.277478 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:24.371172 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:24.380259 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e3ffba00-3f04-4fa9-a1c3-c61f240b3250 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1219 microversion: 2.1 time: 0.127663 Jul 19 21:16:24.391666 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3639/7172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:24 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:25.403935 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:25.405501 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:25.419803 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:25.420666 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:25.422202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:25.423153 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:25.523538 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:25.539098 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-2118d1fc-ba29-45cf-8fe2-76a978633a82 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1219 microversion: 2.1 time: 0.142608 Jul 19 21:16:25.540632 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3534/7173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:25 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:26.565883 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:26.566542 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:26.575272 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:26.575805 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:26.576583 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:26.577022 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:26.647780 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:26.657111 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48425b69-93dd-4b98-8a17-aa4356491340 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1219 microversion: 2.1 time: 0.096165 Jul 19 21:16:26.659506 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3640/7174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:26 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:27.674053 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:27.674728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:27.682430 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:27.682898 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:27.683721 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:27.684161 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:27.761765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:27.770491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b42d9eb7-987d-4414-aaec-5f2897b0194b tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1219 microversion: 2.1 time: 0.100366 Jul 19 21:16:27.771426 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3535/7175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:27 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:28.788365 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:28.789335 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:28.799197 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:28.799932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:28.801186 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:28.801931 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:28.852921 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:28.853647 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:28.854347 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lazy-loading 'fault' on Instance uuid a7b7b6b7-3910-4308-80c5-46c143e877bd {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:16:28.915218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a401ddf04467b8f920d99aead86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d53ae11da64e28ba7c85541c61142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:28.928907 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-793fc035-05e5-4d99-bf74-1aecc7873497 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 200 len: 1224 microversion: 2.1 time: 0.144067 Jul 19 21:16:28.930199 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3641/7176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:28 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:29.948797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:29.949687 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] [instance: a7b7b6b7-3910-4308-80c5-46c143e877bd] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:29.959048 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:29.959521 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:29.960348 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:29.960800 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:29.980085 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] HTTP exception thrown: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Request method failure captured: Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd HTTP/1.1 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1x0FjgGEjgTU6FegSQAcV9iXu8awQcyvnl72etNQfcEHW6btxLRPG1fyWAw5skmZgET73tnfpYM678ur0xRtDwsc6ZK7I2HgDQggD8_tQwgXZRQe2902i7fbIWIZc7KlMh7z8xdOD-_qpWnbVSbhMXZyYucdecXsp5i01XRroTI5C7o Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: e7d53ae11da64e28ba7c85541c61142c Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestShelveInstance-2081148350 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d53ae11da64e28ba7c85541c61142c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestShelveInstance-2081148350 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: e7d53ae11da64e28ba7c85541c61142c Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestShelveInstance-2081148350 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestShelveInstance-2081148350-project Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: b68a401ddf04467b8f920d99aead86e3 Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestShelveInstance-2081148350-project Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': 'a7b7b6b7-3910-4308-80c5-46c143e877bd'} Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:16:29.981893 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Returning 404 to user: Instance a7b7b6b7-3910-4308-80c5-46c143e877bd could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:16:29.987152 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-fb0a21a6-7822-44df-aea7-6feca871cabc tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd" status: 404 len: 111 microversion: 2.1 time: 0.039690 Jul 19 21:16:29.990837 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3536/7177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:29 2022] GET /compute/v2.1/servers/a7b7b6b7-3910-4308-80c5-46c143e877bd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:16:30.192363 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-d6e0a8d5-bf88-4fa2-9d39-4c8a914e53b9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] Calling method '.version_select at 0x7f23ee30be50>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:30.224418 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-d6e0a8d5-bf88-4fa2-9d39-4c8a914e53b9 tempest-TestShelveInstance-2081148350 tempest-TestShelveInstance-2081148350-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-221650087" status: 202 len: 0 microversion: 2.1 time: 0.036128 Jul 19 21:16:30.225719 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3642/7178] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jul 19 21:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-221650087 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:16:51.819831 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=12 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:51.821865 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=24 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:52.059519 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Action: 'create', calling method: .version_select at 0x7f23efb92430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-426902291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrqCOrwoKlKKrmNM+yqbSBIUSC1RrV828y3/yrv2Kk58cFLac0rKRkDQ1Za8V8uuTeTyt5Ui5dS54oCNtMnfe12CpomaMVNXZl51QTHTwOws9Db/P3uONq6TMVHWyreuA=="}} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:52.076254 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:16:52.084278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.quota [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for user 3806a525d27245f696ddfdfa16319452 and project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'key_pairs'} {{(pid=131230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:16:52.099015 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:16:53.107189 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [6c6b135b-7377-4dd1-a683-1d43070fccb2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55588. Jul 19 21:16:53.126750 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9e3e666f-082a-493f-a1af-6de65288d9e9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.312490 Jul 19 21:16:53.132784 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3537/7179] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 19 21:16:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:54.414102 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-578248140", "imageRef": "371de3c2-13a8-4290-a544-705d4d9b3f29", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-426902291", "security_groups": [{"name": "tempest-secgroup-smoke-241120026"}], "networks": [{"uuid": "41fbf8d7-1f8d-4146-8754-a415ee98cef0"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:54.434409 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:54.435462 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:16:54.599485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] validate_networks() for [('41fbf8d7-1f8d-4146-8754-a415ee98cef0', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:16:55.150819 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:16:55.151743 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:16:55.152318 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:16:55.152892 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:16:55.153330 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:16:55.165922 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:55.166384 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:55.167227 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:55.167671 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:55.185837 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:16:55.191992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for user 3806a525d27245f696ddfdfa16319452 and project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:16:55.207226 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:16:55.209559 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='371de3c2-13a8-4290-a544-705d4d9b3f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:16:55.260453 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fb6b96ec-8cc5-4e19-8b8d-69ca0f56f882 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.865321 Jul 19 21:16:55.261088 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3643/7180] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:16:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:16:55.272735 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-87559e97-4c43-43ee-8133-358695f2a530 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:55.274428 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-87559e97-4c43-43ee-8133-358695f2a530 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:55.337088 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-87559e97-4c43-43ee-8133-358695f2a530 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:55.345426 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-87559e97-4c43-43ee-8133-358695f2a530 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1247 microversion: 2.1 time: 0.077971 Jul 19 21:16:55.346051 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3538/7181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:55 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:56.373320 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:56.374168 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:56.385448 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:56.385946 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:56.386850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:56.387328 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:56.467868 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:56.477618 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-3f631241-5ac8-4f2e-bd75-6e5e1ea9476e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1317 microversion: 2.1 time: 0.117268 Jul 19 21:16:56.478489 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3644/7182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:56 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1317 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:57.499883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:57.500765 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:57.508253 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:57.508728 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:57.510164 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:57.510642 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:57.668005 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:57.675976 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ea183fa4-0da4-4e30-bbea-69efca2826f7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.182250 Jul 19 21:16:57.676927 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3539/7183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:57 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:57.806599 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-3c6dcaf0-6de7-492c-9ce1-13a60c25abad req-9eb11bc1-1eec-4d5c-ab63-5e75c3d85f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:16:57.826421 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3c6dcaf0-6de7-492c-9ce1-13a60c25abad req-9eb11bc1-1eec-4d5c-ab63-5e75c3d85f91 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:57.831188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-3c6dcaf0-6de7-492c-9ce1-13a60c25abad req-9eb11bc1-1eec-4d5c-ab63-5e75c3d85f91 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:57.848170 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-3c6dcaf0-6de7-492c-9ce1-13a60c25abad req-9eb11bc1-1eec-4d5c-ab63-5e75c3d85f91 service nova] Creating event network-changed:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:16:57.853745 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-3c6dcaf0-6de7-492c-9ce1-13a60c25abad req-9eb11bc1-1eec-4d5c-ab63-5e75c3d85f91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057980 Jul 19 21:16:57.854345 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3645/7184] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:58.694016 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:58.694817 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:58.702640 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.703148 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.703965 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:58.704417 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:58.858349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:16:58.866488 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0a4cc5d1-d297-404a-8b46-6ae0eb0a1a49 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.176841 Jul 19 21:16:58.867158 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3540/7185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:58 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:16:59.894891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:16:59.896240 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:16:59.904424 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:59.904906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:16:59.905733 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:16:59.906211 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:00.066842 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:00.075894 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-03edeb9b-6493-42a0-85ad-ffb28786f08f tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.186767 Jul 19 21:17:00.076424 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3646/7186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:16:59 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:01.092752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:01.093351 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:01.100465 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:01.100940 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:01.101731 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:01.102173 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:01.244060 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:01.252280 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9bac5afb-e8b0-4a34-a3cf-514527e5cad7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.163777 Jul 19 21:17:01.252876 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3541/7187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:01 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:17:02.270077 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:02.270737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:02.278610 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:02.279188 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:02.280028 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:02.280595 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:02.421971 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:02.430015 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-00c8ed5e-457e-45bc-a6e0-0f4621462c28 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.164177 Jul 19 21:17:02.430619 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3647/7188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:02 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:02.760754 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-d2b95766-e713-44d4-bb2e-6ba844def720 req-923c3578-d6bb-4534-b46c-c326b5d50193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "name": "network-vif-plugged", "status": "completed", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:02.774128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d2b95766-e713-44d4-bb2e-6ba844def720 req-923c3578-d6bb-4534-b46c-c326b5d50193 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:02.774607 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-d2b95766-e713-44d4-bb2e-6ba844def720 req-923c3578-d6bb-4534-b46c-c326b5d50193 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:02.788733 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-d2b95766-e713-44d4-bb2e-6ba844def720 req-923c3578-d6bb-4534-b46c-c326b5d50193 service nova] Creating event network-vif-plugged:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:17:02.794221 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-d2b95766-e713-44d4-bb2e-6ba844def720 req-923c3578-d6bb-4534-b46c-c326b5d50193 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037689 Jul 19 21:17:02.794818 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3542/7189] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:03.448853 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:03.449841 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:03.459963 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:03.460681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:03.461492 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:03.461937 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:03.624435 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:03.634765 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8863300d-2e9d-4c96-99e6-cb00268f6c6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1372 microversion: 2.1 time: 0.190391 Jul 19 21:17:03.635407 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3648/7190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:03 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:04.659035 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:04.659966 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:04.666985 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:04.667461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:04.668268 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:04.668759 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:04.840491 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:04.849544 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-754210ad-b3fb-4b7f-93ae-10e3ef0dcd16 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1557 microversion: 2.1 time: 0.199198 Jul 19 21:17:04.850152 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3543/7191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:04 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1557 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:04.869791 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:17:04.870891 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:17:04.884513 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:04.885376 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:04.886739 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:04.887581 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:05.175757 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:05.200360 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:05.365125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:17:05.373435 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-5c0ccdcf-35a5-49fe-9c0a-ee7cbd2f2fdc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1557 microversion: 2.1 time: 0.510987 Jul 19 21:17:05.374095 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3649/7192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:17:04 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1557 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:17:07.251336 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=6 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:17:07.312613 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-52a2befc-11a9-4364-b8dc-3057b6313baf req-bd1306c6-6474-45bc-9a75-48c297358ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:17:07.321916 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-52a2befc-11a9-4364-b8dc-3057b6313baf req-bd1306c6-6474-45bc-9a75-48c297358ebd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:17:07.322250 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-52a2befc-11a9-4364-b8dc-3057b6313baf req-bd1306c6-6474-45bc-9a75-48c297358ebd service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:17:07.335333 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-52a2befc-11a9-4364-b8dc-3057b6313baf req-bd1306c6-6474-45bc-9a75-48c297358ebd service nova] Creating event network-changed:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:17:07.341344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-52a2befc-11a9-4364-b8dc-3057b6313baf req-bd1306c6-6474-45bc-9a75-48c297358ebd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095018 Jul 19 21:17:07.342266 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3544/7193] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:17:29.348781 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:29.349507 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:19:02.137423 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:19:02.138301 n-d-843834-3 devstack@n-api.service[131229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fa8d10f-2496-44b5-b4dc-1dffee6e8c22] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:19:02.138745 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:02.139775 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=34 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:02.143681 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1883719068"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:02.144719 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:02.152064 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:02.152517 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:02.153296 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:02.153734 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:02.475197 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-1aa13c4c-0f86-4349-aa2e-0c2f80c12fe7 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "POST /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7/action" status: 202 len: 0 microversion: 2.1 time: 0.339389 Jul 19 21:19:02.475751 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3650/7194] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:19:02 2022] POST /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 21:19:07.388523 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:19:07.390082 n-d-843834-3 devstack@n-api.service[131230]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:19:07.390982 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:07.392710 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=28 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:07.399058 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-a5fc3727-5607-40e6-838e-8d9ea1dccb55 req-d8593463-0d91-4f14-97dd-6041b0e30ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "name": "network-vif-plugged", "status": "completed", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:07.410104 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a5fc3727-5607-40e6-838e-8d9ea1dccb55 req-d8593463-0d91-4f14-97dd-6041b0e30ceb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:07.410945 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-a5fc3727-5607-40e6-838e-8d9ea1dccb55 req-d8593463-0d91-4f14-97dd-6041b0e30ceb service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:07.426344 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-a5fc3727-5607-40e6-838e-8d9ea1dccb55 req-d8593463-0d91-4f14-97dd-6041b0e30ceb service nova] Creating event network-vif-plugged:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:19:07.432785 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-a5fc3727-5607-40e6-838e-8d9ea1dccb55 req-d8593463-0d91-4f14-97dd-6041b0e30ceb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046029 Jul 19 21:19:07.433937 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3545/7195] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:19:09.469219 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 19 21:19:09.469920 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:19:16.069206 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:16.070010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:16.074948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-521054294", "imageRef": "7889aeb8-5767-4a21-adac-4b68929db1fd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-426902291", "security_groups": [{"name": "tempest-secgroup-smoke-241120026"}], "networks": [{"uuid": "41fbf8d7-1f8d-4146-8754-a415ee98cef0"}]}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:16.102097 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fa8d10f-2496-44b5-b4dc-1dffee6e8c22] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55844. Jul 19 21:19:16.103076 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaf88cc8-fe3d-4741-a2bd-b6888e7fb897] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55842. Jul 19 21:19:16.214198 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.network.neutron [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] validate_networks() for [('41fbf8d7-1f8d-4146-8754-a415ee98cef0', None, None, None, None, None)] {{(pid=131229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:19:16.633359 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Flavor limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:19:16.633843 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Image limits 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:19:16.634325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Flavor pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:19:16.634737 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Image pref 0:0:0 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:19:16.635184 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.virt.hardware [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:19:16.645664 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:16.646118 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:16.646948 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:16.647395 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:16.665815 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:19:16.676778 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.quota [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Getting quotas for user 3806a525d27245f696ddfdfa16319452 and project b9675e0b1bb440e1bc1681e5d4ebfe37. Resources: {'instances', 'cores', 'ram'} {{(pid=131229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:19:16.689911 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Going to run 1 instances... {{(pid=131229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:19:16.692441 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7889aeb8-5767-4a21-adac-4b68929db1fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:19:16.750093 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-99ac1cba-02f3-4edf-88c1-92f3ddc96bfc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.683782 Jul 19 21:19:16.750766 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3651/7196] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 19 21:19:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:19:16.765350 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-d9a50128-06c5-4958-8f51-856132f2cee9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:16.766098 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-d9a50128-06c5-4958-8f51-856132f2cee9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:16.784208 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [28833dfa-a1a5-4dd7-8ebe-077255eb75a6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55860. Jul 19 21:19:16.787616 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bae676f-55cc-40f5-ae23-6c803cab0333] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55858. Jul 19 21:19:16.837797 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-d9a50128-06c5-4958-8f51-856132f2cee9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:16.849262 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-d9a50128-06c5-4958-8f51-856132f2cee9 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1247 microversion: 2.1 time: 0.091887 Jul 19 21:19:16.849859 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3546/7197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:16 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:17.868543 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:17.869520 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:17.877459 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:17.878027 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:17.878885 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:17.879611 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:17.989362 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:17.998498 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c30fc470-3853-462e-a756-f71d4e69ba18 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1307 microversion: 2.1 time: 0.135124 Jul 19 21:19:18.009602 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3652/7198] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:17 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:19.020269 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:19.020987 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:19.023256 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:19.030799 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:19.031564 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:19.032236 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:19.032681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:19.242229 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:19.251649 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-ccc8d6a2-6984-4550-8b7a-d088b10c9a65 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.237120 Jul 19 21:19:19.252459 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3547/7199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:19 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:19.431774 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-acab37af-5838-423f-a8ba-da9045c19a8c req-6b5790d6-4a8e-4a9a-95a8-5abd5b443ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:19.442334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-acab37af-5838-423f-a8ba-da9045c19a8c req-6b5790d6-4a8e-4a9a-95a8-5abd5b443ad5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:19.442899 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-acab37af-5838-423f-a8ba-da9045c19a8c req-6b5790d6-4a8e-4a9a-95a8-5abd5b443ad5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:19.455688 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-acab37af-5838-423f-a8ba-da9045c19a8c req-6b5790d6-4a8e-4a9a-95a8-5abd5b443ad5 service nova] Creating event network-vif-unplugged:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:19:19.461522 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-acab37af-5838-423f-a8ba-da9045c19a8c req-6b5790d6-4a8e-4a9a-95a8-5abd5b443ad5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034070 Jul 19 21:19:19.462370 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3653/7200] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:19:20.270177 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:20.270816 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:20.283128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:20.283680 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:20.284673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:20.285484 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:20.449207 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:20.457402 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b9a3a364-227f-4899-8106-8195a4005893 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.191506 Jul 19 21:19:20.458007 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3548/7201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:20 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:21.479619 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:21.480803 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:21.491906 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:21.492648 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:21.494035 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:21.494651 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:21.675682 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:21.686733 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-def02f34-367d-4ecc-bc70-ba13936ecb1d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.215933 Jul 19 21:19:21.687401 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3654/7202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:21 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:22.707504 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:22.708321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:22.716149 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:22.716921 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:22.717742 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:22.718186 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:22.867639 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:22.876342 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-a0833247-08b3-4b5c-aece-bca5165c4a70 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.173112 Jul 19 21:19:22.885742 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3549/7203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:22 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:23.895167 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:23.896592 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:23.904751 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:23.905450 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:23.906312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:23.906827 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:24.076052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:24.084059 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-cec57a19-d8dd-4cc4-ba7d-e02746f17f4c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.194980 Jul 19 21:19:24.084960 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3655/7204] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:23 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:25.108298 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:25.111128 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:25.125681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:25.128239 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:25.129962 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:25.131190 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:25.349685 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:25.365020 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-7706d40e-e56f-4b4b-ab77-5a101655d359 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.265603 Jul 19 21:19:25.366262 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3550/7205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:25 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:19:26.390366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:26.391010 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:26.398992 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:26.399355 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:26.400370 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:26.400828 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:26.587391 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:26.599030 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-e60bb920-edaa-4060-8619-28156729ce1c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.212684 Jul 19 21:19:26.599675 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3656/7206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:26 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:27.622507 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:27.623394 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:27.627439 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell0:SELECT=2 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:27.633031 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:27.633499 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:27.634321 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:27.634789 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:27.928833 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:27.944936 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-9756d853-3f78-432d-96e7-a29cf4c42acc tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.331147 Jul 19 21:19:27.947112 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3551/7207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:27 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:28.204125 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [req-be35e7b1-44db-428e-8904-eba4030fbea0 req-cffdc594-d1e4-49bf-9150-4e6d1b387ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:28.217859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:28.218862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell0:SELECT=6 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:19:28.223218 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-be35e7b1-44db-428e-8904-eba4030fbea0 req-cffdc594-d1e4-49bf-9150-4e6d1b387ab1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:28.224030 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [req-be35e7b1-44db-428e-8904-eba4030fbea0 req-cffdc594-d1e4-49bf-9150-4e6d1b387ab1 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:28.250615 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.compute.server_external_events [req-be35e7b1-44db-428e-8904-eba4030fbea0 req-cffdc594-d1e4-49bf-9150-4e6d1b387ab1 service nova] Creating event network-changed:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:19:28.256602 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [req-be35e7b1-44db-428e-8904-eba4030fbea0 req-cffdc594-d1e4-49bf-9150-4e6d1b387ab1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057179 Jul 19 21:19:28.257596 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3657/7208] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:19:28.964138 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:28.964813 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:28.972092 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:28.972539 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:28.973324 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:28.973773 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:29.123214 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:29.131053 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-b8cfeb36-71d4-4763-a4cc-7181e2338754 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.170886 Jul 19 21:19:29.131664 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3552/7209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:28 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:30.151065 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:30.151830 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:30.158983 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:30.159300 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:30.160219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:30.160660 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:30.341111 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:30.349142 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f4f1f5ec-8546-4005-9f15-2c3021931d15 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.203326 Jul 19 21:19:30.349725 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3658/7210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:30 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:31.367349 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:31.368698 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:31.376340 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:31.376866 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:31.377663 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:31.378123 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:31.567314 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:31.582060 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e25d4ec0-68e3-4e94-9c95-10757b53422c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.219315 Jul 19 21:19:31.583066 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3553/7211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:31 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:32.604594 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:32.605334 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:32.612623 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:32.613091 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:32.613859 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:32.614294 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:32.763324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:32.771280 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-b2e8e5c1-850a-4d79-9476-1e74a6daec88 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.172454 Jul 19 21:19:32.771884 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3659/7212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:32 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:33.113282 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-2e26cd0b-db72-4fda-9b12-94e846a4c08c req-6f4625fa-da33-4b44-851b-0e7cb3154895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "name": "network-vif-plugged", "status": "completed", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:33.124915 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e26cd0b-db72-4fda-9b12-94e846a4c08c req-6f4625fa-da33-4b44-851b-0e7cb3154895 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:33.125377 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-2e26cd0b-db72-4fda-9b12-94e846a4c08c req-6f4625fa-da33-4b44-851b-0e7cb3154895 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:33.143892 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-2e26cd0b-db72-4fda-9b12-94e846a4c08c req-6f4625fa-da33-4b44-851b-0e7cb3154895 service nova] Creating event network-vif-plugged:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:19:33.149229 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-2e26cd0b-db72-4fda-9b12-94e846a4c08c req-6f4625fa-da33-4b44-851b-0e7cb3154895 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040645 Jul 19 21:19:33.150037 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3554/7213] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:19:33.793351 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:33.793981 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:33.801476 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:33.801934 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:33.802718 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:33.803195 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:33.966471 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:33.979909 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-f7169f6b-1d64-4598-a222-c5ee7d6ee6c4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1372 microversion: 2.1 time: 0.190201 Jul 19 21:19:33.980547 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3660/7214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:33 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:35.006956 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:35.007667 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:35.015431 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:35.015923 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:35.016752 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:35.017402 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:35.161850 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:35.171278 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-bfb204e8-f11e-4d0a-8e77-36fa7841b615 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1558 microversion: 2.1 time: 0.168935 Jul 19 21:19:35.171987 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3555/7215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:35 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:35.187820 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:19:35.188428 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:19:35.195699 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:35.196515 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:35.197311 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:35.197750 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:35.343700 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:19:35.351752 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-043eb17a-f7c7-4621-b949-2ae39e329c0d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1558 microversion: 2.1 time: 0.167917 Jul 19 21:19:35.352320 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3661/7216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:19:35 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:37.109265 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-891886f1-f7c8-4dce-a169-a28c12dc37b1 req-ccaec857-362c-43b8-ac6e-dcbbdfafb176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:19:37.119771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-891886f1-f7c8-4dce-a169-a28c12dc37b1 req-ccaec857-362c-43b8-ac6e-dcbbdfafb176 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:19:37.119771 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-891886f1-f7c8-4dce-a169-a28c12dc37b1 req-ccaec857-362c-43b8-ac6e-dcbbdfafb176 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:19:37.134963 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-891886f1-f7c8-4dce-a169-a28c12dc37b1 req-ccaec857-362c-43b8-ac6e-dcbbdfafb176 service nova] Creating event network-changed:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:19:37.140542 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-891886f1-f7c8-4dce-a169-a28c12dc37b1 req-ccaec857-362c-43b8-ac6e-dcbbdfafb176 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035127 Jul 19 21:19:37.141124 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3556/7217] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:20:49.357706 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:20:49.358523 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:21:05.260056 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:05.261015 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=54 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:05.265319 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1462218548"}} {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:05.266361 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:05.274205 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:05.274654 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:05.275485 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:05.275919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:05.808755 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-dfb939f5-9d5a-41f4-99cb-63d11cdc1f3c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "POST /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d/action" status: 202 len: 0 microversion: 2.1 time: 0.551849 Jul 19 21:21:05.810045 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3662/7218] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 19 21:21:05 2022] POST /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 21:21:11.639896 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_api:SELECT=26 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:11.642372 n-d-843834-3 devstack@n-api.service[131230]: DEBUG dbcounter [-] [131230] Writing DB stats nova_cell1:SELECT=52 {{(pid=131230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:11.726900 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-e7b8a49d-11e4-41e9-a7a0-af8c4be9aca8 req-059ffe9f-3db5-48fe-8b31-594049baff92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "name": "network-vif-plugged", "status": "completed", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:11.740912 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e7b8a49d-11e4-41e9-a7a0-af8c4be9aca8 req-059ffe9f-3db5-48fe-8b31-594049baff92 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:11.741464 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-e7b8a49d-11e4-41e9-a7a0-af8c4be9aca8 req-059ffe9f-3db5-48fe-8b31-594049baff92 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:11.753556 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-e7b8a49d-11e4-41e9-a7a0-af8c4be9aca8 req-059ffe9f-3db5-48fe-8b31-594049baff92 service nova] Creating event network-vif-plugged:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:21:11.767100 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-e7b8a49d-11e4-41e9-a7a0-af8c4be9aca8 req-059ffe9f-3db5-48fe-8b31-594049baff92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130129 Jul 19 21:21:11.768646 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3557/7219] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:19.666449 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_api:SELECT=2 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:19.667366 n-d-843834-3 devstack@n-api.service[131229]: DEBUG dbcounter [-] [131229] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:21:19.672324 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:19.673274 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-b1c6587c-0c84-4b89-a17c-05de335807e1 req-22427451-b8ac-4b4b-bd4f-889982aae258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:19.673875 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:19.683278 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b1c6587c-0c84-4b89-a17c-05de335807e1 req-22427451-b8ac-4b4b-bd4f-889982aae258 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:19.683847 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-b1c6587c-0c84-4b89-a17c-05de335807e1 req-22427451-b8ac-4b4b-bd4f-889982aae258 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:19.687439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:19.688327 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:19.689782 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:19.690862 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:19.702239 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-b1c6587c-0c84-4b89-a17c-05de335807e1 req-22427451-b8ac-4b4b-bd4f-889982aae258 service nova] Creating event network-changed:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:21:19.709052 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-b1c6587c-0c84-4b89-a17c-05de335807e1 req-22427451-b8ac-4b4b-bd4f-889982aae258 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042463 Jul 19 21:21:19.710034 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3558/7220] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:19.742285 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:21:19.871528 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-48a85d94-8a71-4c1e-bf4e-b99258d83f6e tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 204 len: 0 microversion: 2.1 time: 0.206292 Jul 19 21:21:19.873936 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3663/7221] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:21:19 2022] DELETE /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:21:19.885492 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:19.887288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:19.899483 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:19.899988 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:19.901027 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:19.901461 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:20.107202 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:20.115984 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-e3e993b4-25b0-42ee-bc69-24ec8ed357e4 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1683 microversion: 2.1 time: 0.236094 Jul 19 21:21:20.116833 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3559/7222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:19 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:21.136089 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:21.137041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:21.144919 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:21.145408 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:21.146454 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:21.146901 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:21.332210 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:21.342191 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-8e9365d0-9268-453b-be2b-85568fe98cb8 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1683 microversion: 2.1 time: 0.210371 Jul 19 21:21:21.342779 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3664/7223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:21 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:22.069489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-99bf22d3-8053-4485-a1f5-9acd8fa22f8a req-7676b007-c978-47b3-a072-a97e9b20f138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d", "name": "network-vif-deleted", "tag": "83c9ec8c-f72b-4488-b767-505be0c967b2"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:22.079653 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-99bf22d3-8053-4485-a1f5-9acd8fa22f8a req-7676b007-c978-47b3-a072-a97e9b20f138 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:22.080273 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-99bf22d3-8053-4485-a1f5-9acd8fa22f8a req-7676b007-c978-47b3-a072-a97e9b20f138 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:22.095309 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-99bf22d3-8053-4485-a1f5-9acd8fa22f8a req-7676b007-c978-47b3-a072-a97e9b20f138 service nova] Creating event network-vif-deleted:83c9ec8c-f72b-4488-b767-505be0c967b2 for instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d on n-h2-843834-3 Jul 19 21:21:22.101272 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-99bf22d3-8053-4485-a1f5-9acd8fa22f8a req-7676b007-c978-47b3-a072-a97e9b20f138 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111170 Jul 19 21:21:22.102169 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3560/7224] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:22.361107 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:22.362364 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:22.372325 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:22.373439 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:22.373727 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:22.374331 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:22.416400 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:22.416850 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:22.418052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lazy-loading 'fault' on Instance uuid 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:21:22.466041 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:22.483523 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-46e32a17-18c1-4aec-8645-215ad8227070 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 200 len: 1337 microversion: 2.1 time: 0.127667 Jul 19 21:21:22.484254 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3665/7225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:22 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 1337 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:23.504420 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:23.505033 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:23.511620 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:23.512093 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:23.512868 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:23.513310 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:23.532171 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] HTTP exception thrown: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Request method failure captured: Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d HTTP/1.1 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1x89payjPrFLXgm2DoswNX4bu5NAlTYbnfSLTVqJ9WS5fgE0IlGtLQaEq9tb6y5Gl2MI1FlGUoomU1UjxQ19nzZrbll4YUnS-or2HajPQeoEepd66u2J94SFvSASlXtzpHwArHsjDYTV5Z58kfVGRylSJqX21lpMWqohLcPL1y10nqg Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b9675e0b1bb440e1bc1681e5d4ebfe37 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b9675e0b1bb440e1bc1681e5d4ebfe37 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestSnapshotPattern-1429978639-project Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3806a525d27245f696ddfdfa16319452 Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestSnapshotPattern-1429978639-project Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d'} Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:21:23.533883 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Returning 404 to user: Instance 90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-f8fc20f7-562f-4060-b72b-34f26d4fc092 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d" status: 404 len: 111 microversion: 2.1 time: 0.037241 Jul 19 21:21:23.538303 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3561/7226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:23 2022] GET /compute/v2.1/servers/90aa4d3e-4ff7-4422-b2ca-0de3716a1c5d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:21:25.018932 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:25.019766 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:25.021625 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-4596b3c2-8a50-4903-b29b-698945db8d1a req-bd4adc6e-752c-41c1-82b4-385989e85a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:25.031602 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:25.032326 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:25.033627 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:25.034323 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:25.037887 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4596b3c2-8a50-4903-b29b-698945db8d1a req-bd4adc6e-752c-41c1-82b4-385989e85a28 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:25.039059 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-4596b3c2-8a50-4903-b29b-698945db8d1a req-bd4adc6e-752c-41c1-82b4-385989e85a28 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:25.059871 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-4596b3c2-8a50-4903-b29b-698945db8d1a req-bd4adc6e-752c-41c1-82b4-385989e85a28 service nova] Creating event network-changed:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:21:25.068374 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-4596b3c2-8a50-4903-b29b-698945db8d1a req-bd4adc6e-752c-41c1-82b4-385989e85a28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053126 Jul 19 21:21:25.069849 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3562/7227] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:25.082085 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Going to try to terminate instance {{(pid=131229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:21:25.206251 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-c976e3c0-346c-4026-b59a-a1a32fb51195 tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 204 len: 0 microversion: 2.1 time: 0.193050 Jul 19 21:21:25.210443 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3666/7228] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 19 21:21:25 2022] DELETE /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:21:25.218995 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:25.219910 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:25.227257 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:25.228189 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:25.229276 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:25.230600 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:25.396095 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.policy [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131230) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:25.404406 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-0cd3b7a8-9bf3-4ac1-b4c1-1999dcf9630d tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1681 microversion: 2.1 time: 0.191823 Jul 19 21:21:25.405017 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3563/7229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:25 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:26.424809 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:26.425510 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:26.433845 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:26.434312 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:26.435154 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:26.435593 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:26.588863 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:26.597120 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-fcd26208-763f-4754-85c5-8f3efdd07d7a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1681 microversion: 2.1 time: 0.176620 Jul 19 21:21:26.597750 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3667/7230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:26 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:21:27.221673 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [req-421b0c1c-9a33-42d8-9124-f6e5a6b44b46 req-c3d3ec1b-e049-4251-b8d9-3a78d15e2eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c5c22-089b-4d21-b844-4286d88a12c7", "name": "network-vif-deleted", "tag": "d6822cf5-6fef-44f6-97f1-7dab89488ce1"}]} {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:21:27.233288 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-421b0c1c-9a33-42d8-9124-f6e5a6b44b46 req-c3d3ec1b-e049-4251-b8d9-3a78d15e2eb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:27.233755 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [req-421b0c1c-9a33-42d8-9124-f6e5a6b44b46 req-c3d3ec1b-e049-4251-b8d9-3a78d15e2eb5 service nova] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:27.261291 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.compute.server_external_events [req-421b0c1c-9a33-42d8-9124-f6e5a6b44b46 req-c3d3ec1b-e049-4251-b8d9-3a78d15e2eb5 service nova] Creating event network-vif-deleted:d6822cf5-6fef-44f6-97f1-7dab89488ce1 for instance 084c5c22-089b-4d21-b844-4286d88a12c7 on n-h1-843834-3 Jul 19 21:21:27.266491 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [req-421b0c1c-9a33-42d8-9124-f6e5a6b44b46 req-c3d3ec1b-e049-4251-b8d9-3a78d15e2eb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048625 Jul 19 21:21:27.267233 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3564/7231] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 19 21:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:21:27.615263 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:27.616461 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.compute.api [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131229) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:27.624063 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:27.625483 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:27.626551 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:27.627235 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:27.668773 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:27.669219 n-d-843834-3 devstack@n-api.service[131229]: DEBUG oslo_concurrency.lockutils [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:27.669668 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.objects.instance [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lazy-loading 'fault' on Instance uuid 084c5c22-089b-4d21-b844-4286d88a12c7 {{(pid=131229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:21:27.718877 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.policy [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3806a525d27245f696ddfdfa16319452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9675e0b1bb440e1bc1681e5d4ebfe37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131229) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:21:27.726665 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-2b4426d9-4d30-452d-ad30-a44d612f900a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 200 len: 1337 microversion: 2.1 time: 0.115598 Jul 19 21:21:27.727304 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3668/7232] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:27 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 1337 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:21:28.751946 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '>' {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:28.752681 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.compute.api [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] [instance: 084c5c22-089b-4d21-b844-4286d88a12c7] Fetching instance by UUID {{(pid=131230) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:21:28.759993 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:28.760489 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:28.761287 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:21:28.761744 n-d-843834-3 devstack@n-api.service[131230]: DEBUG oslo_concurrency.lockutils [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Lock "20398988-5dca-4cfe-920d-ac0c6c1185cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:21:28.776104 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.wsgi [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] HTTP exception thrown: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Request method failure captured: Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: request: GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 HTTP/1.1 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Accept: application/json Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Accept-Encoding: identity Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Connection: close Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Content-Length: 0 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Content-Type: application/json Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Host: 10.222.0.23 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: Openstack-System-Scope: None Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: User-Agent: python-urllib3/1.26.9 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Auth-Token: gAAAAABi1x89payjPrFLXgm2DoswNX4bu5NAlTYbnfSLTVqJ9WS5fgE0IlGtLQaEq9tb6y5Gl2MI1FlGUoomU1UjxQ19nzZrbll4YUnS-or2HajPQeoEepd66u2J94SFvSASlXtzpHwArHsjDYTV5Z58kfVGRylSJqX21lpMWqohLcPL1y10nqg Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Id: None Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Domain-Name: None Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Identity-Status: Confirmed Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Is-Admin-Project: True Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Id: default Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Domain-Name: Default Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Id: b9675e0b1bb440e1bc1681e5d4ebfe37 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Project-Name: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Role: reader,member Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Roles: reader,member Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9675e0b1bb440e1bc1681e5d4ebfe37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Id: b9675e0b1bb440e1bc1681e5d4ebfe37 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-Tenant-Name: tempest-TestSnapshotPattern-1429978639 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-User: tempest-TestSnapshotPattern-1429978639-project Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Id: default Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Domain-Name: Default Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Id: 3806a525d27245f696ddfdfa16319452 Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: X-User-Name: tempest-TestSnapshotPattern-1429978639-project Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: method: > Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: exception: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: action_args: {'id': '084c5c22-089b-4d21-b844-4286d88a12c7'} Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: {{(pid=131230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:21:28.777844 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: ERROR nova.api.openstack.wsgi Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: DEBUG nova.api.openstack.wsgi [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Returning 404 to user: Instance 084c5c22-089b-4d21-b844-4286d88a12c7 could not be found. {{(pid=131230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: INFO nova.api.openstack.requestlog [None req-5d8d45fc-9636-4940-9686-3befbc8e257a tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7" status: 404 len: 111 microversion: 2.1 time: 0.033337 Jul 19 21:21:28.782356 n-d-843834-3 devstack@n-api.service[131230]: [pid: 131230|app: 0|req: 3565/7233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 19 21:21:28 2022] GET /compute/v2.1/servers/084c5c22-089b-4d21-b844-4286d88a12c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:21:28.967052 n-d-843834-3 devstack@n-api.service[131229]: DEBUG nova.api.openstack.wsgi [None req-4dbd56df-76b6-4fe3-bfb3-97c514898c8c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] Calling method '.version_select at 0x7f23ee309670>' {{(pid=131229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:21:28.996586 n-d-843834-3 devstack@n-api.service[131229]: INFO nova.api.openstack.requestlog [None req-4dbd56df-76b6-4fe3-bfb3-97c514898c8c tempest-TestSnapshotPattern-1429978639 tempest-TestSnapshotPattern-1429978639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-426902291" status: 202 len: 0 microversion: 2.1 time: 0.034098 Jul 19 21:21:28.997232 n-d-843834-3 devstack@n-api.service[131229]: [pid: 131229|app: 0|req: 3669/7234] 10.222.0.23 () {58 vars in 1253 bytes} [Tue Jul 19 21:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-426902291 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:22:29.278546 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:22:29.279206 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:22:29.926117 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:22:29.926693 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:09.368300 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:09.368960 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:09.480874 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:09.481473 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:29.168829 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:29.169473 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:25:49.290286 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:25:49.291072 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:25:49.935465 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:25:49.936117 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:26:25.235509 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:26:25.236295 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:27:29.378659 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:27:29.379308 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:27:29.491257 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:27:29.491908 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:27:49.178160 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:27:49.179159 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:29:09.300494 n-d-843834-3 devstack@n-api.service[131230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:29:09.301266 n-d-843834-3 devstack@n-api.service[131230]: Tue Jul 19 21:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:29:09.945773 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:29:09.946417 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:29:45.246738 n-d-843834-3 devstack@n-api.service[131229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:29:45.247357 n-d-843834-3 devstack@n-api.service[131229]: Tue Jul 19 21:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!